Brillio

Senior Lead Data Engineer - R01562813

Apply Now

Job Description

Role Summary

 

The Senior Lead Data Engineer is responsible for designing, building, and operating cloud‑native data platforms on Microsoft Azure. This role supports analytics, AI, and image‑driven use cases and provides technical leadership across data ingestion, transformation, and serving layers.



Key Responsibilities
  • Design and implement scalable data pipelines on Azure.
  • Build batch and near‑real‑time data processing solutions.
  • Work with Data Scientists and AI Engineers to enable ML workloads.
  • Develop and optimize data models for analytics and AI consumption.
  • Ensure data quality, reliability, and performance.
  • Contribute to engineering standards, reviews, and best practices.
  • Lead small teams or workstreams and mentor engineers.

  • Required Skills & Experience
  • 6+ years of experience in data engineering.
  • 3–4 years of hands‑on experience with Microsoft Azure.
  • Strong experience with Azure Data Factory, Azure Databricks, Azure Synapse, ADLS Gen2.
  • Solid SQL, PySpark, and data modeling skills.
  • Experience delivering production data pipelines.
  • Familiarity with CI/CD and DevOps practices.
  • Exposure to AI/ML data enablement.
  • Familiarity with Microsoft Fabric / Foundry.
  • Experience handling semi‑structured or unstructured data.