Data Engineer

Job Description

About Anteriad

We are not just another B2B solution provider. We're problem solvers. We believe that data is the key to unlocking effective solutions that span a range of marketing challenges - from customer acquisition to demand generation to account-based marketing. Data is at the core of everything we do. Our team works tirelessly to create powerful solutions that drive real results for our clients. Whether it's through innovative technology or deep analysis, we're committed to finding the best path to growth for every one of our customers.

Why Join Our Database Solutions Team?

As our Data Engineer, you will support our custom data platforms. This role focuses on building, maintaining, and continuously evolving data ingestion and transformation pipelines using Azure Data Factory, Databricks, and emerging Microsoft Fabric capabilities, while preserving and reusing existing SQL logic wherever possible. You will play a key role as we modernize and migrate SQL Server–based workloads currently running on Azure virtual machines to Azure‑native data services.

You will stand out if you have hands‑on experience using Azure data tools as well as SQL Server experience.

Each custom data platform is actively maintained and enhanced over time to support new and evolving requests from campaign services and analytics teams. You must be comfortable working on ongoing, parallel initiatives, balancing modernization work with continuous delivery of incremental enhancements.

Anteriad means “always moving forward” and we apply that to our company culture by tirelessly promoting an environment that allows our employees to thrive:

• Flexible PTO & Company Holidays
• Flexible Schedule
• Continuous Professional Training and Development
• Mix Of Collaborative & Independent Work
• Community Outreach Opportunities via Anteriad Cares
• Professional Global Mentoring Program - Career Guidance From Leadership
• Great Benefits For You And Your Family

Benefits We Bring To You:

• Comprehensive medical (choice of 3 plans), dental and vision coverage
• Company paid short-term disability, long term disability and life Insurance
• Optional supplemental life, accident and critical illness insurance plans
• 401K with company match
• Flexible PTO and generous holiday schedule
• Fully paid primary caregiver leave (12 weeks) & parental bonding leave (2 weeks)

What You’ll Do:

• Build and maintain data ingestion pipelines using Azure Data Factory (ADF) to move data into the corporate Azure Data Lake and related platforms.
• Develop and enhance data transformation logic in Databricks notebooks, primarily leveraging SQL‑based transformations in existing SQL scripts and stored procedures.
• Support a medallion data architecture (Bronze, Silver, Gold) with Silver and Gold datasets stored primarily in Parquet format.
• Assist in migrating SQL Server–based processes (scripts, stored procedures, SSIS logic) running on Azure VMs into Azure‑native pipelines and Databricks transformations.
• Continuously update and enhance existing database solutions and systems based on new and evolving requirements from marketing campaign activation and analytics teams, ensuring data remains accurate, timely, and fit for purpose.
• Manage multiple concurrent initiatives, including modernization efforts and ongoing enhancement requests, while maintaining platform stability and data quality.
• Configure Azure Data Factory pipelines to orchestrate Databricks notebooks and Fabric‑related processes as applicable.
• Use Azure DevOps for source control, versioning, and deployment of Azure Data Factory, Databricks, and Fabric assets.
• Test, monitor, and troubleshoot pipelines to ensure data reliability, performance, and quality.
• Collaborate with senior engineers, project managers, campaign services, analytics, and platform teams to deliver ongoing data solutions. Participate in the adoption and use of Microsoft Fabric, understanding how Fabric components (e.g., OneLake, Lakehouse, Warehousing) integrate with existing Azure and Databricks workflows.
• Maintain technical documentation for data pipelines, transformations, and datasets

What You’ll Bring:

Required Qualifications:

• Hands‑on experience building or supporting pipelines in Azure Data Factory.
• Experience developing data transformations in Databricks, preferably using SQL within notebooks.
• Experience working with Azure Data Lake Storage or similar cloud storage platforms.
• Familiarity with modern data lake and analytics concepts, including medallion architecture.
• Experience with SQL Server, including writing, maintaining, and understanding complex SQL scripts and stored procedures.
• Experience using Git / Azure DevOps for source control.
• Experience with Python for use in Databricks notebooks and supporting data pipeline operations.
• Ability to follow established architectural patterns and implementation standards.
• Strong analytical, troubleshooting, and communication skills.

Nice‑to‑Have Qualifications:

• Exposure to Microsoft Fabric, including Lakehouse, Warehousing, or OneLake concepts.
• Experience integrating or evaluating Fabric alongside existing Azure and Databricks ecosystems.
• Experience migrating SQL Server workloads from Azure VMs to Azure‑native or Fabric‑based platforms.
• Prior exposure to SSIS and translating ETL logic into cloud‑based pipelines.
• Familiarity with data governance and data hygiene best practices, supporting clean, consistent, and trustworthy data for downstream use.

#LIremote