Sr. Data Engineer

Job Description

Are you passionate about building scalable, high-performance data pipelines? We are looking for a talented Data Engineer to join our team and help us process, transform, and analyze healthcare claims data at scale. As a key member of our data engineering team, you will work on building robust ETL pipelines, optimizing data workflows, and enabling advanced analytics to support key business initiatives.

In this role, you will:

• Design, build, and maintain scalable data pipelines to process claims data efficiently using Spark (Scala/PySpark), AWS Glue, and Airflow.
• Work closely with analysts, backend engineers, and other stakeholders to ensure high data quality, reliability, and accessibility.
• Optimize and tune distributed data processing workflows for performance and cost efficiency.
• Develop and enforce best practices for data governance, schema evolution, and pipeline observability while understanding the nuances of security and compliance.
• Implement automated testing, monitoring, and alerting for data workflows to ensure operational excellence.
• Collaborate with stakeholders to define and implement data models that support analytics and business intelligence initiatives.

Our backend tech stack:

• Data Processing: Apache Spark (Scala/PySpark), AWS Glue
• Orchestration: Apache Airflow, AWS Glue
• Infrastructure: AWS

Requirements

You’ll be an ideal candidate if you:

• Have 4+ years of experience working with big data processing frameworks, such as Apache Spark (Scala or PySpark).
• Have hands-on experience building ETL pipelines for structured and semi-structured healthcare claims data.
• Are proficient in SQL and have experience working with distributed databases and data lakes (e.g., Delta Lake, Redshift, Snowflake).
• Have experience orchestrating workflows using Apache Airflow and managing data processing on AWS Glue or EMR.
• Are comfortable working in a cloud-native environment (AWS preferred) and using infrastructure-as-code tools like Terraform.
• Have strong problem-solving skills and the ability to take ownership and work autonomously in a fast-paced environment.
• Embrace a growth mindset, continuously seeking to improve processes, learn new technologies, and mentor others.
• Bonus: Experience with healthcare data standards (FHIR, HL7, medical and / or pharmacy claims) and building HIPAA-compliant data systems.

The salary range for this position is $175,000–$220,000, with the final offer determined based on the candidate’s experience, skills, and location.

At Motion MSK, we believe diversity makes us stronger. We are proud to be an Equal Opportunity Employer and are committed to fostering an inclusive workplace where everyone belongs. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, genetic information, military status, or any other protected status under applicable laws.

If you need accommodations during the application or interview process, please let us know—we’re happy to help!

Benefits

At Motion, we know that providing great care starts with taking care of our team. That’s why we’re committed to supporting you both professionally and personally, offering a comprehensive set of benefits designed with your well-being in mind.

• Health Benefits: We’ve got you covered—literally. Our dental and vision plans are 100% company-paid AND our medical plans are up to 90% company-paid, keeping health benefits for you not only accessible but also affordable!
• Retirement Savings: Secure your future with our competitive retirement plans, which include a company match to help you grow your savings.
• Paid Time Off: From PTO and holidays to parental and bereavement leave, we’re here to support you through all of life’s moments.
• Family Building: We’re here for you as you grow your family, offering financial support for fertility treatments and family-building assistance.:
• Mental Health Support: Your mental health matters. That’s why we provide free 24/7 access to mental health resources to ensure you’re supported whenever you need it.