As a Senior/Staff Software Engineer on our Data Infrastructure group, you will contribute to scaling and advancing our entire data infrastructure. This includes building data-related infrastructure and tooling, and collaborating closely with various teams to facilitate and improve their usage of data. You will work with our team lead to design, scope, and deliver large scale projects within the team. You will collaborate closely with a diverse group of engineers, and directly impact the team's productivity and successful delivery. You will help to define the team's technical roadmap towards achieving strategic-level engineering goals. You'll participate in mentorship and development of other engineers on the team, and shaping our company's engineering culture.
We seek brilliant thinkers who are passionate about taming complexity and solving problems through innovation and rigorous engineering. You’ll work in a collaborative environment that encourages creative thinking and experimentation, and values efficiency and attention to detail. Our engineers come from leading technology companies and top academic programs. Our team partners closely with machine learning researchers. We pride ourselves on being kind, friendly, and down-to-earth, and look for people who share those qualities.
Responsibilities
Guide complex initiatives from initial requirements gathering and robust system design to deployment, effectively evaluating dependent technologies and collaborating closely with stakeholders.
Build scalable data infrastructure and shape the developer experience, tackling projects such as owning data cataloging, versioning, and lineage to support seamless research and production workflows.
Provide technical guidance to both engineering and research staff, fostering a supportive environment that accelerates the growth of your teammates.
Experience building data platforms with a developer experience lens — designing APIs, access patterns, or tooling that abstracts infrastructure complexity from end users
Job scheduling and orchestration technologies (e.g. Airflow, Slurm)