Senior Staff Data Engineer (R12399)

ABOUT OPORTUN

Oportun (Nasdaq: OPRT) is a mission-driven fintech that puts its 2.0 million members' financial goals within reach. With intelligent borrowing, savings, and budgeting capabilities, Oportun empowers members with the confidence to build a better financial future. Since inception, Oportun has provided more than $16.6 billion in responsible and affordable credit, saved its members more than $2.4 billion in interest and fees, and helped its members save an average of more than $1,800 annually. Oportun has been certified as a Community Development Financial Institution (CDFI) since 2009.

WORKING AT OPORTUN

Working at Oportun means enjoying a differentiated experience of being part of a team that fosters a diverse, equitable and inclusive culture where we all feel a sense of belonging and are encouraged to share our perspectives. This inclusive culture is directly connected to our organization's performance and ability to fulfill our mission of delivering affordable credit to those left out of the financial mainstream. We celebrate and nurture our inclusive culture through our employee resource groups.

Position Overview

We are seeking a highly skilled and experienced Senior Staff Data Engineer to join our dynamic team. The right candidate shall lead the development of our data infrastructure, from ingestion, ETL / ELT, aggregations, processing, quality checks, certifying data to regulatory standards, and making the data available for usage in analytics, data science, and CXO suite dashboards. Your work enables us to deliver advanced and impactful solutions to our clients. As the Senior Staff Data Engineer at Oportun, you will assume a pivotal role in elevating our data engineering capabilities, responsible for conceiving and implementing a state-of-the-art data infrastructure. Collaborating seamlessly with diverse teams, including data engineers, data scientists, engineers, analysts, product managers, and senior leaders, you will craft revolutionary solutions that redefine the norms of FinTech. Your profound expertise in architecting and deploying data architectures will be instrumental in propelling our products to new dimensions of sophistication and success.

Responsibilities :

Model deployment & Infrastructure Automation

•  Architect and deploy end-to-end MLops pipelines on databricks for automated model training, deployment, and versioning.
•  Implement CI/CD pipelines for ML models using Github actions, Terraform

ML model Orchestration & Management

•  Leverage databricks MLflow for model tracking, versioning, and lifecycle management.
•  Deploy models using databricks model serving, sagemaker ML endpoints.
•  Build real-time ML inference pipelines with databricks jobs and delta live tables.
•  Optimize spark-based ML training workloads for scalability and cost efficiency.

Model monitoring & observability

• Implement automated model monitoring for drift detection, bias tracking, and performance degradation.
•  Set up logging, alerting, and monitoring using databricks unity catalog, MLflow, new relic.
•  Enable automated model rollback strategies based on performance degradation thresholds.
•  Implement a/b testing and shadow deployments for model validation before full rollout.

 Security, compliance & governance

•  Ensure model security and compliance with GDPR, SOC2, HIPPA, FTC standards.
•  Use unity catalog and lakehouse governance for access control, model lineage, and auditability.
•  Establish data encryption, identity management (iam), and secure model serving practices.
•  Enforce reproducibility and explainability using MLflow and databricks lakehouse governance.

Scaling & performance optimization

• Optimize ML training and inference costs by tuning databricks clusters, spark jobs, and delta lake performance.
•  Scale MLops workflows to handle large volumes of data and concurrent model deployments.
•  Automate GPU/TPU resource allocation for high-performance training workloads.

• Set the strategic vision and lead the implementation of a cutting-edge data infrastructure roadmap, encompassing all facets as highlighted above.

• Provide exceptional technical leadership, mentoring, and guidance to a team of data engineers, fostering a culture of continuous learning and innovation.
• Collaborate closely with data scientists to translate intricate model requirements into optimized data pipelines, ensuring impeccable data quality, processing, and integration.
• Spearhead the establishment of best practices for model versioning, experiment tracking, and model evaluation to ensure transparency and reproducibility.
• Engineer automated CI/CD pipelines that facilitate seamless deployment, monitoring, and continuous optimization for code and configurations in data engineering.
• Define and refine performance benchmarks, and optimize data infrastructure to achieve peak correctness, availability, cost efficiency, scalability, and robustness.
• Highly motivated self-starter who loves ownership and responsibility while working in a collaborative and interdependent team environment.
• Work with multiple teams of data engineers to design, develop, and test major software and data systems components using an agile, scrum methodology.
• Drive strong data engineering practices around product development execution, operational excellence in observability, quality, reliability, and developer efficiency.
• Remain at the forefront of industry trends and emerging technologies, expertly integrating the latest advancements into our data ecosystem.

Qualifications

• Requires 12+ years of related experience in data engineering, with a Bachelor's degree in Computer Science; or a Master's degree with an equivalent combination of education and experience.
• Experience in MLOps, ML infrastructure, or ML platform engineering
• Expert in databricks, with hands-on experience in MLflow, model serving, and delta lake.
• Strong background in CI/CD automation for ML models using Github actions, Terraform.
• Proficiency in Python, Spark, and SQL, specifically for ML pipeline automation
• Experience with feature stores (databricks feature store) for ML feature standardization
• Extensive experience orchestrating the development of end-to-end data engineering infrastructure for intricate and large-scale applications.
• Proven record of transformative leadership, guiding technical teams to achieve remarkable outcomes and innovation.
• Profound mastery of data engineering architecture and frameworks across batch and stream processing of data, such as Hadoop ecosystem, Medallion architecture, Databricks or equivalent data warehouse / data lake platforms, coupled with Python / PySpark programming. 
• .Thorough comprehension of software engineering principles, version control (Git), and collaborative development workflows.
• Adeptness with cloud platforms (AWS / Azure / GCP) and utilization of cloud-native services for crafting robust data engineering infrastructure.
• Track record of successfully integrating DevOps practices, continuous integration, and continuous deployment (CI/CD) pipelines.
• Superior problem-solving acumen and ability to navigate intricate technical challenges with dexterity.
• Exceptional communication aptitude, capable of fostering effective collaboration across diverse teams and stakeholders.

If you are passionate about using your technical & data expertise to drive social impact and financial inclusion, we invite you to join us in our mission at Oportun. Apply now to become a part of our dynamic team and make a difference in the lives of millions.

Preferred Skills

• Experience or Knowledge in financial services domain.
• Experience or Knowledge of one or more data processing frameworks using AWS will be a strong plus.
• Ability to handle multiple competing priorities in a fast-paced environment.

We are proud to be an Equal Opportunity Employer and consider all qualified applicants for employment opportunities without regard to race, age, color, religion, gender, national origin, disability, sexual orientation, veteran status or any other category protected by the laws or regulations in the locations where we operate.

California applicants can find a copy of Oportun's CCPA Notice here:  https://oportun.com/privacy/california-privacy-notice/.

We will never request personal identifiable information (bank, credit card, etc.) before you are hired. We do not charge you for pre-employment fees such as background checks, training, or equipment. If you think you have been a victim of fraud by someone posing as us, please report your experience to the FBI’s Internet Crime Complaint Center (IC3).