Senior Lead Data Engineer - R01548037

Job Description

Senior Lead Data Engineer


Primary Skills
  • HDFS, Spark - Pyspark, ETL Fundamentals, SOLR, Model Provisioning: Kubernetes, Kibana, SQL, SQL (Basic + Advanced), Spark - Scala, Talend, Python, AWS Elastic Cache, Spark - Java, Data Warehousing, PLSQL, T-SQL, Stored Procedures

  • Job requirements

  • Job Title: Sr Talend Engineer/Lead
    Location: St. Louis, MO (Remote is fine)
    JD:
    We are seeking a talented Talend Engineer to join our data engineering team. The ideal candidate will be responsible for designing and optimizing data workflows using Talend to support the creation and editing of Campaign Data. This role requires collaboration with data architects, SQL engineers, and product owners to meet business requirements while ensuring scalability, efficiency, and high-quality outcomes.
    Key Responsibilities
  • 1. Data Workflow Development
  • o Maintain and optimize the data pipeline to Salesforce Marketing Cloud through a system of Talend jobs.
    o Develop data views, with custom attributes, for automated campaigns o Collaborate with Data teams – Data architects, SQL engineers, and product owners to gather requirements.
    o Design and develop scalable data workflows using Talend to create or edit Campaign Data Management effectively.
  • 2. Job Optimization and Rule Engineering
  • o Optimize Talend jobs to address Campaign Data requirements.
    o Enhance job performance and ensure efficient processing of large data volumes.
  • 3. Pipeline Building and Scheduling
  • o Develop robust data pipelines for file creation and ensure accurate scheduling for timely delivery.
    o Automate and monitor workflows to streamline operations and reduce manual intervention.
  • 4. Problem Solving and Validation
  • o Identify and resolve issues in data workflows and processes.
    o Build and implement validation checks to ensure data accuracy and reliability throughout the pipeline.
  • 5. Softskills
  • o Customer Centericity, Communication and can do mindset/attitude are important for this role.
    Know more about: