Job Description
Senior Lead Data Engineer
Primary Skills
HDFS, Spark - Pyspark, ETL Fundamentals, SOLR, Model Provisioning: Kubernetes, Kibana, SQL, SQL (Basic + Advanced), Spark - Scala, Talend, Python, AWS Elastic Cache, Spark - Java, Data Warehousing, PLSQL, T-SQL, Stored Procedures Job requirements
Job Title: Sr Talend Engineer/Lead
Location: St. Louis, MO (Remote is fine)
JD:
We are seeking a talented Talend Engineer to join our data engineering team. The ideal candidate will be responsible for designing and optimizing data workflows using Talend to support the creation and editing of Campaign Data. This role requires collaboration with data architects, SQL engineers, and product owners to meet business requirements while ensuring scalability, efficiency, and high-quality outcomes.
Key Responsibilities
1. Data Workflow Development o Maintain and optimize the data pipeline to Salesforce Marketing Cloud through a system of Talend jobs.
o Develop data views, with custom attributes, for automated campaigns o Collaborate with Data teams – Data architects, SQL engineers, and product owners to gather requirements.
o Design and develop scalable data workflows using Talend to create or edit Campaign Data Management effectively.
2. Job Optimization and Rule Engineering o Optimize Talend jobs to address Campaign Data requirements.
o Enhance job performance and ensure efficient processing of large data volumes.
3. Pipeline Building and Scheduling o Develop robust data pipelines for file creation and ensure accurate scheduling for timely delivery.
o Automate and monitor workflows to streamline operations and reduce manual intervention.
4. Problem Solving and Validation o Identify and resolve issues in data workflows and processes.
o Build and implement validation checks to ensure data accuracy and reliability throughout the pipeline.
5. Softskills o Customer Centericity, Communication and can do mindset/attitude are important for this role.
Know more about:
Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.