Job Description
We have an opening for a Principal Data Engineer/Architect to collaborate with our Data Platform and Segmentation teams to build solutions that improve our ability to process and leverage data and improve our data integration velocity. As a Data Engineer/Architect, you will partner with various teams to develop business requirements to standardize the business input and develop a long-term vision. You'll play a pivotal role working with other Data Engineers who build and maintain the data pipelines and data lake that enable and accelerate Data Science, Machine Learning, and AI, as well as the engine for real-time segmentation and marketing automation within Constant Contact.
What you’ll do:
- Work closely with Data Science/ML/AI teams to leverage and provide access to the vast data available for data-driven marketing insights for our customers
- Work with cross-functional teams, define data strategies and leverage the latest technologies in data processing and data analytics
- Design, implement, and build data models and pipelines that deliver data with measurable quality under the service level agreement
- Design, develop, and deliver improvements to Constant Contact data integration practices, data analytics, and real-time stream processing
- Work with the teams and stakeholders to scope and prioritize solutions
- Establish rigorous engineering processes to ensure service quality, delivery of new capabilities, and continuously improve metrics.
Who you are:
- 8+ years experience in business analytics, data science, software development, data modeling, and/or data engineering work
- 3+ years of experience creating high-quality data pipelines
- Proficiency in Java, Python, and SQL
- Strong understanding of OLAP concepts with experience with OLAP technologies such as ClickHouse, Druid, Pinot, or similar platforms
- Familiarity with search technologies such as Elasticsearch for high performance real-time applications
- Experience orchestrating data pipelines with technologies such as Airflow, Dagster, and/or NiFi
- Familiarity with stream-processing frameworks such as Apache Flink
- Experience with AWS cloud services including, but not limited to, Kinesis, Glue, S3, Lambda, API Gateway, DynamoDB, and Athena
- Experience with Docker and Kubernetes
- Certification in AWS Cloud (AWS Certified Solutions Architect or similar)
#LI-HK1 #LI-Remote