We are looking for a Product Data Engineer to maintain and optimize data pipelines in AWS for product analytics and decision-making. This role focuses on ensuring data flow, availability, and performance while optimizing costs.
Key Responsibilities:
- Develop and optimize scalable data pipelines using Python and AWS services.
- Manage ETL/ELT workflows with tools like Airflow and Glue for data integrity.
- Improve storage efficiency and query performance for large datasets.
- Implement logging and monitoring for pipeline reliability.
- Collaborate with cross-functional teams to provide quality data for decision-making.
Required Skills & Experience:
- Experience with Data Engineering or a related role.
- Strong Python proficiency for data processing and automation.
- Experience with AWS and basic SQL.
- Hands-on experience with ETL orchestration using Apache Airflow.
- Familiarity with CI/CD pipelines and version control (Git).
Preferred Qualifications:
- Experience with data lake architectures.
- Knowledge of data governance and cost management best practices.