Data Engineer

Job Description

We are seeking a Data Engineer / Data Lake Engineer to join our team and help build, optimize, and maintain scalable data pipelines and data lake architectures. The ideal candidate will have experience in designing, implementing, and managing data ingestion, transformation, and storage solutions in cloud or on-premise environments.

• Design, develop, and maintain scalable ETL/ELT pipelines to support data ingestion and processing.
• Implement and optimize data lake solutions to ensure efficient data storage, retrieval, and governance.
• Work with structured and unstructured data sources to enable efficient analytics and reporting.
• Collaborate with data scientists, analysts, and business teams to understand data needs and deliver solutions.
• Ensure data integrity, security, and compliance with industry standards.
• Monitor, troubleshoot, and enhance data pipelines for reliability and performance.
• Work with cloud platforms like AWS, Azure, or GCP for data storage and processing.
• Utilize tools such as Apache Airflow, Kafka, Snowflake for data engineering workflows. Acquire data from primary or secondary data sources and maintain databases/data systems
• Identify, analyze and interpret trends or patterns in complex data sets using statistical techniques
• Build and provide ongoing reports that will be utilized to prioritize business and information needs
• Document Analytics Pipeline.

Contribute actively and effectively as an integrated team member.

• Meet regularly with the line manager to review progress.
• Manage issue resolution and critically escalate.
• Work effectively with other teams, units, and departments.
• Manage issues with clarity and ensure effective information flow and team working.
• Support other organization’s priority activities, when necessary.
• Act as an Omilia ambassador.

Requirements

• Bachelors or master’s degree in computer science, Data Engineering, Information Technology, or related field.
• Excellent professional level knowledge of English
• 2-4 years of experience in data engineering, ETL development, or cloud data solutions.
• Hands-on experience with SQL, Python and Scala/Java for data pipeline development.
• Experience with cloud-based data platforms (AWS S3, Azure Data Lake, Google BigQuery, etc.).
• Strong knowledge of relational and NoSQL databases.
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy

Nice to have:

• Experience with big data technologies (Spark, Hadoop, Hive, etc.).
• Experience with containerization technologies like Docker for deploying and managing data pipelines.
• Experience with Snowflake
• Understanding of CI/CD practices and version control (Git, Jenkins, etc.).
• Experience with data governance, cataloging, and security best practices.
• Experience with streaming data technologies (Kafka, Kinesis, etc.).
• Exposure to machine learning workflows or advanced analytics.
• Experience with NLP

Benefits

• Fixed compensation;
• Long-term employment with the working days vacation;
• Development in professional growth (courses, training, etc);
• Being part of successful cutting-edge technology products that are making a global impact in the service industry;
• Proficient and fun-to-work-with colleagues;
• Apple gear.

Omilia is proud to be an equal opportunity employer and is dedicated to fostering a diverse and inclusive workplace. We believe that embracing diversity in all its forms enriches our workplace and drives our collective success. We are committed to creating an environment where everyone feels welcomed, valued, and empowered to contribute their unique perspectives without regard to factors such as race, color, religion, gender, gender identity or expression, sexual orientation, national origin, heredity, disability, age, or veteran status, all eligible candidates will be given consideration for employment.