[Job 19895] Mid-Level Full Stack Developer (Data Core), Brasil (ingles avançado)

Opportunity Overview:

We are seeking a talented Data Developer to join our high-end technology team, focusing on a cutting-edge product leveraging Generative AI,

This role involves working in a dynamic and innovative environment, utilizing Azure cloud services, including ADLS2, and dealing with complex data structures in SQL and NoSQL databases.

You will be at the forefront of data governance, data modeling, ETL processes, AI-related data processing and scalable data models that accommodate future growth and complexity, ensuring they are efficient and optimized for performance.

Key Responsibilities:

Implement and manage data solutions in Azure Cloud, focusing on ADLS2, SQL, and NoSQL databases.

Develop and oversee data governance and data modeling strategies, ensuring compliance with industry standards and regulations.

Handle data processing tasks including ETL, using tools like Azure Databricks, while ensuring data lineage is documented and traceable.

Engage in data streaming and real-time data processing, ensuring scalability for growing data needs.

Write and maintain scripts primarily in PySpark, ensuring adherence to data contracts and quality standards.

Troubleshoot and resolve data-related issues, ensuring minimal disruption to operations.

Propose and implement best practices in data engineering, emphasizing maintainability and scalability of data solutions.

Collaborate closely with data scientists, analysts, software engineers, and business stakeholders to align data solutions with business objectives, ensuring effective communication of data governance and lineage aspects.

Qualifications:

Proven experience in data engineering and analytics, preferably in a high-tech environment.

Strong proficiency in PySpark, Python, and familiarity with Azure cloud services.

Solid understanding of ADLS2, SQL and NoSQL databases, data governance, and data modeling principles.

Experience with ETL processes, Azure Databricks, and data streaming.

Familiarity with data contracts, ensuring that data provided meets the agreed-upon quality and format standards.

Ability to implement scalable data solutions that can adapt to growing data volumes and complexity.

Ability to stay updated with the latest trends and technologies in data engineering and analytics.

Capable of troubleshooting and problem-solving in data-related operations.

Excellent collaboration skills to work effectively with cross-functional teams.

Preferred Skills:

Additional experience with other programming languages.

Prior work in a similar Generative AI environment.

Certifications or formal training in Azure cloud services and data engineering tools.

Strong communication skills to effectively articulate technical concepts and solutions, especially regarding data governance and lineage.

Collaborate with compliance teams to ensure data practices adhere to legal and regulatory requirements, particularly concerning data privacy and protection.

Foster a culture of data quality and integrity through regular audits and monitoring of data processes.

#MidLevel

#LI-RW1