Senior Data Engineer (Python & Snowflake)

🌟 Accomplished Tech Visionary: 

Elevate your expertise to new heights at 3Pillar, the premier destination for trailblazing senior software engineers like yourself. Picture collaborating with industry leaders, spearheading transformative projects that redefine urban living, establishing new media channels for enterprise companies, or driving innovation in healthcare. Our mission is to revolutionize the tech landscape, and your skills are integral to achieving this ambitious goal.

Your role extends beyond the realm of code composition; you will architect transformative solutions that reshape entire industries. Join us and spearhead the charge toward a tech future that transcends the ordinary. 🔮🌐

• Primarily responsible for analyzing data integrity challenges including investigating, correcting, and monitoring data to help identify and address key data issues. Must be comfortable remedying data integrity issues and identifying root cause analysis by going through the code.
• Facilitate effective communication with client project stakeholders regarding project status and recommendations.
• Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality.
• Actively participate in accurate planning and estimation efforts, utilizing project methods and tools.
• Proficiently gather requirements and organize/present developed features for clients.
• Execute complex activities within the current methodology and quality standards, showcasing success across diverse engagements.
• Promote client success across the team by collaborating with engineers, designers, and managers to understand user pain points, anticipate potential problems, and iterate on solutions that drive client success.
• Engage in agile software development, including daily stand-ups, sprint planning, team retrospectives, and other governance activities.
• Actively participate in the Engineering Practice community, mentoring others through Communities of Practice (CoPs) or on project teams, and supporting the growth of technical capabilities.
• Independently drive project delivery within defined architecture, demonstrating autonomy and accountability in all stages from conceptualization to deployment.

• Experience/expertise in the following areas specified below:
  • Design and implement scalable backend services and APIs using Python
  • Collaborate with cross-functional teams to define and execute on technical requirements
  • Optimize system performance and troubleshoot issues
  • Stay updated with the latest Python and SQL to drive continuous improvement
  Must-Have Skills & Tools:
  • Languages: SQL, Python
  • Skills/Responsibilities: MS SQL Server, Snowflake (data warehouse), Hevo / dbt
  • Tools: Jira, Bitbucket, Slack/Teams
  Good to Have Skills:
  • Languages: Javascript
  • Skills/Responsibilities: Dynamo DB, AWS Services, Rockset (analytical engine)
  • Experience in Agile software development methodologies.
  • Expertise in working with SQL and SQL MS Server
  • Experience in creating and implementing well-tested, scalable, and performant enterprise-level systems.
  • Practice and initiative mentoring other engineers and decision-makers throughout the organization.
  • Proficiency in the English language.

• Ability to optimize backend performance and troubleshoot issues.
• Familiarity with modern frontend build tools and CI/CD pipelines.
• Excellent problem-solving skills and a proactive attitude towards challenges.
• Strong verbal and written communication skills.
• Professional software engineering experience, working on multi-discipline teams
• Experience in backend development with expertise in node.js 
• Proficiency in designing and implementing RESTful APIs and microservices architecture.
• Good knowledge of AWS services like Lambda, API Gateway, DynamoDB/RDS, and S3.
• Experience with containerization using Docker and orchestration with Kubernetes (optional).
• Excellent problem-solving skills and a proactive attitude towards challenges.
• Object-Relational Mappers (ORMs)
• Architectural (Microservices, Serverless etc) and Design (Factory, Singleton, Observer etc) Patterns
• Unit Testing