Job Description
What are we looking for?
We are looking for a Senior Data Engineer to join a global leader in government technology. In this opportunity, you’ll leverage all sorts of data, from application event streams to product databases to third-party data, to help stakeholders create products and answer business questions.
Here are some of the exciting day-to-day challenges you will face in this role:
Work with business stakeholders to understand their goals, challenges, and decisionsAssist with building solutions that standardize their data approach to common problems across the companyIncorporate observability and testing best practices into projectsAssist in the development of processes to ensure their data is trusted and well-documentedEffectively work with data analysts on refining the data model used for reporting and analytical purposesImprove the availability and consistency of data points crucial for analysisStanding up a reporting system in BigQuery from scratch, including data replication, infrastructure setup, dbt model creation, and Integration with reporting endpointsRevamping orchestration and execution to reduce critical data delivery timesDatabase archiving to move data from a live database to cold storageYou will shine if you have these skills:
Strong hands-on experience with Python and core Python Data Processing tools such as pandas, numpy, scipy, scikitExperience with cloud tools and environments like Docker, Kubernetes, GCP, and/or AzureExperience with Spark/PySparkExperience with Data Lineage and Data CatalogingRelational and non-relational database experienceExperience with Data Warehouses and Lakes, such as Bigquery, Databricks, or SnowflakeExperience in designing and building data pipelines that scaleStrong communication skills, with the ability to convey technical solutions to both technical and non-technical stakeholdersExperience working effectively in a fast-paced, agile environment as part of a collaborative teamAbility to work independently and as part of a teamWillingness and enthusiasm to learn new technologies and tackle challenging problemsExperience in Infrastructure as Code tools like TerraformAdvanced SQL expertise, including experience with complex queries, query optimization, and working with various database systemsIt doesn't hurt if you also have:
Experience building across cloudsExperience with BI systems like Thoughtspot, Looker, Metabase, or PowerBIKnowledge of different data modeling paradigms, e.g., relational, data vault, and medallionHere are some of the perks we offer you:
Salary in USDLong-termFlexible schedule (within US Time zones)100% Remote
