Data Engineer | Mid - Senior | Threat Intelligence

Job Description

Main Responsibilities

Perform comprehensive data analysis to identify patterns, trends, and anomalies in data;

Utilize Python, SQL, AWS, and Pyspark to extract, clean, manipulate, and transform data for analysis purposes;

Generate reports and visualizations using appropriate tools to communicate findings to technical and non-technical stakeholders;

Continuously monitor data quality, identify data gaps or inconsistencies;

Investigate data sources and their reliability;

Provide data insights and recommendations for data driven decision making;

Suggest improvements, changes needed in daily tasks as well as processes.

Core Requirements

Bachelor's degree in Computer Science, Data Science, Mathematics, or a related field;

At least 2 years of experience working as a Data Engineer or a similar role;

Strong knowledge of SQL, Python, AWS, Hudi, and experience in scripting for data manipulation and data analysis;

Knowledge of statistical analysis techniques (Descriptive Statistics, Hypothesis Testing, A/B Testing, etc.);

Strong problem-solving and critical-thinking skills with a keen eye for detail;

Great communication, including written and spoken English;

Be able to work individually as well as in a team;

Excellent time management skills;

Ability to learn quickly.

Considered as an advantage

Familiarity with Pyspark for distributed data processing and analysis;

Experience with data visualization tools (Kibana, Looker, Tableau, etc.);

Experience with ML Ops and Databricks;

Experience working with AWS infrastructure (AWS EMR, Athena, Glue, S3, MSK);

Cybersecurity domain knowledge.

Tools You Will Use

SQL

Python

Jupyter notebook

Pyspark

GitLab

Jira and Confluence

Salary Range

Monthly gross salary from 17600 - 29900 PLN/Month.