Mission

As an Data Engineer, you will mainly focus on the definition and implementation of data flows making data from the plants available to support multiple use cases defined by the business and implemented according to the Agile methodology.

Responsibilities

A major part of the work will consist in the preparation of data for specific use cases defined by the business which involves:

-identifying the more suitable source of data to fill in business requirements,

-designing and developing data pipelines,

-designing, implementing and automating the tests,

-automating the creation of the releases and the deployment thereof.

Moreover, you will play an active role in continuously improving our technical architecture and way of working.

Background

Computer Science or any applied science field with strong affinity for IT

Profile

-Experience:

o   Previous experience as a data engineer or in a similar role (medior or senior profile)

-Technical skills:

o   Programming skills in Python, Java, C#, bash

o Affinity with multiple types of database engines (mainly RDMBS and Timeseries) and hands-on experience with Oracle, InfluxDB, and Snowflake

o Data transformation using python, sql and dbt

o   CI/CD using GitLab and infrastructure-as-code using Terraform

o   Observability and creation of dashboards (Grafana)

o   Hands-on experience with cloud technologies, preferably with AWS, containerization (docker) and container orchestration (Kubernetes)

o At ease with messaging and stream processing; hands-on experience with MQTT, kafka, firehose and flink