BA Markets wants to professionalise and streamline its activities with regards to data streaming. Therefore, a new agile team has been created to build up a technical platform for BA Markets users to get a hub for all required streaming services. ​The team will develop the service suite largely internally but will also rely on managed vendor services, such as Databricks. The streaming technology used is Kafka. ​Many BA Markets users are technically quite advanced so the central data streaming team must constantly keep up to date to deliver state of the art services.So, there will be constant development opportunities for the candidate, and the candidate must be comfortable to work in a fast-changing, international environment. The team consists of four members in Hamburg, one member in Stockholm and should also have three colleagues in Poland. What will you do? This is a hybrid role to support the Data Engineers and Software developers with automatization and simplification for the users. ​Vision for this role should be to “Simplify the user experience”. ​​Your tasks and responsibilities: <ul><li>Stream deployment and stream architecture, developments and deployments ​</li><li>Automate workflows and orchestrate data pipelines. ​</li><li>Implement CI/CD routines​</li><li>Implement and monitor “system health” with observability tools and data quality checks​</li><li>Support the development of Client Libraries so other applications can integrate streams in own application and services ​</li><li>Perform Python development ​</li><li>Perform “glue code” development that 95% of use cases can apply. ​</li></ul> Location   Katowice or in Poland remotely

Vattenfall is a European energy company with approximately 20,000 employees. For more than 100 years we have electrified industries, supplied energy to people's homes and modernised our way of living through innovation and cooperation. We are working for fossil freedom.&nbsp;

Data Operations Engineer

BA Markets wants to professionalise and streamline its activities with regards to data streaming. Therefore, a new agile team has been created to build up a technical platform for BA Markets users to get a hub for all required streaming services.&nbsp;​The team will develop the service suite largely internally but will also rely on managed vendor services, such as Databricks. The streaming technology used is Kafka.&nbsp;​Many BA Markets users are technically quite advanced so the central data streaming team must constantly keep up to date to deliver state of the art services.So, there will be constant development opportunities for the candidate, and the candidate must be comfortable to work in a fast-changing, international environment. The team consists&nbsp;of four&nbsp;members in Hamburg, one member in Stockholm and should also have three colleagues in Poland.&nbsp;What will you do?&nbsp;This is a hybrid role to support the Data Engineers and Software developers with automatization and simplification for the users. ​Vision for this role should be to “Simplify the user experience”. ​​Your tasks and responsibilities:&nbsp;<ul><li>Stream deployment and stream architecture, developments and deployments ​</li><li>Automate workflows and orchestrate data pipelines. ​</li><li>Implement CI/CD routines​</li><li>Implement and monitor “system health” with observability tools and data quality checks​</li><li>Support the development of Client Libraries so other applications can integrate streams in own application and services ​</li><li>Perform Python development ​</li><li>Perform “glue code” development that 95% of use cases can apply. ​</li></ul> Location&nbsp;&nbsp; Katowice or in Poland remotely

Data Operations Engineer

About the Job

About the Company

Vattenfall

Similar Jobs

Data Engineer, Parameta Solutions (Madrid)

Data Engineer, Parameta Solutions (Madrid)

Software Engineer

Software Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Sr. Data Engineer

Sr. Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Data Engineer, Parameta Solutions

Data Engineer, Parameta Solutions

Data Engineer

Data Engineer

Staff Data Engineer

Staff Data Engineer