A leading mobile gaming company is looking for a senior data engineer to augment its internal team of data & ML engineers. In the assignment you will work with internal data consumers such as analysts, data scientists and BI developers to serve them with high quality and timely data. You will design, develop and maintain automated, high volume data pipelines (batch and streaming) and data infrastructure, including data lakes, warehouses and data governance tooling. You will continuously optimize data processing frameworks to ensure the scalability, reliability and security of the data pipelines and platforms for demanding big data use cases.
To succeed in the assignment you have:
- Proven experience in designing, implementing and maintaining data pipelines that process massive amounts of data
- Strong Python and SQL skills, Scala experience is a plus
- Experience with AWS data platform components and services (Athena, Presto, EMR..)
- Spark experience
- Experience with microservices, streaming analytics, Kafka is a plus
- Good communication and team working skills
The customer will interview candidates as soon as they are found. Please apply asap!