17.06.2025
DevOps Consultant
Kafka Migration
An opportunity to show your data platform modernization skills and technical leadership in Kafka migration project.
Start
01.10.2025
Duration
5mo
Location
Helsinki, remote
Allocation
100%
I'm seeking an experienced DevOps consultant to lead a critical infrastructure migration project: transitioning our Apache Kafka deployment from self-managed infrastructure to Azure cloud-managed Aiven Kafka services, while ensuring zero-downtime operations and establishing a robust long-term operational model.
Role and Responsibilities
Role and Responsibilities
- Lead the Kafka Migration: Plan and execute the migration from self-managed Kafka to Azure-managed Aiven Kafka with minimal disruption to production data flows
- Infrastructure as Code: Design and implement the new cloud infrastructure using Terraform, ensuring scalability, security, and maintainability
- CI/CD Integration: Adapt and optimize existing GitLab CI/CD pipelines to support the new Aiven Kafka architecture and deployment workflows
- Data Pipeline Continuity: Ensure seamless operation of data connectors, consumers, and producers throughout the migration process
- Security Implementation: Configure and manage certificate-based authentication (mTLS) and integrate with existing private CA infrastructure
- Knowledge Transfer: Conduct workshops and create comprehensive documentation for the internal team on the new architecture and operational procedures
- Operational Excellence: Establish monitoring, alerting, and operational runbooks for the new managed services environment
Key Expectations
- Kafka Expertise: Deep experience with Apache Kafka ecosystem including Kafka Connect, MirrorMaker 2, and large-scale cluster operations
- Cloud Migration Leadership: Proven track record in migrating critical data infrastructure to managed cloud services, particularly in hybrid cloud environments
- Terraform Proficiency: Advanced skills in Infrastructure-as-Code with Terraform, especially for Azure and multi-cloud deployments
- GitLab CI/CD: Strong experience integrating data platform operations with GitLab CI/CD pipelines
- Security Focus: Hands-on experience with certificate management, mTLS configuration, and enterprise security practices
- Migration Strategy: Ability to design and execute zero-downtime migration strategies for business-critical data platforms
- Workshop Facilitation: Experience in conducting technical workshops and creating operational documentation for knowledge transfer
Preferred Qualifications
- Experience with Aiven managed services or similar cloud-native data platforms
- Background in large-scale data platform migrations and modernization projects
- Familiarity with PostgreSQL administration and integration patterns
- Understanding of hybrid cloud networking and security considerations
- Experience in establishing managed services operational models
