Senior DevOps Engineer (Cloud)

We are seeking a highly skilled Senior DevOps Engineer to join our dynamic team and lead the productization of a Proof of Concept (POC) within a big European cloud vendor's infrastructure, focusing on Apache Spark as a Service.

Job Description

The successful candidate will possess extensive experience in DevOps practices and cloud technologies, demonstrating proficiency in designing, implementing, and maintaining scalable and reliable infrastructure. In this role, you will collaborate closely with cross-functional teams to develop strategies for the seamless integration of Apache Spark as a Service into the cloud platform, ensuring optimal performance, security, and cost-effectiveness. As a senior member, you will play a pivotal role in automating deployment processes, enhancing system reliability, and providing technical guidance to junior team members. Your expertise in cloud-based solutions, combined with a deep understanding of Apache Spark, will contribute to the successful productization of the POC, driving innovation and efficiency within our organization. Join us in shaping the future of our cloud-based offerings and advancing our commitment to cutting-edge technology solutions.

Responsibilities

• Lead the end-to-end productization process of a Proof of Concept (POC) centered around Apache Spark as a Service within a cloud vendor's infrastructure
• Design, implement, and maintain robust, scalable, and automated DevOps pipelines for efficient deployment and management of Apache Spark services
• Building dockerized applications, writing helm charts
• Work with gitOps tools
• Automate and optimize infrastructure provisioning, monitoring, and alerting processes to enhance system performance and availability
• Evaluate and implement industry best practices, staying abreast of emerging trends in DevOps and cloud technologies
  
  

Mandatory skills and qualifications

• Proven experience as a Senior DevOps Engineer with a focus on cloud technologies
• Extensive experience with at least one major cloud vendor : Azure, AWS, Google
• Experience with Infrastructure as Code (IaC) tools, such as Terraform or CloudFormation
• Strong knowledge of containerization technologies (e.g., Docker, Kubernetes) and orchestration tools
• Experience with gitOps tools ArgoCD, Flux, work with K8S CRDs
• Loki stack or similar experience (monitoring, logging, observability)
• Excellent problem-solving skills and the ability to troubleshoot complex systems
• Solid understanding of security best practices in cloud-based environments
• Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment
• Some programming knowledge, e.g. Go, Python 3, shell, PowerShell

Optional skills

• In-depth expertise in Apache Spark and its deployment in cloud environments

Benefits

• Competitive salary
• Medical insurance
• Comprehensive training (Linux, streaming & other attractive technologies)
• Opportunity to work in the exciting and challenging industry of web and cloud
• International working experience