Data DevOps Engineer
Summary:
The Data DevOps Engineer will design, develop, and implement scalable Big Data solutions, focusing on automation, dynamic scaling, and self-healing systems. The role involves full lifecycle development, technical advisory, and collaboration with internal and external teams.
Key Responsibilities:
• Develop and optimize scalable clustered Big Data solutions.
• Provide technical leadership on data and adjacent technologies.
• Collaborate with cross-functional teams.
• Enhance and improve solutions through continuous innovation.
Required Skills & Experience:
• DevOps & Automation: CI/CD, Infrastructure as Code (Ansible, Terraform, Jenkins).
• Big Data & Cloud: Apache Spark, Hadoop Ecosystem, Kubernetes, OpenShift.
• Monitoring & Observability: Prometheus, Grafana, ELK, filebeat, SRE principles.
• Scripting & Development: Python, Bash, YAML.
• Networking & Security: NGINX, HAProxy, Linux administration.
• Must hold UK Developed Vetting (DV) – UKIC
Desirable Skills:
• Jupyter Hub, Minio (S3), Trino/Presto, RabbitMQ, NiFi, Rego.
Summary:
The Data DevOps Engineer will design, develop, and implement scalable Big Data solutions, focusing on automation, dynamic scaling, and self-healing systems. The role involves full lifecycle development, technical advisory, and collaboration with internal and external teams.
Key Responsibilities:
• Develop and optimize scalable clustered Big Data solutions.
• Provide technical leadership on data and adjacent technologies.
• Collaborate with cross-functional teams.
• Enhance and improve solutions through continuous innovation.
Required Skills & Experience:
• DevOps & Automation: CI/CD, Infrastructure as Code (Ansible, Terraform, Jenkins).
• Big Data & Cloud: Apache Spark, Hadoop Ecosystem, Kubernetes, OpenShift.
• Monitoring & Observability: Prometheus, Grafana, ELK, filebeat, SRE principles.
• Scripting & Development: Python, Bash, YAML.
• Networking & Security: NGINX, HAProxy, Linux administration.
• Must hold UK Developed Vetting (DV) – UKIC
Desirable Skills:
• Jupyter Hub, Minio (S3), Trino/Presto, RabbitMQ, NiFi, Rego.
