Cloud Data Engineer (Hadoop / Spark / Bigdata)
GIOS Technology
Role Description
We are hiring for Cloud Data Engineer (Hadoop / Spark / Bigdata)
Location : Hybrid - 2 days per week in Solihull Office
• Design, develop, and optimize data pipelines using Scala, Spark, and cloud technologies.
• Integrate data from diverse sources into the Raw Layer of DATAHUB.
• Model data and develop efficient data pipelines to enrich and transform large volumes of data.
• Implement data transformation and quality control processes to ensure data consistency and accuracy.
• Strong programming skills in Scala, Python, and SQL.
• Experience with data processing frameworks like Apache Spark.
• Knowledge of cloud platforms (AWS, GCP) and cloud-native technologies.
• Familiarity with data warehousing and data modeling concepts.
• Experience with data quality tools and techniques.
• Understanding of CI/CD pipelines and DevOps practices.
• Set up CI/CD pipelines for automated deployment and testing.
Key Skills : Cloud Data Engineer (Hadoop / Spark / Bigdata)