Cloud Data Engineer (Hadoop / Spark / Bigdata)

GIOS Technology

Role Description

Posted on: 
Sep 12, 2024

We are hiring for Cloud Data Engineer (Hadoop / Spark / Bigdata)

Location : Hybrid - 2 days per week in Solihull Office

• Design, develop, and optimize data pipelines using Scala, Spark, and cloud technologies.

• Integrate data from diverse sources into the Raw Layer of DATAHUB.

• Model data and develop efficient data pipelines to enrich and transform large volumes of data.

• Implement data transformation and quality control processes to ensure data consistency and accuracy.

• Strong programming skills in Scala, Python, and SQL.

• Experience with data processing frameworks like Apache Spark.

• Knowledge of cloud platforms (AWS, GCP) and cloud-native technologies.

• Familiarity with data warehousing and data modeling concepts.

• Experience with data quality tools and techniques.

• Understanding of CI/CD pipelines and DevOps practices.

• Set up CI/CD pipelines for automated deployment and testing.

Key Skills : Cloud Data Engineer (Hadoop / Spark / Bigdata)

Apply Now
> Start 3-Day Free Trial

Roles Published Yesterday
To see roles published in the last 48 hours, sign-up to 3-day free trial of Role Scout.