Senior AI & Data Engineer (Scala, Spark, GCP)

Role: Senior AI & Data Engineer (Scala, Spark, GCP).

Location: Sunnyvale, CA (Hybrid (2 days onsite))

Contract W2.

Skills Required: SCALA, SPARK, GCP preferred, LLM, AI.

Job Description:

We are seeking a highly skilled Senior AI & Data Engineer to join our team and work on a cutting-edge Marketing Technology Platform.

In this role, you will focus on data engineering while also exploring AI-driven innovations.

You will work with structured and unstructured data, perform ETL processes using Scala, Spark, and Java, and operate in a GCP-based environment leveraging Hive tables.

Additionally, you will play a key role in Next-Gen AI strategy, helping integrate LLM models into the platform. This role combines data engineering and data science, with a stronger emphasis on engineering.

Key Responsibilities:

Extract, transform, and load (ETL) data from structured and unstructured sources.

Develop scalable and efficient data pipelines using Scala, Spark, and Java.

Work within a GCP environment, leveraging Hive tables and cloud-based big data solutions.

Optimize and maintain high-performance data processing workflows.

Collaborate with AI/ML teams to integrate Large Language Models (LLMs) into the platform.

Explore and implement Next-Gen AI strategies for marketing technology applications.

Ensure data quality, governance, and compliance across all engineering tasks.

Required Skills & Experience:

Strong experience in Scala, Spark, and Java for big data processing.

Hands-on experience working in a Google Cloud Platform (GCP) environment.

Proficiency in ETL development and data pipeline orchestration.

Experience handling structured and unstructured data.

Familiarity with Hive tables and distributed data storage solutions.

Understanding of AI/ML concepts, with experience in integrating LLMs preferred.

Strong problem-solving skills and ability to work in a fast-paced environment.