Senior Data Engineer

Tata Consultancy Services

Role Description

Posted on: 
Sep 12, 2024

Role: Senior Data Engineer

Job Type: Fixed term Contract

Location: Peterborough (Hybrid)

Ready to utilise your skills and knowledge in AWS Cloud data platform Services?

Are you passionate about Cloud platforms and technology?

We have an exciting role for you as a Senior Data Engineer!

Careers at TCS: It means more

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

• Gain access to endless learning opportunities.

• Lead a team and their technical growth.

• Collaborate with customers and stakeholders.

The Role

As a Senior Data Engineer, you will advise and assist with the AWS cloud data platform services: EC2, EMR, RDS, Redshift, Glue and define data pipeline and workflow management tools like Airflow. In this role, you’ll work with a variety of datasets, transform as per business needs and store in a datastore for further analytics.

Key Responsibilities:

• Provide technical guidance and support with the AWS cloud data platform services.

• Build and optimize ETL data pipelines and processes supporting data transformation, data structures, metadata, data quality and workload management.

• Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

• Process and extract value from large datasets.

Your Profile

Key skills/knowledge/experience:

• Experience building and optimising ETL data pipelines to ingest, transform and load the datasets.

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

• Experience performing root cause analysis on internal and external data.

• Experience in processing and extracting value from large datasets.

• Strong working knowledge with AWS cloud data platform services: EC2, EMR, RDS, Redshift, Glue.

• Strong hands-one with object-oriented scripting languages: Python, Pyspark.

• Working knowledge of data pipeline and workflow management tools like Airflow.

• Experience with relational SQL and NoSQL databases, including MongoDB.

• Experience with stream-processing systems: Spark-Streaming, Kinesis etc.

• Effective communication and stakeholder management skills.

Good to have:

• Agile project experience working in scrums.

• Experience in Databricks.

Rewards & Benefits

TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

Diversity, Inclusion & Wellbeing

At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is ‘Inclusion without Exception’.

You’ll find a welcoming culture and many internal volunteering and social networks to join. Our diversity, inclusion and social activities involve 12 employee networks including LGBTQ+ & Allies, mental health, disability & neurodiversity inclusion and many more, as well as health & wellness initiatives and sports events (we even sponsor the London Marathon).

We are open to all and treat applications equally, regardless of ethnicity, disability, gender identity, gender reassignment, age, sexual orientation, or beliefs.

If you are an applicant who needs a reasonable accommodation due to Disability or Neurodiverse Condition to complete an employment application, or during any phase of the hiring process, please contact us at elena.cioaca@tcs.com with the subject line: “Reasonable Accommodation Request”.

Due to the high volume of applications, we will be unable to contact each applicant individually on the status of their application. If you have not received a direct response within 30 days, then it should be deemed unsuccessful on this occasion.

Application Process:

  1. Online application > 2. Technical discussion > 3. Managerial discussion > 4. HR discussion

Join us and do more of what matters. Apply online now.

Apply Now
> Start 3-Day Free Trial

Roles Published Yesterday
To see roles published in the last 48 hours, sign-up to 3-day free trial of Role Scout.