AWS Data Engineer

Position: InfoSec AWS Data Engineer

Work Location: Remote

Duration: 12 Months (possible extension)

Job Description:

We are seeking a highly skilled Senior AWS Data Engineer to design, build, and optimize cloud-based data solutions that support our business intelligence, analytics, and machine learning initiatives. The ideal candidate has extensive experience with AWS data services, ETL pipelines, and data governance best practices, ensuring scalable and efficient data infrastructure.

Key Responsibilities:
• Data Architecture & Engineering
• Design, implement, and maintain scalable data pipelines and data lakes using AWS services such as Glue, Lambda, Step Functions, S3, Redshift, and DynamoDB.
• Develop real-time and batch data processing solutions using Apache Spark, Kinesis, and Kafka.
• Optimize data storage, retrieval, and compute efficiency across AWS resources.
• ETL & Data Integration
• Build and manage ETL/ELT pipelines using AWS Glue, Step Functions, or other orchestration tools.
• Integrate data from various sources (APIs, databases, third-party platforms) into centralized storage (e.g., S3, Redshift, or Snowflake).
• Implement data transformation and quality checks to ensure accuracy, consistency, and compliance.
• Data Governance & Security
• Enforce data security and compliance standards using AWS IAM, KMS, and Lake Formation.
• Implement data cataloging, lineage tracking, and metadata management with AWS Glue Data Catalog.
• Monitor, tune, and optimize query performance on Redshift, Athena, and other databases.
• Collaboration with stakeholders

Required Qualifications:
• 5+ years of experience in data engineering, with at least 5+ years of hands-on AWS experience.
• Expertise in AWS services such as Glue, Redshift, Athena, S3, Lambda, Step Functions, EMR, and Kinesis.
• Strong proficiency in SQL, Python, and Spark for data processing and transformations.
• Experience with data modeling, warehousing (Redshift, Snowflake), and distributed computing frameworks.
• Familiarity with IaC (Terraform, CloudFormation)
• Experience with CI/CD pipelines for data workflows (e.g., GitHub Actions, CodePipeline, or Airflow).
• Knowledge of data governance, security best practices, and compliance frameworks.
• Strong analytical and problem-solving skills with the ability to optimize complex queries and large-scale data processing.
• AWS Data Engineer or related certification is a plus/AWS Developer/ Solution Architect

“Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.”