Data Migration Specialist

Position Overview:

We are looking for a highly skilled and experienced Data Migration Module Lead to manage and oversee specific modules within larger data migration projects. The ideal candidate will have strong expertise in SQL, various databases (SQL Server, PostgreSQL), AWS Glue, Python, PySpark, Code Commit/Git, AWS Crawler, AWS Glue orchestration (Workflow/Triggers), and AWS DevOps/CICD.

This role demands technical proficiency, leadership, and the ability to collaborate with various teams to ensure successful module delivery.

Key Responsibilities:
• Module Leadership: Lead and manage specific modules within larger data migration projects, ensuring timely and successful delivery.
• Technical Implementation: Design and develop data migration solutions using AWS Glue, Python, and PySpark.
• Data Mapping & Transformation: Perform detailed data mapping and transformation activities for accurate data migration.
• ETL Development: Develop and maintain ETL processes using AWS Glue, Python, and PySpark.
• Quality Assurance: Implement data validation and quality assurance processes.
• Collaboration: Work closely with the project lead, data architects, business analysts, and other stakeholders.
• Documentation: Create and maintain documentation for design specifications, mapping documents, and operational procedures.
• Performance Optimization: Optimize data migration processes for performance and scalability.
• Troubleshooting & Support: Provide troubleshooting and support for module-specific issues.
• Orchestration & Automation: Automate data migration workflows using AWS Glue orchestration (Workflow/Triggers).
• Version Control & Deployment: Use CodeCommit/Git for version control and manage deployment through AWS DevOps/CICD pipelines.

Required Skills:
• AWS Glue
• AWS Python
• Data Migration Execution
• PostgreSQL
• PySpark
• SQL (Structured Query Language)
• Transact-SQL (T-SQL)