GCP Data Engineer
Required Skills & Experience
• 10+ years of experience in data engineering with a variety of database platforms (ideally 5+ being in Cloud Platforms).
• Experience with GCP Data - BigQuery, Dataflows, Dataproc, Pubsub and ETL jobs
• 7+ years of experience using python and/or java.
• 7+ years of experience developing and utilizing APIs (GraphQL and REST)
• 7+ years of experience designing and deploying pipelines as well as experience with CI/CD Pipelines, Github actions, docker and jenkins builds
• 10+ years of experience in data mapping and modeling.
• 7+ years developing and deploying data quality and test automation.
Nice to Have Skills & Experience
• Experience with Reliable Transaction Framework
• Experience with Spring, Microservices, Posgres or NoSQL
Job Description
Insight Global is seeking GCP Data Engineers in a Hybrid role for a large Financial Institution. This resource will be responsible for designing, developing, evaluating, modifying, deploying and troubleshooting as well as appropriate documentation of all data components (data architecture, logical and physical data models, database objects and database administration) that meet the needs of customer-facing applications, business applications, internal user applications, and business intelligence platforms.
• Utilizes cloud technology to design and implement data movement, transformation, storage, and access for numerous systems and business use cases.
• Performs data mapping analysis to facilitate the centralization of disparate data sources.
• Designs and employs event-driven services to stream data in real-time.
• Creates pipelines to orchestrate data movement activities.
• Engineers and deploys APIs to facilitate data access.
• Creates and maintains meta-data including data catalogues, dictionaries, lineage, taxonomy, etc.
• Utilizes code repositories to ensure code quality and version control.
• Adheres to strict standards and policies as it relates to data governance, retention, classification, privacy, and legislation.
• Automates and employs data quality and code tests.
• Accurately tracks and manages tasks through project lifecycle management tools.
• Partners directly with product and project managers, architects, and other engineers to design and implement optimal, efficient, and scalable data solutions.
• Maintains visibility and transparency of work performed through the documentation of requirements and processes.
• Performs database design review and supports database testing.
• Provides production environment support for database systems and processes.
Compensation:
$63/hr to $73/hr.
Exact compensation may vary based on several factors, including skills, experience, and education.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Required Skills & Experience
• 10+ years of experience in data engineering with a variety of database platforms (ideally 5+ being in Cloud Platforms).
• Experience with GCP Data - BigQuery, Dataflows, Dataproc, Pubsub and ETL jobs
• 7+ years of experience using python and/or java.
• 7+ years of experience developing and utilizing APIs (GraphQL and REST)
• 7+ years of experience designing and deploying pipelines as well as experience with CI/CD Pipelines, Github actions, docker and jenkins builds
• 10+ years of experience in data mapping and modeling.
• 7+ years developing and deploying data quality and test automation.
Nice to Have Skills & Experience
• Experience with Reliable Transaction Framework
• Experience with Spring, Microservices, Posgres or NoSQL
Job Description
Insight Global is seeking GCP Data Engineers in a Hybrid role for a large Financial Institution. This resource will be responsible for designing, developing, evaluating, modifying, deploying and troubleshooting as well as appropriate documentation of all data components (data architecture, logical and physical data models, database objects and database administration) that meet the needs of customer-facing applications, business applications, internal user applications, and business intelligence platforms.
• Utilizes cloud technology to design and implement data movement, transformation, storage, and access for numerous systems and business use cases.
• Performs data mapping analysis to facilitate the centralization of disparate data sources.
• Designs and employs event-driven services to stream data in real-time.
• Creates pipelines to orchestrate data movement activities.
• Engineers and deploys APIs to facilitate data access.
• Creates and maintains meta-data including data catalogues, dictionaries, lineage, taxonomy, etc.
• Utilizes code repositories to ensure code quality and version control.
• Adheres to strict standards and policies as it relates to data governance, retention, classification, privacy, and legislation.
• Automates and employs data quality and code tests.
• Accurately tracks and manages tasks through project lifecycle management tools.
• Partners directly with product and project managers, architects, and other engineers to design and implement optimal, efficient, and scalable data solutions.
• Maintains visibility and transparency of work performed through the documentation of requirements and processes.
• Performs database design review and supports database testing.
• Provides production environment support for database systems and processes.
Compensation:
$63/hr to $73/hr.
Exact compensation may vary based on several factors, including skills, experience, and education.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
