Lead Data Engineer
Job Description:
As the onsite lead and a Data Engineer, you will be a member of the Data Governance and Technology development team within the Non-Financial Risk Technology team, with specific focus in developing data solutions. In this role you will be primarily responsible for the development of data workflows, pipelines, views, and stored procedures, working with the user community, in addition to performing data analysis and firming up requirements from the users. You will also be working closely with data providers, data scientists, other data developers, and data analytics teams to facilitate the implementation of client-specific business requirements and requests.
Your Key Responsibilities:Ø Design, implement, and maintain databases and datastores, ensuring optimal performance, scalability, and data integrity.Ø Write complex SQL queries to analyse data and create views for reporting purposes for downstream consumers.Ø Interact with business customers/users, understand their requirements, and translate them into technical requirements.Ø Implement and enforce data security and access controls, ensuring compliance with industry standards and regulations.Ø Conduct database capacity planning, forecasting future requirements, and implementing necessary scaling strategies.Ø Troubleshoot and resolve complex database-related issues, collaborating closely with development and operations teams.Ø Utilize Python/Shell scripting to automate database tasks, such as data extraction, transformation, loading, monitoring, and maintenance.Ø Monitor and optimize database performance, identifying and resolving bottlenecks, and implementing performance tuning techniques.Ø Stay up to date with the latest advancements in RDBMS systems, Postgres DB, scripting languages (Python/Shell), as well as other data engineering tools and evaluate their potential application within our organization.
Required:Ø Bachelor’s degree in computer science, software engineering, information technology, or related field required.Ø At least 10+ years of experience in data development and solutions inØ At least .Ø At least .Ø Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.Ø Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.Ø Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.Ø Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.
Good to have:Ø Experience withØ Experience on any ETL tool is added advantage.Ø Knowledge of usingØ Knowledge and
Job Type: Contract
Pay: $80.00 - $85.00 per hour
Ability to Commute:
New York, NY 10001 (Required)
Work Location: In person
Job Description:
As the onsite lead and a Data Engineer, you will be a member of the Data Governance and Technology development team within the Non-Financial Risk Technology team, with specific focus in developing data solutions. In this role you will be primarily responsible for the development of data workflows, pipelines, views, and stored procedures, working with the user community, in addition to performing data analysis and firming up requirements from the users. You will also be working closely with data providers, data scientists, other data developers, and data analytics teams to facilitate the implementation of client-specific business requirements and requests.
Your Key Responsibilities:Ø Design, implement, and maintain databases and datastores, ensuring optimal performance, scalability, and data integrity.Ø Write complex SQL queries to analyse data and create views for reporting purposes for downstream consumers.Ø Interact with business customers/users, understand their requirements, and translate them into technical requirements.Ø Implement and enforce data security and access controls, ensuring compliance with industry standards and regulations.Ø Conduct database capacity planning, forecasting future requirements, and implementing necessary scaling strategies.Ø Troubleshoot and resolve complex database-related issues, collaborating closely with development and operations teams.Ø Utilize Python/Shell scripting to automate database tasks, such as data extraction, transformation, loading, monitoring, and maintenance.Ø Monitor and optimize database performance, identifying and resolving bottlenecks, and implementing performance tuning techniques.Ø Stay up to date with the latest advancements in RDBMS systems, Postgres DB, scripting languages (Python/Shell), as well as other data engineering tools and evaluate their potential application within our organization.
Required:Ø Bachelor’s degree in computer science, software engineering, information technology, or related field required.Ø At least 10+ years of experience in data development and solutions inØ At least .Ø At least .Ø Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.Ø Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.Ø Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.Ø Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.
Good to have:Ø Experience withØ Experience on any ETL tool is added advantage.Ø Knowledge of usingØ Knowledge and
Job Type: Contract
Pay: $80.00 - $85.00 per hour
Ability to Commute:
New York, NY 10001 (Required)
Work Location: In person
