Senior Data Engineer/Architect (NYC or JC)
Senior Data Engineer/Architect New York City | Jersey City 18 Month W2 Contract $60-$70/hour Hybrid 3 days onsite Profile Types We Are Searching For: The team is responsible for all global banking data (commercial, investment, small markets, etc.), the CRM data, deals data, and analytics data. The team interfaces with Salesforce, pulls data from different bank systems, manipulates the data, and provides it to downstream business users. The extended teams take it for reporting so the business users can actually visualize the data. In this role, the resource will help pull and process all data and then help with the acquisition of processing and distributing that data.
Assemble large, complex data sets that meet functional and non-functional requirements, ensuring that the design and engineering approach is consistent across multiple systems.
Maintain, improve, clean, and manipulate large data for operational and analytics data systems, build complex processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, and communicate required information for deployment, maintenance and support of business functionality.
Utilize multiple architectural components in the design and development of client requirements and collaborate with development teams to understand data requirements and ensure the data architecture is feasible to implement.
Define and build data pipelines to enable data-informed decision making, ensuring adherence to release processes and risk management routines.
Contribute to existing test suites including integration, regression, and performance, analyze test reports, identify any test issues and errors and lead triage of underlying causes.
Lead the identification of gaps in data management standards adherence and work with appropriate partners to develop plans to close gaps, leading concept testing and conducting research to prototype toolsets and improve existing processes.
Mentor Data Engineers in the delivery and release of continuous integration and continuous delivery events and define key performance indicators and internal controls.
Must Haves / Required Skills:
5-7 years of Data Engineering and Analysis experience in a large enterprise environment
Skilled in understanding databases and relational data
Extremely strong in SQL (MSSQL, NoSQL, PostgresSQL)
Skilled in Python
Hadoop experience (as the team is in the midst of a migration effort over to Hadoop)
ETL
Skills / Experience That Are A Plus
Knowledge in Oracle
Knowledge in Informatica Powercenter
