Sr. Data Engineer
Remote Sr. Data Engineer
Candidates must have a good amount of experience with: SQL, T-SQL, Data Warehousing, Azure Data Factory, data modeling, creating pipelines, mapping.
This work will consist of mapping data from source operational systems into the new enterprise data warehouse
Job Description/Objectives
I. Data Extraction/Transformation Pipelines
• Landing Container (Data Flow/Pipeline)
• Conformance Container (Data Flow/Pipeline)
• Source to target map
II. Load Data to SQL Date Warehouse Staging Tables
• EDW Batch & BatchStep Metadata
• EDW External Table & Entity Table (Stage) Metadata
• EDW Initial Physical Creation (Production Tables)
III. Capture data from staging tables to destination production tables
• Stage to initial stored procedures
• EDW entity Table Metadata (initial)
IV. Create views to distribute the data in BI Tool
• EDW Operation Views Creation
• Add to Source Control (Repos)