Data Engineer

NOTE : ONSITE INTERVIEW IS REQUIRED

Location : Reston VA /Plano TX (In Person Interview & 2 Days Hybrid)

Minimum Required Experiences:

7+ years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)

5+ years of Python, SQL, SparkSQL, PySpark

Excellent problem-solving skills and strong verbal & written communication skills

Ability to work independently as well as part of an agile team (Scrum / Kanban)

Identify customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.

Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.

Support the integration of data into readily available formats while maintaining existing structures and govern their use according to business requirements.

Analyze new data sources and monitor the performance, scalability, and security of data.

Create an initial analysis and deliver the user interface (UI) to the customer to enable further analysis.

4+ years’ experience with Big Data Hadoop clusters, AWS, and Python

Knowledge of Spark streaming technologies

Experience in working with agile development teams

Familiarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML)

Knowledge of Environmental, Social, and Corporate Governance (ESG)

Skills

Skilled in cloud technologies and cloud computing

Programming including coding, debugging, and using relevant programming languages

Experience in the process of analysing data to identify trends or relationships to inform conclusions about the data

Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB

Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica

Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere

Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.

Tools

Skilled in AWS Analytics such as Athena, EMR, or Glue

Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora

Skilled in SQL

Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS

Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms

Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager

Skilled in Python object-oriented programming