Data Engineer - Hadoop
Location: Onsite EVERYDAY 5 days a wk; Office location is Chicago IL
Required Pay Scale: $65-75hr W2
•
•
• Due to client requirements this role is only open to USC or GC candidates
•
•
• Summary:
We are seeking a skilled Data Engineer responsible for developing and delivering data solutions to accomplish technology and business goals and initiatives. Key responsibilities include performing code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytical data systems.
Job expectations include working with stakeholders and Product and Software Engineering teams to aid with implementing data requirements, analyzing performance, and researching and troubleshooting data problems within system engineering domains.
MUST HAVES:
• Scripting – Kafka or elastic Search (MUST HAVES)
• Data ingestion - message queue, file share, REST API, relational database, etc.
• Experience working with Hadoop/Big Data and Distributed Systems
• Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
• Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting
• Performance tuning experience with spark /MapReduce and/or SQL jobs
• Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Requirements:
• Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
• Experience working with SPARK Structured steaming
• Experience working with admin/prod support/debugging
• Experience and proficiency with Linux operating system is a must
• Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
• Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.
• Experience working with Jenkins and Jar management
• Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
• Ability to comprehend customer requests and provide the correct solution
• Strong analytical mind to help take on complicated problems
• Desire to resolve issues and dive into potential issues
• Ability to adapt and continue to learn new technologies is important
About Matlen Silver
Experience Matters. Let your experience be driven by our experience. For more than 40years, Matlen Silver has delivered solutions for complex talent and technology needs to Fortune 500 companies and industry leaders. Led by hard work, honesty, and a trusted team of experts, we can say that Matlen Silver technology has created a solutions experience and legacy of success that is the difference in the way the world works.
Matlen Silver is an Equal Opportunity Employer and considers all applicants for all positions without regard to race, color, religion, gender, national origin, age, sexual orientation, veteran status, the presence of a non-job-related medical condition or disability, or any other legally protected status.
If you are a person with a disability needing assistance with the application orat any point in the hiring process, please contact us at email and/or phone at info@matlensilver.com // 908-393-8600
Location: Onsite EVERYDAY 5 days a wk; Office location is Chicago IL
Required Pay Scale: $65-75hr W2
•
•
• Due to client requirements this role is only open to USC or GC candidates
•
•
• Summary:
We are seeking a skilled Data Engineer responsible for developing and delivering data solutions to accomplish technology and business goals and initiatives. Key responsibilities include performing code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytical data systems.
Job expectations include working with stakeholders and Product and Software Engineering teams to aid with implementing data requirements, analyzing performance, and researching and troubleshooting data problems within system engineering domains.
MUST HAVES:
• Scripting – Kafka or elastic Search (MUST HAVES)
• Data ingestion - message queue, file share, REST API, relational database, etc.
• Experience working with Hadoop/Big Data and Distributed Systems
• Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.
• Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting
• Performance tuning experience with spark /MapReduce and/or SQL jobs
• Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Requirements:
• Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
• Experience working with SPARK Structured steaming
• Experience working with admin/prod support/debugging
• Experience and proficiency with Linux operating system is a must
• Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
• Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.
• Experience working with Jenkins and Jar management
• Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
• Ability to comprehend customer requests and provide the correct solution
• Strong analytical mind to help take on complicated problems
• Desire to resolve issues and dive into potential issues
• Ability to adapt and continue to learn new technologies is important
About Matlen Silver
Experience Matters. Let your experience be driven by our experience. For more than 40years, Matlen Silver has delivered solutions for complex talent and technology needs to Fortune 500 companies and industry leaders. Led by hard work, honesty, and a trusted team of experts, we can say that Matlen Silver technology has created a solutions experience and legacy of success that is the difference in the way the world works.
Matlen Silver is an Equal Opportunity Employer and considers all applicants for all positions without regard to race, color, religion, gender, national origin, age, sexual orientation, veteran status, the presence of a non-job-related medical condition or disability, or any other legally protected status.
If you are a person with a disability needing assistance with the application orat any point in the hiring process, please contact us at email and/or phone at info@matlensilver.com // 908-393-8600
