
Sr. Data Engineer
Senior Big Data Engineer with strong technical skills and experience working with and supporting multiple engineering teams.
Must have heavy Databricks exp (creating schema etc)
Experience in building Big Data/ML/AI applications and optimizing data pipelines, architectures and data sets.
5+ years of technical experience with big data technologies. They should also have experience using the following software/tools:
Experience with big data tools: Apache Spark, Databricks, Parquet/Delta, PySpark, SparkSQL, Spark Streaming, Kafka/Kinesis, S3, Glue
Experience with Databricks using Unity Catalog and MLFlow is a big plus
Experience with any relational/noSQL databases or any MPP databases like Snowflake and Redshift.
Experience with data pipeline and workflow management tools: Step Functions, Airflow
Experience with AWS cloud services: EC2, EMR, RDS, Redshift, IAM, Security Group, VPC etc.
Experience developing in Python and Notebooks/IDE
Experience with Automation: Jenkins CI/CD, Terraform, CDK, Boto3
Job Type: Contract
Pay: $55.00 - $60.00 per hour
Application Question(s):
Can you come for in-person interview in NJ?
Can you join as a W2 employee (no C2C)?
Do you require any Visa Sponsorship?
Work Location: Hybrid remote in Parsippany, NJ