Data Engineer
Job Description:
We are seeking a Kafka Real-Time Architect to design and implement scalable, real-time data processing systems. This role involves architecting Kafka clusters, ensuring high availability, and integrating with other data platforms.
Responsibilities:
• Design and deploy scalable Kafka-based real-time systems.
• Configure, maintain, and optimize Kafka clusters for high availability.
• Integrate Kafka with tools like Kafka Streams, Kafka Connect, Spark Streaming, Flink, and Beam.
• Implement security and performance monitoring for Kafka environments.
• Support development teams with Kafka connectors (JDBC, MongoDB, S3) and schema management.
• Maintain Kafka architecture documentation and best practices.
Required Skills:
• Extensive experience with Apache Kafka, event-driven frameworks, and real-time architecture.
• Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Flink, and Beam.
• Experience with cloud platforms (preferably GCP Pub/Sub).
• Excellent problem-solving and troubleshooting skills.
Job Description:
We are seeking a Kafka Real-Time Architect to design and implement scalable, real-time data processing systems. This role involves architecting Kafka clusters, ensuring high availability, and integrating with other data platforms.
Responsibilities:
• Design and deploy scalable Kafka-based real-time systems.
• Configure, maintain, and optimize Kafka clusters for high availability.
• Integrate Kafka with tools like Kafka Streams, Kafka Connect, Spark Streaming, Flink, and Beam.
• Implement security and performance monitoring for Kafka environments.
• Support development teams with Kafka connectors (JDBC, MongoDB, S3) and schema management.
• Maintain Kafka architecture documentation and best practices.
Required Skills:
• Extensive experience with Apache Kafka, event-driven frameworks, and real-time architecture.
• Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Flink, and Beam.
• Experience with cloud platforms (preferably GCP Pub/Sub).
• Excellent problem-solving and troubleshooting skills.
