Data Engineer – Real Time Streaming
Location: Bengaluru
Level of Experience: 5+ Years
Location: Bengaluru
Experience: 5+ Years
Work Mode: Hybrid (3 Days Onsite)
Role Overview:
We are seeking skilled Data Engineer – Real Time Streaming to design, build, and optimize enterprise-scale streaming data platforms. The ideal candidate will have strong expertise in Apache Kafka, Flink/Beam, PySpark Streaming, and distributed data processing systems.
This role involves building scalable real-time pipelines, enabling enterprise data modernization, and supporting cloud-native and containerized data platforms.
Key Responsibilities:
Real-Time Streaming & Data Engineering
- Design and develop real-time streaming pipelines and enterprise data solutions.
- Implement and support Apache Kafka / Confluent Kafka platforms and integrations.
- Develop streaming applications using Apache Flink, Apache Beam, and PySpark Streaming.
- Optimize streaming applications for performance, scalability, and reliability.
Data Architecture & Warehousing
- Design end-to-end data flow architectures across enterprise systems.
- Work on Data Vault, Data Lake, Data Warehouse, and Data Mart implementations.
- Support enterprise data modeling including conceptual, logical, and physical data models.
- Manage metadata, data lineage, governance, and data quality initiatives.
Platform & Infrastructure
- Support deployments in Cloudera Data Platform (CDP) and Kubernetes environments.
- Recommend suitable relational and non-relational database solutions.
- Contribute to enterprise data platform modernization initiatives.
Required Skills:
- Strong expertise in Apache Kafka / Confluent Kafka
- Experience with Apache Flink or Apache Beam
- Strong hands-on experience in PySpark Streaming / Spark Streaming
- Knowledge of Python or Java programming
- Experience with Cloudera CDP and Kubernetes
- Understanding of data warehousing and distributed systems
📩 Apply Now: [email protected]