Senior Technology Engineer – DevOps Data Hadoop

Location: Bengaluru, India
Experience: 8+ Years

Job Overview:

We are looking for hands-on Tier-2 Production Engineer with strong Cloudera Data Platform (CDP) expertise to install, maintain, secure, and optimize enterprise Hadoop/Cloudera data platforms.

The role requires deep expertise across cluster administration, automation, containerization, platform security, observability, and collaboration with data engineering teams to ensure reliable and high-performing data services.

Key Responsibilities:

Cloudera & Data Platform Administration

  • Provide hands-on Tier-2 production support for Cloudera Data Platform (CDP).
  • Install, configure, maintain, and optimize the Cloudera environment.
  • Install and maintain the latest supported CDP version, including CDP 7.1.9 or later and associated Cloudera Data Services.
  • Support ongoing platform maintenance and operational stability.

Security & Compliance

  • Implement and maintain security requirements for CDP.
  • Automate security and regulatory checks.
  • Support secure operation of the enterprise data platform.

Performance Engineering

  • Optimize Cloudera cluster performance.
  • Work closely with data engineering teams to optimize Spark job performance.
  • Troubleshoot:
    • Spark jobs
    • Hive jobs
    • YARN jobs
  • Drive platform optimization and service reliability.

Containerization

  • Implement CDP containerization with data services.
  • Work with container technologies and enterprise container-management platforms.
  • Support Kubernetes/OpenShift-based environments.

Automation & CI/CD

  • Build automated pipelines and workflows for data projects.
  • Use tools such as:
    • GitHub Actions
    • Jenkins
    • ArgoCD
    • Similar CI/CD technologies
  • Python-based automation is preferred.
  • Drive automated patching and platform observability.

Required Skills & Experience:

  • 8+ years of relevant experience, with the source specifically calling for 10+ years of hands-on Tier-2 production experience with Cloudera.
  • Strong Cloudera/CDP administration experience.
  • Experience developing automation using:
    • Shell
    • Terraform
    • Groovy
    • Ansible
  • Experience with containerization technologies including:
    • Podman
    • Docker
    • OCP
  • Experience with container management using:
    • Kubernetes
    • OpenShift
  • Strong Linux operating system and networking fundamentals.
  • Proficiency with Git and Agile engineering practices.

📩 Apply Now: [email protected]

Job Application