Big Data DevOps Lead

7 days ago


Hyderabad, India Zeta Global Full time

Summary:

As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.

Main Responsibilities:

Driving improvement of the efficiency of Big Data infrastructure.

  • Coordinating cross-team infrastructure and Big Data initiatives.
  • Leading Big Data related architecture and design efforts.
  • Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
  • Building and supporting tools for operational tasks. Evaluating, designing, deploying monitoring tools.
  • Design and implementation of DR/BC practices and procedures.
  • On-call support of production systems.

Requirements:

7+ years of experience working with Hadoop, preferably Open Source.

  • 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
  • Experience setting up and running Hadoop clusters of 1000+ nodes.
  • Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
  • Experience running and troubleshooting Kafka.
  • Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet. Proficiency in shell scripting.

Nice to have:

Experience with Prometheus.

  • Experience managing Showflake. Solid knowledge of Graphite and Grafana.
  • Python or Perl scripting skills.
  • Experience with installing and managing Aerospike.
  • DBA experience with one of: PostgreSQL, MySQL, MariaDB.

  • Devops Developer

    7 days ago


    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 321814NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevOps Developer to join our team in Hyderabad Telangana IN-TG India IN NTT DATA Services currently seeks DevOps...

  • Big Data Developer

    2 days ago


    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in innovative solutions across cloud adoption and modernization, data engineering and analytics, AI-driven operations, digital service management, and cybersecurity. Based in Herndon, Virginia, USA, with an Innovation & Development Center in Hyderabad, India, we...


  • Hyderabad, Telangana, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Big Data DeveloperPosition Overview:We are seeking a skilled professional to join our team, with a dual focus on hands-on project support and mentoring junior engineers in the field of big data.This role is ideal for a developer who thrives in a technical environment and is passionate about coaching and developing the next generation of talent.You...


  • Hyderabad, India ORBCOMM Full time

    Join Us as a Senior Software Engineer – Big DataAre you ready to lead high-impact initiatives in a fast-paced, global technology environment? At ORBCOMM, we're seeking aSenior Software Engineer – Big Datato design, develop, and implement high-performance analytics solutions. In this role, you'll leverage your expertise in distributed systems, real-time...


  • Hyderabad, India Data Economy Full time

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Big Data

    4 days ago


    Hyderabad, India Greenwich Associates Full time

    Please enter job description - 5+ years software development experience in an enterprise level engineering environment demonstrating increasing levels of technical leadership. 3+ years of work experience with ETL, Data Modeling, and Data Architecture. Experience with Big Data technologies such as Hadoop/Hive/Spark with Spark as primary. Fluent in one or more...

  • Devops Engineer

    7 days ago


    Hyderabad, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Devops Engineer - Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). I am...

  • DevOps Engr

    5 days ago


    Hyderabad, Telangana, India NTT DATA Full time

    **Req ID**: 332449 We are currently seeking a Devops Engr. to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Hybrid Mode. Location - Bangalore, Hyderabad 1. Setting up automated solutions for branch creation, CI/CD setup, Jenkins builds and deployment and Security 3. Create solutions for automated database deployment 4. Create automated...

  • Devops Engineer

    4 weeks ago


    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 300721NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevOps Engineer - Digital Solution Consultant Sr Analyst to join our team in Hyderabad Telangana IN-TG India IN ...

  • Big Data Engineer

    2 days ago


    Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB RESPONSIBILITY· Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)·Write SQL queries to validate the dashboard output·Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.·Performing code reviews and...