Big Data DevOps Lead

2 days ago

Hyderabad, Telangana, India Zeta Global Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Summary:

As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.

Main Responsibilities:

Driving improvement of the efficiency of Big Data infrastructure.

  • Coordinating cross-team infrastructure and Big Data initiatives.
  • Leading Big Data related architecture and design efforts.
  • Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
  • Building and supporting tools for operational tasks. Evaluating, designing, deploying monitoring tools.
  • Design and implementation of DR/BC practices and procedures.
  • On-call support of production systems.

Requirements:

7+ years of experience working with Hadoop, preferably Open Source.

  • 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
  • Experience setting up and running Hadoop clusters of 1000+ nodes.
  • Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
  • Experience running and troubleshooting Kafka.
  • Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet. Proficiency in shell scripting.

Nice to have:

Experience with Prometheus.

  • Experience managing Showflake. Solid knowledge of Graphite and Grafana.
  • Python or Perl scripting skills.
  • Experience with installing and managing Aerospike.
  • DBA experience with one of: PostgreSQL, MySQL, MariaDB.

  • Big Data Developer

    5 days ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in innovative solutions across cloud adoption and modernization, data engineering and analytics, AI-driven operations, digital service management, and cybersecurity. Based in Herndon, Virginia, USA, with an Innovation & Development Center in Hyderabad, India, we...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Vaakruthi Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesJob Description : Big Data EngineerAnalyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidentsRequired Qualifiactions:years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS,...

  • Senior Software Engineer-Big Data

    2 days ago

    Hyderabad, Telangana, India ORBCOMM Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Join Us as a Senior Software Engineer – Big DataAre you ready to lead high-impact initiatives in a fast-paced, global technology environment? At ORBCOMM, we're seeking aSenior Software Engineer – Big Datato design, develop, and implement high-performance analytics solutions. In this role, you'll leverage your expertise in distributed systems, real-time...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Devops Lead

    11 minutes ago

    Hyderabad, Telangana, India Jio Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Lead - DevopsLocation: HyderabadResponsibilities:1.Minimum of 5-7 years of Hands-on Azure Administration and Governance.2.Well versed with Hybrid Cloud workloads management with good understanding of Azure Networking(setting up VNETS, NSG's, NAT, Route tables), AKS orchestration, App services, Logic Apps, Storage accounts, Key Vaults...

  • Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB RESPONSIBILITY· Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)·Write SQL queries to validate the dashboard output·Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.·Performing code reviews and...

  • Big Data Developer

    7 days ago

    Hyderabad, Telangana, India Sonata Software Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Database Expertise:Strong hands-on experience with Greenplum, Teradata, MongoDB, and Oracle for data modelling, querying, and performance optimization.Streaming & Real-Time Data:Proficient in Apache Kafka for building and managing real-time data streaming pipelines.Data Integration & ETL Tools:Informatica: Experience with HTTP Transformation for REST APIs,...

  • Big Data Developer

    2 days ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title:Big Data DeveloperWork Location:Hyderabad, Telangana (TG), IndiaExperience Range:6–8 YearsSkill Area:Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-drivenBig Data Developerto join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing, developing, and...

  • Big Data

    6 days ago

    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesProvide technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. Monitor system performance, analyze logs, and identify potential issues before they impact services. Collaborate with engineering teams to deploy and configure Hadoop clusters and related components. Assist in maintenance and...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.Roles and ResponsibilityDesign and develop scalable big data systems using Pyspark and Azure Data Bricks.Implement and manage...