Big Data Engineer

1 day ago

Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Company Description

Softility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered in Herndon, Virginia, with an Innovation & Development Center in Hyderabad, India, our team consists of highly skilled engineers led by experienced technologists. Agile and forward-thinking, we are dedicated to #RiseTogether and enable our customers to #BeFutureReady.

Job Description – Big Data Operations Engineer

Role Overview

We are looking for a skilled Big Data Operations Engineer with hands-on experience in

supporting and maintaining large-scale data platforms. The role involves ensuring platform

availability, managing incidents, monitoring performance through dashboards, and coordinating

with development teams for enhancements. While the primary focus is on operations and

support, the candidate should also have exposure to Big Data development concepts and tools.

Key Responsibilities

● Monitor and maintain Hadoop clusters, HDFS storage, and YARN resource

management.

● Troubleshoot and resolve production issues, ensuring minimal downtime and quick

recovery.

● Support Informatica workflows in production, including error handling and performance

tuning.

● Manage Kafka topics, producers/consumers, and cluster health monitoring.

● Work with Anthos for hybrid cloud platform management and operational tasks.

● Support observability and log pipelines using Cribl.

● Build and maintain dashboards for monitoring and reporting using tools like New

Relic.

● Perform incident management, root cause analysis, and preventive action

planning.

● Collaborate with development teams to roll out new jobs, updates, and fixes.

● Maintain operational documentation, runbooks, and knowledge repositories.

Required Skills & Experience

● 5-6 years of experience in Big Data operations/support.

● Strong knowledge of the Hadoop ecosystem, including HDFS, YARN, Hive, and Oozie.

● Experience supporting ETL workflows (preferably Informatica).

● Familiarity with Kafka operations and troubleshooting.

● Exposure to Anthos and Cribl for platform and pipeline monitoring.

● Experience with dashboard/monitoring tools (Grafana, Kibana, or equivalent).

  • ● Hands-on with Linux/Unix administration, shell scripting, and automation.

  • Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data Engineer

    1 day ago

    Hyderabad, Telangana, India Pennant Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerDepartment: Data & AnalyticsEmployment Type: Full‑timeRole OverviewWe are seeking an experienced Big Data Engineer to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work...

  • Big Data Engineer

    1 day ago

    Hyderabad, Telangana, India Pennant Technologies Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are looking for experienced Big Data Engineers to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work closely with data scientists, analysts, and stakeholders to turn raw data into...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Operations Engineer

    7 days ago

    Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India, Telangana Rapinno Tech Solutions Pvt.Ltd. Full time

    Big Data Engineer Locations: Hyderabad | Chennai | Pune | Bangalore Skills: Scala, Python, Apache Spark, PySpark, AWS, CI/CD Experience: 3 to 11 years Scala Developer Multiple Locations Strong hands-on experience in Scala & distributed data processing

  • Big Data Engineer

    1 day ago

    Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB RESPONSIBILITY· Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)·Write SQL queries to validate the dashboard output·Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.·Performing code reviews and...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Techno Facts Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.Position Requirements :Must Have : Build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimize ETL/ELT processes for structured and unstructured data. Knowledge of Lakehouse architecture for efficient data...

  • AI Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Apple Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the...

  • AI Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Apple Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the...