Big Data Engineer

22 hours ago

Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Company Description

Softility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered in Herndon, Virginia, with an Innovation & Development Center in Hyderabad, India, our team consists of highly skilled engineers led by experienced technologists. Agile and forward-thinking, we are dedicated to #RiseTogether and enable our customers to #BeFutureReady.

Job Description – Big Data Operations Engineer

Role Overview

We are looking for a skilled Big Data Operations Engineer with hands-on experience in

supporting and maintaining large-scale data platforms. The role involves ensuring platform

availability, managing incidents, monitoring performance through dashboards, and coordinating

with development teams for enhancements. While the primary focus is on operations and

support, the candidate should also have exposure to Big Data development concepts and tools.

Key Responsibilities

● Monitor and maintain Hadoop clusters, HDFS storage, and YARN resource

management.

● Troubleshoot and resolve production issues, ensuring minimal downtime and quick

recovery.

● Support Informatica workflows in production, including error handling and performance

tuning.

● Manage Kafka topics, producers/consumers, and cluster health monitoring.

● Work with Anthos for hybrid cloud platform management and operational tasks.

● Support observability and log pipelines using Cribl.

● Build and maintain dashboards for monitoring and reporting using tools like New

Relic.

● Perform incident management, root cause analysis, and preventive action

planning.

● Collaborate with development teams to roll out new jobs, updates, and fixes.

● Maintain operational documentation, runbooks, and knowledge repositories.

Required Skills & Experience

● 5-6 years of experience in Big Data operations/support.

● Strong knowledge of the Hadoop ecosystem, including HDFS, YARN, Hive, and Oozie.

● Experience supporting ETL workflows (preferably Informatica).

● Familiarity with Kafka operations and troubleshooting.

● Exposure to Anthos and Cribl for platform and pipeline monitoring.

● Experience with dashboard/monitoring tools (Grafana, Kibana, or equivalent).

  • ● Hands-on with Linux/Unix administration, shell scripting, and automation.

  • Big Data engineer

    3 weeks ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Senior Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineering Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data engineering professional to spearhead the development and implementation of cutting-edge big data analytics platforms.Key Responsibilities:Design and implement robust big data pipelines utilizing Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Develop expertise in graph databases such as Neo4j,...

  • Big Data Engineering Leader

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 36,00,000

    Job Title:Big Data Engineering LeaderWe are seeking a Big Data Engineering Leader to join our team. As a key member of our engineering organization, you will be responsible for delivering roadmap features of our Enterprise TruRisk Platform.This platform helps customers Measure, Communicate and Eliminate Cyber Risks. You will work closely with...

  • Big Data Developer

    3 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data DeveloperWork Location: Hyderabad, Telangana (TG), IndiaExperience Range: 6–8 YearsSkill Area: Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing,...

  • Big Data Developer

    3 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data Developer Work Location: Hyderabad, Telangana (TG), India Experience Range: 6–8 Years Skill Area: Digital – Big Data and Hadoop Ecosystems Job Description: We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in...

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data DeveloperWork Location: Hyderabad, Telangana (TG), India Experience Range: 6–8 Years Skill Area: Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing,...

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Kresta Softech Private Limited Full time

    Role Highlights: Position: Big Data Engineer Experience: 2+ years Location: Hyderabad, Chennai- Hybrid Notice Period: Immediate/7 days joiners mandate Job Overview: Must have skills- Big Data, Scala, AWS and Python or Java

  • Big Data Engineer- Professional Services

    2 weeks ago

    Hyderabad, Telangana, India BrightEdge Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About UsBrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of data to provide actionable insights to our clients. We're looking for a talented Big Data Engineer to join our Professional Services to help us scale and optimize our data...

  • Senior Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataScience Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Developer PositionJob Summary:We are seeking a skilled big data developer to join our organization. The ideal candidate will have experience in designing and developing large-scale big data systems using Scala, AWS, Python, and Java.The selected candidate will be responsible for:Designing and implementing big data solutions using Hadoop, Spark, and...