Big Data Engineer

2 days ago

Hyderabad, Telangana, India Harp Technologies Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Job Title: Bigdata + Pyspark

Location: Hyderabad

Experience Level: 5-8 Years

Notice Period: Immediate to 30 Days

Interview Mode: L1 Virtual / L2 F2F (Mandatory)

Work Mode: Hybrid

Job Summary

We are seeking a Specialist with 5 to 8 years of experience in the Big Data Hadoop Ecosystem to design and implement scalable data solutions.

Detailed Job Description

  • Work extensively with the Big Data Hadoop Ecosystem to process and analyze large datasets.
  • Utilize Hadoop, Spark, and SparkSQL technologies to build efficient and high-performance data pipelines.
  • Leverage Python for data manipulation, automation, and integration tasks.
  • Collaborate with cross-functional teams to gather data requirements and deliver optimized solutions.
  • Participate in the design, development, and deployment of Big Data applications and frameworks.
  • Ensure data quality, integrity, and security across big data environments.
  • Stay current with the latest trends and advancements in Hadoop and Spark technologies.
  • Optimize system performance and troubleshoot issues related to big data infrastructure.

Roles and Responsibilities

  • Design and develop scalable Big Data solutions using the Hadoop and Spark ecosystems.
  • Implement and optimize SparkSQL queries for performance and efficient resource utilization.
  • Develop Python scripts for data ingestion, transformation, and workflow automation.
  • Monitor and maintain Hadoop clusters to ensure high availability and reliability.
  • Collaborate with data engineers, analysts, and stakeholders to deliver actionable insights.
  • Conduct code reviews and provide technical guidance to junior team members.
  • Participate in capacity planning, system tuning, and performance benchmarking.
  • Document technical specifications, processes, and best practices for big data projects.

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Sky Systems, Inc. (SkySys) Full time

    Role:Big Data EngineerPosition Type:Full-Time Contract (40hrs/week)Contract Duration:Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilledBig Data Engineer (5+ years' experience)to join Experian's dynamic data engineering team. You will design and optimize scalable data pipelines,...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.Roles and ResponsibilityDesign and develop scalable big data systems using Pyspark and Azure Data Bricks.Implement and manage...

  • Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India HARP Technologies And Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : - Skill : Bigdata + Pyspark - Location : Hyderabad only - Experience : 5-9 Years - Notice Period : Immediate to 30 Days - Interview Mode : L1 Virtual / L2 F2F (Mandatory) - Work Mode : Hybrid - Skills required : Bigdata (Hadoop Hive, Impala, Spark) , pyspark, Python, Oracle, Exadata (RDBMS),...

  • Big Data QA/Test Engineer

    7 days ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Pennant Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerDepartment: Data & AnalyticsEmployment Type: Full‑timeRole OverviewWe are seeking an experienced Big Data Engineer to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work...

  • Big Data QA/Test Engineer

    1 week ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Currently we are looking for Bigdata QA test Engineer. Responsibilities Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Pennant Technologies Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are looking for experienced Big Data Engineers to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work closely with data scientists, analysts, and stakeholders to turn raw data into...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India Hucon Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    5+ years of experience working in a software product development organization building modern and scalable big data applicationsExpertise with functional programming, preferably ScalaFluency in Hadoop technologies and big data processing technologies, e.g. Spark, YARN, HDFS, Oozie, HiveExperience implementing RESTful web services in Java, Scala, Python, or...

  • Big Data Developer

    1 week ago

    Hyderabad, Telangana, India KPG99 INC Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Role:Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data platforms and services that power Experian's global data ecosystem. You will be instrumental in building scalable data pipelines, integrating APIs,...