Big Data Engineer

10 hours ago

Hyderabad, Telangana, India HARP Technologies And Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Description :


- Skill : Bigdata + Pyspark

- Location : Hyderabad only

- Experience : 5-9 Years

- Notice Period : Immediate to 30 Days

- Interview Mode : L1 Virtual / L2 F2F (Mandatory)

- Work Mode : Hybrid

- Skills required : Bigdata (Hadoop Hive, Impala, Spark) , pyspark, Python, Oracle, Exadata (RDBMS), Autosys, Bitbucket

Job Summary :

We are seeking a Specialist with 5 to 8 years of experience in the Big Data Hadoop Ecosystem to design and implement scalable data solutions.

Detailed Job Description :

- Work extensively with the Big Data Hadoop Ecosystem to process and analyze large datasets.

- Utilize Hadoop, Spark, and SparkSQL technologies to build efficient and high-performance data pipelines.

- Leverage Python for data manipulation, automation, and integration tasks.

- Collaborate with cross-functional teams to gather data requirements and deliver optimized solutions.

- Participate in the design, development, and deployment of Big Data applications and frameworks.

- Ensure data quality, integrity, and security across big data environments.

- Stay current with the latest trends and advancements in Hadoop and Spark technologies.

- Optimize system performance and troubleshoot issues related to big data infrastructure.

Roles and Responsibilities :

- Design and develop scalable Big Data solutions using the Hadoop and Spark ecosystems.

- Implement and optimize SparkSQL queries for performance and efficient resource utilization.

- Develop Python scripts for data ingestion, transformation, and workflow automation.

- Monitor and maintain Hadoop clusters to ensure high availability and reliability.

- Collaborate with data engineers, analysts, and stakeholders to deliver actionable insights.

- Conduct code reviews and provide technical guidance to junior team members.

- Participate in capacity planning, system tuning, and performance benchmarking.

- Document technical specifications, processes, and best practices for big data projects.

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data QA/Test Engineer

    13 hours ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Pennant Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerDepartment: Data & AnalyticsEmployment Type: Full‑timeRole OverviewWe are seeking an experienced Big Data Engineer to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered...

  • Big Data QA/Test Engineer

    17 hours ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Currently we are looking for Bigdata QA test Engineer. Responsibilities Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Pennant Technologies Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are looking for experienced Big Data Engineers to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work closely with data scientists, analysts, and stakeholders to turn raw data into...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Operations Engineer

    1 week ago

    Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...

  • Big Data Developer

    16 hours ago

    Hyderabad, Telangana, India KPG99 INC Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Role:Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data platforms and services that power Experian's global data ecosystem. You will be instrumental in building scalable data pipelines, integrating APIs,...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    JOB RESPONSIBILITY· Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)·Write SQL queries to validate the dashboard output·Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.·Performing code reviews and...