Big Data Developer

1 day ago

Hyderabad, Telangana, India KPG99 INC Full time ₹ 6,00,000 - ₹ 18,00,000 per year

About the Role:

Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data platforms and services that power Experian's global data ecosystem. You will be instrumental in building scalable data pipelines, integrating APIs, and optimizing big data solutions on AWS.

Key Responsibilities:

  • Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.
  • Implement and optimize data workflows on AWS EMR, EC2, and ECS.
  • Develop and integrate RESTful APIs and AWS Gateway services using Scala/Java.
  • Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
  • Ensure data quality, performance, and reliability across all systems.
  • Participate in code reviews, testing, and deployment processes.
  • Required Skills & Qualifications:
  • 3–5 years of experience in Big Data Engineering.
  • Strong hands-on experience with Spark/PySpark, Hadoop, and AWS services.
  • Proficiency in Scala or Java for backend and API development.
  • Experience with AWS EMR, EC2, ECS, and API Gateway.
  • Solid understanding of RESTful API design and integration.
  • Familiarity with CI/CD pipelines and version control (e.g., Git).
  • Excellent problem-solving and communication skills.
  • Preferred Qualifications:
  • Experience in data security and compliance within cloud environments.
  • Exposure to data lake architectures and real-time data processing.
  • Knowledge of containerization tools like Docker and orchestration with Kubernetes.

  • Big Data Developer

    23 hours ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in innovative solutions across cloud adoption and modernization, data engineering and analytics, AI-driven operations, digital service management, and cybersecurity. Based in Herndon, Virginia, USA, with an Innovation & Development Center in Hyderabad, India, we...

  • Big Data

    1 day ago

    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesProvide technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. Monitor system performance, analyze logs, and identify potential issues before they impact services. Collaborate with engineering teams to deploy and configure Hadoop clusters and related components. Assist in maintenance and...

  • Big Data Developer

    3 days ago

    Hyderabad, Telangana, India Sonata Software Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Database Expertise:Strong hands-on experience with Greenplum, Teradata, MongoDB, and Oracle for data modelling, querying, and performance optimization.Streaming & Real-Time Data:Proficient in Apache Kafka for building and managing real-time data streaming pipelines.Data Integration & ETL Tools:Informatica: Experience with HTTP Transformation for REST APIs,...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Pennant Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerDepartment: Data & AnalyticsEmployment Type: Full‑timeRole OverviewWe are seeking an experienced Big Data Engineer to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Pennant Technologies Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are looking for experienced Big Data Engineers to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work closely with data scientists, analysts, and stakeholders to turn raw data into...

  • Big Data Operations Engineer

    1 week ago

    Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...

  • Big Data Architect

    20 hours ago

    Hyderabad, Telangana, India Dhira Software Labs Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big DATA Architect / - share your resume along with CTC ECTC Notice Remote