Big Data Developer

2 days ago

Hyderabad, Telangana, India Sonata Software Full time ₹ 6,00,000 - ₹ 18,00,000 per year
  • Database Expertise:

Strong hands-on experience with Greenplum, Teradata, MongoDB, and Oracle for data modelling, querying, and performance optimization.

  • Streaming & Real-Time Data:

Proficient in Apache Kafka for building and managing real-time data streaming pipelines.

  • Data Integration & ETL Tools:

  • Informatica: Experience with HTTP Transformation for REST APIs, XML Transformation, and OAuth-based authentication.

  • StreamSets: Skilled in using components like HTTP Client Processor with OAuth2 authentication for API integration.

  • Big Data & Lakehouse Technologies:

i. Strong development experience with PySpark for distributed data processing.

ii. Familiarity with Apache Iceberg for managing large-scale, transactional datasets in Lakehouse architectures.

  • Scripting & Automation:

  • Advanced scripting skills in Python and Unix/Linux shell for automation, data manipulation, and workflow management.

  • Proven ability to debug and promote fixes under high-priority scenarios.

  • Data Replication:

  • Basic working knowledge/Understanding of Oracle Goldengate and CDC frameworks for data replication across heterogeneous systems.

  • Workflow Orchestration:

  • Experience with Control-M and Apache Airflow for scheduling, monitoring, and managing complex/custom data workflows.

  • Cloud & DevOps:

  • Familiarity with CI/CD tools and AWS ECS for containerized deployments and continuous integration.

  • Soft Skills:

  • Strong problem-solving and debugging capabilities.

  • Flexible and dependable in supporting teams during critical issue resolution and extended hours when needed.

  • Big Data Developer

    5 days ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    5 days ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    5 days ago

    Hyderabad, Telangana, India MobMaxime Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable big data systems and pipelines.Implement data processing frameworks and optimize large datasets using tools such as Hadoop, Spark, and Hive.Develop and maintain ETL processes to ensure data availability, accuracy, and quality for downstream applications.Collaborate with data architects, analysts,...

  • Big Data Developer

    13 hours ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in innovative solutions across cloud adoption and modernization, data engineering and analytics, AI-driven operations, digital service management, and cybersecurity. Based in Herndon, Virginia, USA, with an Innovation & Development Center in Hyderabad, India, we...

  • Big Data Developer

    13 hours ago

    Hyderabad, Telangana, India KPG99 INC Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Role:Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data platforms and services that power Experian's global data ecosystem. You will be instrumental in building scalable data pipelines, integrating APIs,...

  • Big Data Engineer

    7 hours ago

    Hyderabad, Telangana, India HARP Technologies And Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : - Skill : Bigdata + Pyspark - Location : Hyderabad only - Experience : 5-9 Years - Notice Period : Immediate to 30 Days - Interview Mode : L1 Virtual / L2 F2F (Mandatory) - Work Mode : Hybrid - Skills required : Bigdata (Hadoop Hive, Impala, Spark) , pyspark, Python, Oracle, Exadata (RDBMS),...

  • Big Data

    18 hours ago

    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    ResponsibilitiesProvide technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. Monitor system performance, analyze logs, and identify potential issues before they impact services. Collaborate with engineering teams to deploy and configure Hadoop clusters and related components. Assist in maintenance and...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...