Senior Big Data Engineer

2 days ago

India Oracle Full time ₹ 25,00,000 - ₹ 40,00,000 per year
Description

We're seeking a Senior Data Integration Engineer to design, develop, and manage enterprise-grade data integration solutions. The ideal candidate will have experience with ETL/ELT processes, API-driven integrations, and enterprise data platforms, with strong technical skills and collaboration abilities.

Please apply, If you have the passion and standard methodologies work in an environment where challenges are a norm, where individual brilliance is valued and goes hand in hand with team performance, Where being proactive is how we do things

Responsibilities

Successful applicants should have/demonstrate:

Key responsibilities

  • Architect, design, and optimize scalable big data solutions for batch and real-time processing.
  • Develop and maintain ETL/ELT pipelines to ingest, transform, and synchronize data from diverse sources.
  • Integrate data from cloud applications, on-prem systems, APIs, and streaming workspaces into centralized data repositories.
  • Implement and manage data lakes and data warehouses solutions on cloud infrastructure.
  • Ensure data consistency, quality, and compliance with governance and security standards.
  • Collaborate with data architects, data engineers, and business stakeholders to align integration solutions with organizational needs.

Core qualifications

  • Proficiency in Python, Java, or Scala for big data processing.
  • Big Data Frameworks: Strong expertise in Apache Spark, Hadoop, Hive, Flink, or Kafka.
  • Hands-on experience with data modeling, data lakes (Delta Lake, Iceberg, Hudi), and data warehouses (Snowflake, Redshift, BigQuery).
  • ETL/ELT Development: Expertise with tools like Informatica, Talend, SSIS, Apache NiFi, dbt, or custom Python-based frameworks.
  • APIs & Integration: Strong hands-on experience with REST, SOAP, GraphQL APIs, and integration platforms (MuleSoft, Dell Boomi, SnapLogic).
  • Data Pipelines: Proficiency in batch and real-time integration (Kafka, AWS Kinesis/ Azure Event Hub/ GCP Pub/Sub).
  • Databases: Deep knowledge of SQL (Oracle, PostgreSQL, SQL Server) and NoSQL (MongoDB, Cassandra, DynamoDB) systems.

Preferred experience

  • Expertise with at least one major cloud platform (AWS, Azure, GCP).
  • Experience with data services such as AWS EMR/Glue, GCP Dataflow/Dataproc, or Azure Data Factory.
  • Familiarity with containerization (Docker) and orchestration (Kubernetes).
  • Knowledge of CI/CD pipelines for data engineering.
  • Experience with OCI and Oracle Database (including JSON/REST, sharding) and/or Oracle microservices tooling. 


Qualifications

Career Level - IC3

  • Senior Big Data SME

    2 weeks ago

    India Information Tech Consultants Full time

    Job Title: Senior Big Data SME (Subject Matter Expert) Location: Remote Shift : UK Shift timings Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer) Employment Type: Full-Time About Us: We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Role Overview:The Senior Data Platform Engineer is an experienced professional who designs and optimizes complex data processing solutions to address sophisticated business needs. In this role, you will tackle large -scale batch and streaming data projects, ensuring that data pipelines and platforms are scalable, high -performing, and secure. A Senior Data...

  • Big Data Engineer

    10 hours ago

    India Weekday AI Full time ₹ 6,00,000 - ₹ 19,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 6-19 LPA)Min Experience: 4 yearsJobType: full-timeWe are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and...

  • Senior Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations The BIG Advantage Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    Description : Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to design, build, and maintain robust data pipelines and infrastructure that enable data-driven decision-making across the organization. The ideal candidate will have deep expertise in data architecture, ETL processes, and cloud data platforms. You...

  • Big Data Engineer

    3 weeks ago

    Pune, India Coforge Full time

    Job Description Coforge Ltd is Hiring for Big Data Engineer AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: [Confidential Information] For queries, contact via WhatsApp: 9667427662 Key Responsibilities:- Design, develop, and optimize Big Data...

  • Big Data Engineer

    2 weeks ago

    India Alef Education Full time

    Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world's most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly...

  • Big Data Developer

    3 weeks ago

    Pune, India airtel Full time

    Job Description Job Title: Big Data Developer (Manager) Location: Pune Experience: 3-5 years Job Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools....

  • Sr. Big Data Engineer

    2 weeks ago

    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R34As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical...

  • Senior Data Engineer

    2 weeks ago

    India Hunarstreet Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Data Engineer Location: Remote We are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture, optimizing data flow, and supporting cross-functional teams. The ideal candidate has extensive experience in handling big data and...

  • Principal Engineer

    3 weeks ago

    India Oracle Full time

    Job Description Big Data Service team's charter is to offer a managed, cloud-native Big Data Service focused on large-scale data processing and analytics on unstructured data stored in data lakes, and management of the data in data lakes. The service work scope encompasses not just good integration with OCI's native infrastructure (security, cloud, storage,...