Petabyte-Scale Data Engineer

5 days ago

Nashik, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Data Engineer Position Overview

We are seeking a highly skilled data engineer to join our team and drive the design, implementation, and optimization of large-scale data systems.

The ideal candidate will have expertise in building and maintaining petabyte-scale lakehouse architectures, stream processing, and event streaming technologies. They will also be responsible for developing high-throughput data applications and services using Java, leveraging modern data warehouses and query engines for sub-second operation and analytics on real-time data.

Additionally, the successful candidate will work closely with cross-functional teams to ensure data integrity, security, and compliance across multi-tenant systems. They will also manage production infrastructure for reliability, scalability, and cost efficiency, as well as stay ahead of trends in the data ecosystem to drive technical excellence.

Key Responsibilities:

  • Design and implement petabyte-scale lakehouse architectures (Apache Iceberg, Delta Lake) to unify data lakes and warehouses.
  • Develop and optimize streaming pipelines using Kafka, Pulsar, and Flink to process structured/unstructured data with low latency.
  • Build scalable, high-throughput data applications and services using Java.
  • Leverage modern data warehouses and query engines for sub-second operation and analytics on real-time data.
  • Work with RDBMS and NoSQL systems to manage diverse data workloads.
  • Ensure data integrity, security, and compliance across multi-tenant systems.
  • Manage production infrastructure for reliability, scalability, and cost efficiency.
  • Stay ahead of trends in the data ecosystem to drive technical excellence.
Requirements

To be successful in this role, you will need:

  • 8+ years of experience in data engineering with large-scale systems (petabyte-level).
  • Expert proficiency in Java for data-intensive applications.
  • Hands-on experience with lakehouse architectures, stream processing, and event streaming.
  • Strong SQL skills and familiarity with RDBMS/NoSQL databases.
  • Proven track record in optimizing query engines and data pipelines.
  • Knowledge of data governance, security frameworks, and multi-tenant systems.
  • Experience with cloud platforms and infrastructure-as-code.

We offer a dynamic and supportive work environment, opportunities for growth and professional development, and a competitive compensation package. If you are passionate about data engineering and want to be part of a talented team, we encourage you to apply. Don't miss this opportunity to take your career to the next level.

  • Cloud-Scale Data Engineer

    1 week ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    AWS Data Engineer Position OverviewAs a seasoned AWS data engineer, you will design, build, and maintain scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS EMR, Glue, PySpark, Airflow and Python.Key Responsibilities:Develop and implement efficient data processing workflows using AWS...

  • Large Scale Data Specialist

    1 week ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryWe're seeking an experienced Data Engineer to join our team and play a key role in accelerating experiments, developing new datasets, and improving infrastructure efficiency.This is an exciting opportunity for a skilled professional with deep expertise in large-scale data processing to work directly with researchers and contribute to the...

  • Data Engineering Specialist

    7 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly experienced professional to lead the development and maintenance of our large-scale data platforms.

  • Data Engineering Leadership Opportunity

    1 week ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 13,71,000 - ₹ 19,19,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to join our team. This is a challenging role that requires the ability to design, develop, and maintain large-scale data systems.Design and develop large-scale data systems using Airflow, Python, and Snowflake.Collaborate with cross-functional teams to identify business needs and...

  • Senior Data Engineer

    4 weeks ago

    Nashik, Maharashtra, India SPIRO Full time

    Position: Senior Data Engineer Location: Pune Experience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Strategic Data Engineering Director

    6 days ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineer LeaderJob Summary:Practice Lead - Data Practitioner Job Description:Define and execute a modern data engineering strategy aligned with enterprise goals.Architect scalable, cloud-native data platforms using technologies like Spark, Kafka, Delta Lake, and Snowflake.Drive adoption of data mesh, lakehouse, and real-time streaming architectures.Key...

  • Data Engineering Expert

    2 weeks ago

    Nashik, Maharashtra, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    Job Title:Senior Data EngineerJob Description:We are seeking a Senior Data Engineer to join our team. The ideal candidate will have experience in designing, building, and maintaining highly scalable data pipelines.The Senior Data Engineer will be responsible for constructing and optimizing our data pipeline architecture, collaborating closely with data...

  • High-Performance Data Engineer

    2 weeks ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    We're seeking a Data Engineering expert to design and implement large-scale data infrastructures for real-time data processing.Key ResponsibilitiesDeveloped high-performance data pipelines using Kafka, Flink, and Spark.Built scalable data architectures to support efficient data processing.Maintained data quality through robust data modeling and ETL...

  • Mastering Big Data: Lead Data Engineer

    6 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000

    Lead Data Engineer - Cloud ComputingThe ideal candidate will have a strong background in data engineering and cloud computing, with experience in designing and developing large-scale data systems.Responsibilities:Design and develop data pipelines using Python to process big dataExperience with cloud platforms, preferably Azure, to deploy scalable solutions5+...

  • Senior Data Engineer

    2 days ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerThis is a high-level contract remote role requiring a highly skilled and experienced data engineer to design, develop, and optimize large-scale data processing solutions using PySpark.Key Responsibilities:Design and implement scalable data pipelines using PySpark and Python.Develop ETL/ELT solutions to integrate structured and...