Leading Big Data Engineer

3 days ago

Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Opportunity:

A highly skilled and experienced data engineer is required to lead our big data engineering team.

  • Must have 7-12 years of experience in managing distributed teams across multiple geographies and time zones.
  • Proven ability to manage cross-team collaboration with architects, product managers, and operations.
  • Familiarity with Scala and Python programming languages.
  • Hands-on experience with Apache Spark (batch & streaming) – must.
  • Deep knowledge of HDFS internals and migration strategies.
  • Experience with Apache Iceberg (or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.
  • Familiarity with running Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
  • Experience with distributed blob storages like Ceph or AWS S3.
  • Proficient in building ingestion, transformation, and enrichment pipelines for large-scale datasets.
  • Expertise in Infrastructure-as-Code (Terraform, Helm) for provisioning data infrastructure.
  • Strong communication skills are essential for success in this role.
About Us

We are a leading provider of technology consulting, platform, and product engineering, and advanced analytics services. We enable positive business outcomes for enterprise companies undergoing business transformation by solving their most pressing technical challenges.

Benefits

We offer a dynamic work environment, opportunities for growth and development, and a competitive compensation package. If you are a motivated and experienced data engineer looking for a new challenge, please apply.

  • Big Data Specialist

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Big Data SpecialistWe are seeking a highly skilled big data specialist to design, build, and maintain robust data pipelines for processing channel activity data from multiple sources.The ideal candidate will possess strong knowledge of cloud computing, programming languages like Python, and experience in handling data from various sources...

  • Big Data Specialist

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking an accomplished big data developer to lead our team in delivering scalable data-driven solutions.The ideal candidate will have hands-on experience with Spark, Scala and PySpark, as well as a strong understanding of database systems.Key Responsibilities:Developing efficient big data solutions using data analytics...

  • Senior Big Data Engineer

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeBigData Full time ₹ 19,44,000 - ₹ 25,20,000

    Job Title:Hadoop Big Data Ecosystem ProfessionalWe are seeking an experienced Hadoop Big Data Ecosystem Professional to take on a challenging role in designing and developing scalable data processing systems using the latest technologies in the Hadoop ecosystem.Key Responsibilities:• Hands-on experience of Scala, Spark, Hive, and other tools within the...

  • Lead Big Data Innovator

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    Job OverviewThis is an exciting opportunity to work as a Data Engineer, driving data-driven initiatives forward. The role involves building scalable pipelines, working with streaming data, and collaborating with cross-functional teams.Key Responsibilities:Data Pipeline Development: Design, build, and optimize data pipelines and ETL workflows to ensure...

  • Highly Skilled Big Data Engineer Wanted

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Overview\Helpers are looking for a highly skilled engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.\

  • Senior Big Data Architect

    6 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data Solutions ArchitectWe are seeking a highly skilled big data solutions architect with expertise in designing and implementing scalable, high-performance data pipelines.The ideal candidate will have strong knowledge of AWS cloud services, Databricks, and big data frameworks.Main Responsibilities:Design, develop, and maintain complex data pipelines...

  • Big Data Specialist

    12 hours ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Big Data Specialist Job DescriptionThis is a full-time role for an experienced specialist in data processing with one of our prominent clients.The specialist will be responsible for designing, deploying, and managing large-scale data processes to integrate information from various sources. Daily tasks include using ETL tools, performing data modeling,...

  • Big Data Expert

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description:We are seeking a skilled Data Engineer to join our team. The ideal candidate will have experience working with Azure Databricks and PySpark.The successful candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems using Azure Databricks and PySpark.Key Responsibilities:Design and develop...

  • Big Data Specialist

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data Specialist We are seeking an experienced data engineer to join our team. This individual will be responsible for designing, building, and maintaining large-scale data systems. The ideal candidate will have hands-on experience with distributed computing frameworks and a proven track record of delivering high-quality solutions. Key...

  • Senior Data Engineering Manager

    7 days ago

    Bareilly, Uttar Pradesh, India beBeeTechnicalLead Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Platform LeadSigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting.We collaborate with leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges.The role of a Big Data Platform Lead...