Big Data Engineering Expert

10 hours ago


Lucknow, Uttar Pradesh, India beBeeData Full time US$ 1,49,999 - US$ 2,49,999
Big Data Engineering Expert

Job Overview:

We are seeking an experienced Big Data Engineer to lead our data engineering teams. As a key member of our organization, you will be responsible for designing and implementing scalable data pipelines using Scala and Python.

Key Responsibilities:

  • Manage cross-team collaboration with architects, product managers, and operations.
  • Design and implement scalable data pipelines using Scala and Python.
  • Develop expertise in Apache Spark (batch & streaming) and migration strategies.
  • Experience with table formats like Delta Lake / Apache Hudi for schema evolution, ACID transactions, and time travel.
  • Run Spark and/or Flink jobs on Kubernetes (e.g., Spark-on-K8s operator, Flink-on-K8s).
  • Build ingestion, transformation, and enrichment pipelines for large-scale datasets.
  • Provision data infrastructure using Infrastructure-as-Code (Terraform, Helm).

Requirements:

  • 7-12 years of experience in big data engineering.
  • Strong communication skills.

What We Offer:

A challenging role with opportunities for growth and development, working with a talented team of professionals.



  • Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to lead the design, development, and implementation of scalable data processing solutions using big data technologies.The ideal candidate will have 6-12 years of experience in big data engineering and a proven track record of delivering high-quality solutions on time. They...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineering PositionThe role involves designing, executing and managing large and complex distributed data systems using cutting-edge technologies.Key technologies include Apache Hadoop, Java, Elastic Search/Solr, Kafka, Spark, Machine Learning, NLP and Deep Learning.Applicants will have 2-4 years of experience in big data technologies, including...

  • Big Data Specialist

    4 days ago


    Lucknow, Uttar Pradesh, India beBeeDataProcessing Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleAs a Data Processing Specialist, you will be responsible for building and managing big data clusters to ensure efficient data processing and storage. Your role will involve migrating data, performing performance tuning, and providing pre- and post-platform support for application migration. Proficiency in Linux commands is mandatory.In this...

  • Big Data Cloud Expert

    16 hours ago


    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 20,10,000

    Cloud Data ArchitectJob Description:We are seeking a highly skilled Cloud Data Architect to join our team. The ideal candidate will have a strong focus on Big Data management and data quality skills, with expertise in Azure Cloud.Hands-on experience in Azure for a minimum of 3–4 years, with overall professional experience of less than 10 years.Proficient...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 24,00,000

    Job OpportunityWe are seeking an experienced Data Engineer to join our team.About the RoleThis is a 4-10 year experience role with a focus on big data technologies such as Hadoop, Spark, and Scala programming languages.The ideal candidate will have strong SQL skills and be able to develop, tweak queries and work on performance enhancement.Key...


  • Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled data engineer to join our team.The ideal candidate will have hands-on experience in Python and Pyspark, with a strong understanding of big data and telemetry. They will be responsible for designing and implementing a data processing application for a large retailer.Key skills and qualifications...

  • Big Data Specialist

    16 hours ago


    Lucknow, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:The ideal candidate will design, develop and maintain large-scale data processing systems using Big Data technologies.Key Responsibilities:Develop scalable data pipelines to integrate various data sources.Implement data validation and error handling mechanisms to ensure data quality and integrity.Collaborate with cross-functional teams to...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineer - Scala SpecialistWe are seeking a highly skilled data engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity:In this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and implementing standardized Data Models.You will develop data pipelines for new sources, data transformations within the Data Lake, implementing GraphQL, working on NoSQL databases, CI/CD, and data delivery as per business requirements.Key...


  • Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    At Steps AI, we are seeking a highly skilled Data Engineer to join our team. In this role, you will design, build, and maintain production-level data pipelines that handle terabytes of structured and unstructured data.The RoleOwn end-to-end ETL/ELT processes, ensuring reliability, scalability, and high availability.Work with AWS services (S3, EC2, RDS,...