Big Data Engineering Expert

3 days ago


Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Summary

We are seeking an experienced Data Engineer to design, develop, and optimize large-scale data pipelines and distributed data processing systems.

The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka, with a focus on data engineering principles, cloud architecture, and software engineering concepts.

  • Design and implement scalable data architectures for big data processing.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi/Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

Required Skills:

  • Scala - Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi/Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).


  • Thāne, Maharashtra, India beBeeBigDataExpert Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a Big Data Developer, you will play a crucial role in driving business growth through data-driven insights.Key Responsibilities:Design and implement scalable big data solutions using Hadoop, Spark, Hive, HDFS, and KafkaCollaborate with senior engineers to develop and deliver high-quality projects on timeMentor junior engineers in coding standards, best...

  • Big Data Professional

    2 weeks ago


    Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are looking for a skilled Big Data professional to join our team as a Big Data Engineer"> Big Data Engineer ", we require a candidate with strong skills in data engineering and analytics. The ideal candidate will have hands-on experience with Big Data technologies, including data ingestion, processing, and storage.">Key Responsibilities:Data Ingestion:...

  • Big Data Developer

    4 days ago


    Thāne, Maharashtra, India Tech Consulting Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...


  • Thāne, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 16,00,000

    Job DescriptionWe are seeking a skilled Big Data Engineer to join our team. As a key member of our Professional Services, you will play a vital role in designing, building, and maintaining high-performance data pipelines that process massive amounts of data.Key Responsibilities:Design and implement scalable batch processing systems using Python and big data...

  • Big Data Specialist

    2 weeks ago


    Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Databricks Data Engineer OpportunityKey Responsibilities:Develop and maintain scalable data pipelines and ETL processes on Databricks.Lead the architecture and implementation of high-performance data solutions.Collaborate with stakeholders to deliver actionable data insights.Optimize data workflows for performance, cost-efficiency, and reliability.Integrate...


  • Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Description:As a data engineer, you play a vital role in crafting and implementing robust data pipelines to process channel activity data from diverse sources. This encompasses digital channels, Hadoop environments, and Terradata.Key Responsibilities:Design and maintain scalable data architectures that integrate multiple sources of data for effective...


  • Thāne, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Professional OpportunityKey Responsibilities:Greetings from a top IT services company.PySparkHiveTo succeed in this role, you should have experience with Big Data platforms and data ingestion from disparate sources. You will work closely with cross-functional teams to drive business outcomes.We offer competitive compensation and benefits packages to...


  • Thāne, Maharashtra, India beBeeData Full time US$ 90,000 - US$ 1,60,000

    Data Engineering RoleWe are seeking a skilled Data Engineer to join our team.About the Role:This is an exciting opportunity for a seasoned professional with experience in designing and executing large-scale distributed data systems.The ideal candidate will have expertise in big data technologies, including Apache Hadoop, relational databases (e.g., MS SQL...


  • Thāne, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Big Data EngineerWe are seeking an experienced big data engineer to join our team. The ideal candidate will have a strong background in designing and implementing large-scale data processing systems on Azure.The successful candidate will be responsible for developing and maintaining complex data pipelines, creating efficient data models, and integrating and...

  • Big Data Leader

    7 days ago


    Thāne, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    ">Senior Data Architect">This role is responsible for leading data engineering teams globally and collaborating with cross-functional teams to drive business outcomes. ">Lead large-scale data engineering projects using distributed systems like Apache Spark, HDFS, and Kubernetes.Design and implement scalable data pipelines for big data processing using Scala,...