Big Data Engineer for Distributed Systems

13 hours ago


Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Job Overview

We are seeking an experienced Big Data Engineer to design, develop, and maintain large-scale distributed data pipelines using Apache Spark and Scala.

Main Responsibilities:

  • Design, develop, and maintain scalable distributed data processing systems.
  • Write clean, efficient, and maintainable code adhering to industry best practices.
  • Implement data processing solutions using Spark Core, Spark SQL, and Spark Streaming modules.
  • Collaborate with cross-functional teams to gather and understand data processing requirements.
  • Optimize performance of complex queries and processing logic in Hadoop ecosystems.
  • Develop and manage workflows using UNIX shell scripting, Hive, Sqoop, and Impala.
  • Participate actively in Agile/Scrum ceremonies-daily stand-ups, sprint planning, retrospectives, etc.
  • Provide production support and maintenance for existing applications, ensuring high availability and performance.
  • Conduct root cause analysis and resolve data pipeline issues in collaboration with upstream/downstream teams.
  • Stay updated with the latest Big Data technologies.

Mandatory Skills:

  • Strong proficiency in Scala with at least 8+ years of hands-on experience.
  • Solid experience with Apache Spark for building distributed data processing applications.
  • In-depth understanding of data structures, algorithms, and design patterns.
  • Strong command over SQL and working knowledge of NoSQL databases.


  • Delhi, Delhi, India beBeeData Full time ₹ 20,00,000 - ₹ 27,00,000

    Senior Data EngineerOur organization seeks a highly experienced Senior Data Engineer to lead data engineering initiatives. This senior professional will have a strong background in software development, with 8+ years of experience designing and implementing big data ETL pipelines, data processing, analytics applications using PySpark.Key...


  • Delhi, Delhi, India beBeeHadoop Full time

    Big Data and Hadoop Expertise is crucial for designing, building, and maintaining scalable data solutions. You'll work with technologies to ensure smooth data operations and contribute significantly to business objectives through expert analysis, development, implementation, and troubleshooting within the Big Data domain.Roles and Responsibilities:Platform...

  • Big Data Engineer

    5 days ago


    Delhi, Delhi, India Eqaim Technology & Services Full time

    Job Description : Big Data Engineer We are looking for a highly skilled Big Data Engineer to join our team. In this role, you will contribute to building and optimizing scalable data solutions that empower businesses to optimize promotional activities and maximize return on investment. You will work on data collection, validation, and analysis, while...

  • Big Data Expert

    2 days ago


    Delhi, Delhi, India beBeeExpert Full time US$ 1,00,000 - US$ 1,70,000

    We are seeking a highly skilled engineer to fill a key role in our organization. In this position, you will be responsible for designing and building robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and develop end-to-end data pipelines for financial datasets.Integrate third-party APIs and data feeds into internal...

  • Big Data Engineer

    4 days ago


    Delhi, Delhi, India prudential Manpower Pvt Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Education and Experience :Bachelor's degree in computer science, or similar technical field Minimum 5 years of experience in Big Data Engineering/Data Analysis5 Days Work From Office :Preferred Skills and Qualifications : Proficiency in Python, SQL and Apache SparkAWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud...


  • Delhi, Delhi, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Big Data Systems Administrator- Job Description:As a key member of our team, you will be responsible for designing, deploying, and managing large-scale big data systems. This includes planning and implementing data backup and disaster recovery strategies, proactively monitoring and tuning system performance to optimize resource utilization and...

  • Big Data Engineer

    5 days ago


    Delhi, Delhi, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerWe are seeking a skilled data expert to fill this challenging role. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced environment.Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and cloud storage services.Work in...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...


  • Delhi, Delhi, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer OpportunityWe are seeking an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing and developing scalable data pipelines, processing systems, and workflows.About the RoleThe ideal candidate will have hands-on experience with big data technologies such as...

  • Lead Data Scientist

    1 week ago


    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: Azure Data Engineer Role Overview:We are seeking a highly skilled and experienced Data Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Databricks.The ideal candidate will have excellent technical skills, strong problem-solving abilities,...