Data Engineering Leader

2 days ago

India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 28,00,000
Job Overview: Big Data Engineer - Scala

We are seeking a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities:
  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.
Mandatory Skills:
  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.
Preferred Skills:
  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

The ideal candidate will be proficient in a variety of tools and technologies, including Scala, Spark, Python, NiFi, Apache Kafka, and Jupyter Notebooks. Strong communication and collaboration skills are also essential for success in this role.

A bachelor's degree in Computer Science or related field is required, and relevant work experience is preferred.

Additionally, the company offers a range of benefits, including competitive salary, comprehensive health insurance, retirement plan, paid time off, and professional development opportunities.

This is an excellent opportunity for a skilled Big Data Engineer to join a dynamic team and contribute to the growth and success of the organization.

  • Data Engineering Leader

    1 week ago

    India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,10,000

    Job Title: Data Engineering Leader",

  • Cloud Data Engineering Leader

    1 week ago

    India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Cloud Data Engineering LeaderJob Summary:A leading organization is seeking an experienced cloud data engineering leader to oversee the development and implementation of scalable data pipelines and analytics platforms.Key Responsibilities:Lead a team of data engineers in designing and delivering cloud-native data infrastructure solutions using Azure...

  • Data Engineering Leader

    1 week ago

    India beBeeAzure Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Azure Data EngineerWe are currently seeking a seasoned Senior Azure Data Engineer to spearhead our data infrastructure initiatives.

  • Data Engineer

    4 weeks ago

    India iO Associates - UKEU Full time

    Data EngineerRemote - IndiaContractOur client is a global leader in digital transformation, delivering innovative cloud and data solutions to enterprises across industries. With a strong track record of delivering complex, high-impact projects, they leverage modern technologies to help organisations make smarter, faster business decisions.We're looking for...

  • Software Engineering Leader

    7 days ago

    India beBeeSoftwareEngineering Full time £ 90,000 - £ 1,50,000

    Job Title: Software Engineering LeaderJob Description:We are seeking a skilled Software Engineering Leader to join our dynamic team. As a key member of our organization, you will be responsible for developing and maintaining software applications that meet the needs of our customers.As a Software Engineering Leader, you will oversee the development of...

  • Data Strategy Leader

    20 hours ago

    India beBeestrategy Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Strategy LeaderJoin us in a dynamic role where you will drive business outcomes through data-driven insights and strategic decision-making. As a Data Strategy Leader, you will leverage your expertise in marketing analytics to develop innovative solutions that meet our clients' needs.

  • Data Engineer

    7 days ago

    India AQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in Postgre SQL and hands-on experience in building data warehouses and data lakes.In this role, you will design and implement a scalable Postgre SQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Software Engineering Leader

    3 days ago

    India beBeecloudnative Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Native Staff EngineerWe are seeking a seasoned Cloud Native Staff Engineer to join our innovative software engineering team. As a technical leader, you will play a pivotal role in designing and delivering platforms and applications that shape the future of digital healthcare.The ideal candidate will lead the software development lifecycle from design...

  • Data Engineer

    6 days ago

    India Centrilogic Full time

    Data Engineer Purpose: Over 15 years, we have become a premier global provider of multi-cloud management, cloud-native application development solutions, and strategic end-to-end digital transformation services.Headquartered in Canada and with regional headquarters in the U.S.and the United Kingdom, Centrilogic delivers smart, streamlined solutions to...

  • AI-Powered Data Leader

    2 weeks ago

    India beBeeMarketingDataSteward Full time US$ 1,04,000 - US$ 1,30,878

    Job DescriptionWe are seeking a Marketing Data Steward Lead to join our Chief Data Office. This pivotal role will partner with global, regional, and business leaders to analyze, document, optimize, and orchestrate enterprise data for marketing and consumer engagement.Leadership & Execution of Stewardship Initiatives:Support the execution of an integrated...