Big Data Engineer

7 days ago

Bharatpur, Rajasthan, India Idyllic Services Full time

Job Title: Big Data Engineer – Scala

Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

Experience: 7–10 Years (Minimum 3+ years in Scala)

Notice Period: Immediate to 30 Days

Mode of Work: Hybrid

Role Overview

We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities

- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.

- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.

- Collaborate with cross-functional teams to design scalable cloud-based data architectures.

- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

- Build monitoring and alerting systems leveraging Splunk or equivalent tools.

- Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

- Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills

- Scala – Minimum 3+ years of hands-on experience.

- Strong expertise in Spark (PySpark) and Python.

- Hands-on experience with Apache Kafka.

- Knowledge of NiFi / Airflow for orchestration.

- Strong experience in Distributed Data Systems (5+ years).

- Proficiency in SQL and query optimization.

- Good understanding of Cloud Architecture.

Preferred Skills

- Exposure to messaging technologies like Apache Kafka or equivalent.

- Experience in designing intuitive, responsive UIs for data analytics visualization.

- Familiarity with Splunk or other monitoring/alerting solutions.

- Hands-on experience with CI/CD tools (Git, Jenkins).

- Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Expert Big Data Engineer Wanted

    2 weeks ago

    Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Summary:">We seek an experienced Big Data Engineer to design, implement and maintain large-scale data clusters. Key Responsibilities:">Developing scalable big data architectures.Migrating data from legacy systems.Tuning cluster performance for optimal efficiency.Providing pre- and post-platform support for application migration.Executing Linux commands...

  • Senior Big Data Specialist

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataSpecialist Full time ₹ 1,10,00,000 - ₹ 1,75,00,000

    Job Title:Senior Big Data SpecialistAbout the Role:We are seeking a highly skilled Senior Big Data Specialist to join our team. As a key member of our data engineering department, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies.Key Responsibilities:* Design and develop complex...

  • Big Data Solutions Architect

    7 days ago

    Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Coforge is seeking a seasoned Big Data Engineer with expertise in designing scalable data engineering solutions.Job Description:We are looking for an expert who can design and optimize Big Data architectures leveraging AWS services for efficient data processing.The ideal candidate will possess hands-on experience in architecting and implementing large-scale,...

  • Principal Big Data Architect

    2 weeks ago

    Bharatpur, Rajasthan, India beBeeEngineering Full time ₹ 1,51,40,000 - ₹ 2,14,20,000

    Data Engineering Role",">Job Description:","Our company is looking for a highly skilled Data Engineer to join our team. The ideal candidate will have strong expertise in AWS cloud services and Databricks, with experience in designing and implementing scalable data pipelines.","The role involves building and optimizing ETL/ELT workflows, managing big data...

  • Big Data Solutions Architect

    6 days ago

    Bharatpur, Rajasthan, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a skilled Big Data Solutions Architect to lead the design and implementation of our Big Data solutions. As a key member of our team, you will be responsible for architecting and implementing scalable, secure, and reliable Big Data systems.

  • Big Data Architect Position

    1 week ago

    Bharatpur, Rajasthan, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data ArchitectWe are seeking an experienced cloud expert with a strong focus on big data management.This is a full-time role offering flexibility for remote work. We require hands-on experience in Azure, proficient in big data technologies, and a strong understanding of data management principles.Key Responsibilities:Design and implement big...

  • Big Data Administrator with Experience in Hadoop Ecosystem

    7 days ago

    Bharatpur, Rajasthan, India beBeeDataiku Full time ₹ 18,00,000 - ₹ 24,00,000

    Big Data AdministratorWe are seeking a highly skilled On-Premises and Cloud Era Big Data Administrator to manage our big data platform.Key Responsibilities:Administer and monitor Big Data Platform components, including Hadoop, Hive, HBase, and BigSQL.Support technical and application team requests for data copies across environments, data cleanup, query...

  • Big Data Team Lead

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **About the Role:**We are seeking a highly experienced Big Data Engineer to lead our data engineering teams.The successful candidate will have a strong track record of managing cross-functional teams and driving collaboration with architects, product managers, and operations.Key Responsibilities:Lead distributed teams across multiple geographies and time...

  • Big Data Expert

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Data Scientist RoleWe are seeking a highly skilled Data Scientist to lead our data-driven initiatives.The ideal candidate will have hands-on experience with Big Data Eco System Tools, including Scala and Hadoop. Strong SQL skills and the ability to develop, tweak queries, and work on performance enhancement are also essential.A solid understanding of...

  • Data Engineering Lead

    1 week ago

    Bharatpur, Rajasthan, India beBeeDataEngineering Full time US$ 12,00,000 - US$ 16,00,000

    High-End Data Engineering LeadershipAt our organization, we seek a seasoned professional to oversee and lead our data engineering team.Key Responsibilities:Provide technical direction for the development of scalable data platforms.Leverage expertise in cloud environments, big data technologies, and leadership skills to drive project success.We are committed...