Bigdata -Pyspark /Scala Spark- Data Engineer

2 days ago

Pune, Maharashtra, India LTIMindtree Full time US$ 1,50,000 - US$ 2,00,000 per year

30 days to immediate

3+ exp

Job description:

Myrefers Big Data PySpark Scala Spark Java Sparkp3PuneWe are seeking a highly skilled and experienced Big Data Engineer to join our data engineering team The ideal candidate will have a strong background in Hadoop ecosystem tools Apache Spark including SparkSQL and Python programming You will be responsible for designing building and maintaining scalable data pipelines and analytics solutions that support business intelligence and machine learning initiatives

Key Responsibilities

Design and implement robust scalable and highperformance data processing systems using Hadoop Spark and SparkSQL

Develop and maintain ETL pipelines using Python and PySpark

Optimize Spark jobs for performance and costefficiency

Collaborate with data scientists analysts and business stakeholders to understand data requirements and deliver solutions

Ensure data quality governance and security across all data pipelines

Monitor and troubleshoot production data workflows and resolve issues proactively

Document technical designs architecture and operational procedures

Required Skills and Qualifications

Bachelors or Masters degree in Computer Science Engineering or related field

7 years of handson experience in Big Data technologies

Strong expertise in

Hadoop HDFS Hive HBase

Apache Spark RDD DataFrame SparkSQL

Python including libraries like Pandas NumPy

Experience with workflow orchestration tools like Airflow or Oozie

Familiarity with data modeling data warehousing and SQL optimization

Skills:

Mandatory Skills : Apache Spark,Python,Big Data Hadoop Ecosystem,Data Architecture

  • Spark/Scala Developer

    2 days ago

    Pune, Maharashtra, India Cyanous Software Private Limited Full time US$ 1,50,000 - US$ 2,00,000 per year

    Detailed JD (Roles And Responsibilities)At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 8+ years of experience in designing and developing large scale, distributed...

  • Project/Data Analyst

    4 hours ago

    Pune, Maharashtra, India LTIMindtree Full time

    We are currently hiring for Bigdata Scala Spark. The position is ideal for professionals with 6–12 years of experience in Bigdata and related technologies. Experience : 6 to 12Work Mode : Hybrid Mode Interview Mode : In Person (Saturday, 13-Sep-2025)8 YrsYrs of experience in Big Data projects. Experience in Big Data technologies including...

  • BigData-Hadoop/Scala Engineer. AS

    7 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer. ASPosition OverviewJob Title :BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause...

  • BigData-Hadoop/Scala Engineer. AS

    10 hours ago

    Pune, Maharashtra, India Deutsche Bank Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    BigData-Hadoop/Scala Engineer. ASJob ID: R0388874Full/Part-Time: Full-timeRegular/Temporary: RegularListed: Location: PunePosition OverviewJob Title : BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness...

  • BigData-Hadoop/Scala Engineer, AVP

    7 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer, AVPPosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected,...

  • BigData Data Engineering Leader

    6 days ago

    Pune, Maharashtra, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    Senior Data Engineer, AVPJob Summary:As a seasoned software engineer with expertise in BigData and Scala, you will design and develop comprehensive engineering solutions to drive business growth. Key responsibilities include ensuring that solutions are well-architected, maintainable, and scalable.Key Responsibilities:Design and develop large-scale software...

  • Big Data Specialist

    4 hours ago

    Pune, Maharashtra, India LTIMindtree Full time

    Greetings from LTIMindtree We are currently hiring for Bigdata Scala Spark. The position is ideal for professionals with 6–12 years of experience in Bigdata and related technologies. Experience : 6 to 12 Location : Coimbatore/Pune Work Mode : Hybrid Mode Notice Period : Upto 30 Days Interview Mode : In Person (Saturday,...

  • Scala, Spark

    1 day ago

    Pune, Maharashtra, India Citi Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Scala Developer

    2 days ago

    Pune, Maharashtra, India Alp Consulting Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    • At least 8+ years of experience and strong knowledge in Scala programming language.• Able to write clean, maintainable and efficient Scala code following best practices.• Good knowledge on the fundamental Data Structures and their usage• At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines...

  • Scala, Spark

    1 week ago

    Pune, Maharashtra, India Citi Full time US$ 90,000 - US$ 1,20,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...