Lead Consultant Scala/Spark/Hadoop Developer

3 weeks ago


bangalore, India Genpact Full time

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.
Inviting applications for the role of Lead Consultant Scala/Spark/Hadoop Developer
In this role, you will be responsible for coding, testing, and delivering high quality deliverables, and should be willing to learn new technologies.
Responsibilities

• Design, develop, and implement highly scalable and reliable data processing pipelines using Spark and Scala.
• Work closely with data scientists and business analysts to understand their requirements and translate them into technical solutions.
• Optimize and tune data processing workflows to ensure optimal performance and efficiency.
• Troubleshoot and resolve issues related to data processing and performance bottlenecks.
• Collaborate with cross-functional teams to deliver high-quality solutions that meet business objectives.

Qualifications we seek in you
Minimum Qualifications
• BE/B Tech/MCA
• Excellent written and verbal communication skills

Preferred Qualifications/ Skills

• Experience in building data processing systems using Spark, Scala, and Hadoop.
• Strong programming skills in Scala and experience with Spark APIs.
• Proficiency in working with large datasets and implementing data processing algorithms.
• Experience with data warehousing and ETL processes.
• Knowledge of distributed computing principles and technologies.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Experience with cloud-based data processing platforms such as AWS EMR or Azure HDInsight.
• Certification in Spark and/or Hadoop technologies.
• Knowledge of machine learning algorithms and data analytics tools.



  • bangalore, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Big Data Consultant

    1 week ago


    bangalore, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    2 weeks ago


    Bangalore, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    3 weeks ago


    Bangalore, Karnataka, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Hadoop Developer

    3 days ago


    Bangalore, India Andor Tech Full time

    Job Description :We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team. The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development. This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a...

  • Hadoop Developer

    3 days ago


    Bangalore, Karnataka, India Andor Tech Full time

    Job Description :We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team. The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development. This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a...


  • Bangalore, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data Developer Management Level : G130 Years of Experience : 2 to 5 years Job Location : Bangalore (Hybrid) Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark. Educational Qualification : BE/BTech/ MTech/ MCA Role & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good...


  • Bangalore, Karnataka, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data DeveloperManagement Level : G130Years of Experience : 2 to 5 yearsJob Location : Bangalore (Hybrid)Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark.Educational Qualification : BE/BTech/ MTech/ MCARole & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good understanding of...


  • Pune/Bangalore/Hyderabad/Mumbai/Delhi NCR, India TD Newton & Associates Full time

    Job Description : Main duties and responsibilities :- Delivering on critical business priorities while evolving platform towards its strategic vision- Working closely with product managers, end users, and business analysts to understand business objectives and key success measures - Partnering with technology teams to design and architect solutions that...

  • Hadoop developers

    4 weeks ago


    bangalore, India Synechron Full time

    Overall Responsibilities: Utilize solid years of experience in software development using Scala, Java, or Python to build solutions in Hadoop, Spark, and Hive technologies. Design, develop, and maintain ETL solutions using Hadoop, Spark, and related technologies. Implement data wrangling techniques to clean, structure, and enrich raw data for...


  • Bangalore,Anywhere in India,Multiple Locations CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    About the job :Job Description / Duties & Responsibilities :- Develop, program, and maintain applications using the Apache Spark open-source framework.- Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming.- Spark Developer must have strong programming skills in Java, Scala, or Python.- Familiar with...


  • Pune,Bangalore,Chennai,Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description : - Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear...


  • Pune/Bangalore/Chennai/Hyderabad, IN CGI Information Systems and Management Consultants Full time

    Job Description :- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear &...

  • Data Engineer

    1 month ago


    Bangalore, India Huquo Full time

    Job Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Huquo Full time

    Job Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...


  • Bangalore, India CGI Information Systems and Management Consultants Full time

    Job Description : - Minimum 4-8 year's experience as a Data Engineer.- Experience with designing & developing production-grade distributed data systems.- Experience with Scala and Hadoop- Experience with distributed data processing frameworks (such as Spark, Beam, Flink, Hadoop) and using a producer/consumer or message queue technology such as Kafka.-...

  • Big Data Engineer

    1 month ago


    bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Senior Data Engineer

    1 month ago


    Bangalore, India CliqHR Full time

    Job Description : Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India CliqHR Full time

    Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

  • Big Data Engineer

    2 weeks ago


    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...