Senior Hadoop Data Engineer

3 weeks ago


Bengaluru, Karnataka, India Careerconnects Full time

Job Summary

Careerconnects is seeking a highly skilled Hadoop Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related technologies.

Key Responsibilities

  1. Design and Develop Data Processing Systems
  2. Collaborate with Stakeholders
  3. Develop and Maintain Documentation
  4. Work with Support Engineers
  5. Manage Multiple Projects
  6. Analyze and Write SQL Queries
  7. Write Unit Tests
  8. Develop Shell Scripts
  9. Focus on Optimized Code

Requirements

  1. Hands-on Experience with Hadoop Ecosystem
  2. Familiarity with Airflow, Spark Streaming, and Cloud Platforms
  3. Proficiency in Hadoop, Spark, Hive, Airflow, Shell Scripting, Scala, and Kafka

Skills

  • sql
  • hadoop
  • shell scripting
  • kafka
  • unit testing
  • hive
  • performance testing
  • spark
  • airflow
  • scala


  • Bengaluru, Karnataka, India Careerconnects Full time

    Job Responsibilities:Develop and implement data engineering solutions from conception to delivery.Collaborate with stakeholders to gather and implement use case details.Responsible for maintaining accurate FSD and TSD documentation.Work closely with support engineers for test case documentation.Manage multiple projects and deliver on time.Analyze and write...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Mercedes-Benz Full time

    About Mercedes-Benz Research & Development India-----------------------------We are looking for a highly skilled professional with expertise in Hadoop Architecture and Big Data Hadoop ecosystem components to join our team as a Senior Data Engineer.Key Skills:Strong understanding of Hadoop Architecture and underlying framework including Storage...


  • Bengaluru, Karnataka, India consultant Full time

    Job Title: Senior Hadoop Administrator and ManagerJob Description:As a seasoned Senior Manager with 10+ years of technology experience, preferably in database administration, we are seeking a highly skilled professional to lead our Big Data and Hadoop team. The ideal candidate will have at least 3+ years of experience managing Data Warehousing solutions on...


  • Bengaluru, Karnataka, India Oracle Full time

    Job Title: Senior Hadoop DeveloperAbout the Job:We are seeking a skilled Senior Hadoop Developer to join our team at Oracle. The ideal candidate will have extensive experience in the Hadoop ecosystem and a strong background in integrating and managing data from FLEXCUBE core banking systems.Key Responsibilities:Design, implement, and optimize data pipelines...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:We are seeking a highly skilled Hadoop Big Data Engineer to join our team in Bengaluru, India. As a key member of our team, you will be responsible for designing and implementing big data applications and robust data pipelines running on Hadoop clusters.Key Responsibilities:Design and develop big data applications using Spark, Hive, and other...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...


  • Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleWe are seeking an experienced Hadoop Administrator to join our team at BayOne Solutions. As a senior member of our big data infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale Hadoop clusters.


  • Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team, specializing in Linux and Hadoop systems. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key ResponsibilitiesDesign and implement data pipelines using Hadoop and related technologiesTroubleshoot issues...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India TapTalent Full time

    Job Title: Big Data EngineerCompany: TapTalentRole:Data Engineer - Big Data Hadoop GCPKey Responsibilities:Design and develop big data solutions using GCPWork with cross-functional teams to implement data pipelinesCollaborate with data scientists to develop predictive modelsRequirements:3+ years of experience in big data engineeringHands-on experience with...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TATA Consultancy Services is a leading IT consulting and business solutions firm looking for a talented Data Engineer to join our team.We offer a competitive salary range of ₹40,00,000 - ₹80,00,000 per annum, depending on experience and location.Job Description:We are seeking a highly skilled Data Engineer with expertise in Hadoop and PySpark to lead our...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in AWS cloud services, including lambda, glue, s3, emr, sns, sqs, cloudwatch, and redshift.Key Responsibilities:Design and implement scalable data pipelines using AWS servicesDevelop and maintain...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Talpro Full time

    Job Title: Senior Data EngineerRole Summary:At Talpro, we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a crucial role in designing and developing scalable and high-performance data platforms. You will work closely with our data scientists, analysts, and other stakeholders to understand data...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Nagarro Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Nagarro. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data processing pipelines using Apache Spark, Hadoop, and...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Société Générale Assurances Full time

    As a Senior Data Engineer - Big Data, you will be responsible for designing and developing large-scale data processing systems using Hadoop and Spark technologies.Key Responsibilities:Design and implement data pipelines using Hadoop and SparkDevelop and maintain large-scale data processing systemsCollaborate with cross-functional teams to deliver...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Haleon Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Haleon. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems and architectures that support our business operations.Key Responsibilities:Design and implement data pipelines and...


  • Bengaluru, Karnataka, India Careerconnects Full time

    Job DescriptionWe are seeking a talented Data Storage and Retrieval Specialist to join our team at Careerconnects. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data storage and retrieval systems.Key ResponsibilitiesData EngineeringDesign and develop efficient data processing...

  • Hadoop Administrator

    4 weeks ago


    Bengaluru, Karnataka, India @ Six Sigma Full time

    Job DetailsAt @ Six Sigma, we are seeking a skilled Hadoop Admin to join our team in Bangalore. This is a permanent position with a middle management level.Job DescriptionWe are looking for a highly motivated and experienced Hadoop Admin to manage our big data infrastructure. The ideal candidate will have a strong background in Hadoop administration, data...


  • Bengaluru, Karnataka, India Vyana Consultancy Full time

    Vyana Consultancy is seeking a Senior Hadoop Developer to lead the development of our big data solutions.About the RoleDesign, develop, and deploy big data processing pipelines using Hadoop ecosystem tools.Collaborate with cross-functional teams to integrate data from various sources.Develop and maintain data integration scripts and ETL frameworks.Work with...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India CAPCO Full time

    Data Engineer - (Hadoop/Hive/python/Spark/Scala)at Capco India - BengaluruJob Title: Senior Data Engineer/DeveloperNumber of Positions: 2Job Description:The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and...