Hadoop Big data engineer

1 week ago

Bengaluru Pune, India Tech Mahindra Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Responsibilities:

  • Onboarding and updating data deliveries on our Hadoop Datalake

    • Developing frameworks to process and deploy new data delivery methods or file formats (JSON, XML, CSV, ProtoBuf, Avro, Parquet, etc)

    • Creating views and tables for our users with optimal performance for their use case

    • Experience of connecting and interfacing with systems via APIs

    • Support both Development and Operations teams in quickly solving complex issues that are hindering the team and/or stakeholders

    • Coordinating with source teams producing data and also consumers using this data for their use cases

    • Supporting in the design, building, and testing of new services and extending existing services on our platform

    • Team collaboration on complex challenges, code reviews and testing new functionalities

    • Evaluating stakeholder requirements and guiding the innovation team towards the most suitable solution architecture

    • Identifying common development patterns and ensuring generic solutions and architecture are applied where possible

    • Take the design lead for complex requirements that go beyond the standard work done by the team

    • Continue to move the teams towards using more automation and efficient ways of working, to improve quality, eliminate manual mistakes and be more predictable with our deliveries

Education, Experience, and Licensing Requirements:

As an engineer, ideally you have the following qualifications or experience with:

• Extensive knowledge of Data modelling Data Warehousing, Relational DBs and Hadoop BigData stores

• Hadoop including specifically HDFS, Hive and SQL

• Java/Scala, Spark with 5 years+ general software design/development experience

• Shell scripting / Shell commands

• Git and Confluence

• Bachelor's Degree in Computer Science, Information Systems or other area of academic study (IT experience can substitute for a Bachelor's Degree)

• DevOps mindset

• Able to learn quickly in a complex multitool environment

Extra assets are:

• Python, Groovy, Ansible

• Hbase and Phoenix

• Apache Nifi and Kafka

• General hands-on experience with (Cloudera's) Hadoop Suite

Domain

• Telecom Domain knowledge - mainly Fault, Performance, Configuration and Capacity Management Data

  • Hadoop Administrator

    4 weeks ago

    Bengaluru, India Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...

  • Big Data Engineer

    3 weeks ago

    Pune, India True Talents Full time

    Job Title : Big Data EngineerLocation : Bangalore / PuneEmployment Type : Full TimeExperience : 4 to 8 yearsNotice Period : 15 daysAbout the Role :We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems. The ideal candidate will have hands-on experience with big data technologies and a strong...

  • Senior Big Data Engineer

    3 weeks ago

    Bengaluru, India SK HR Consultants Full time

    Service Mapping : Application Senior DeveloperLocation : Whitefield, BangaloreExperience : 6+ yearsRole Overview : Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key Responsibilities : - Develop, test, and...

  • Itss-big Data/hadoop/splunk Developer-humjp00032981

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 325776 We are currently seeking a ITSS-Big Data/Hadoop/Splunk Developer-HUMJP00032981 to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Azure Data Factory, Azure Synapse, and Databricks **About NTT DATA

  • Big Data Developer(Hadoop)

    4 days ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS is conducting weekday Virtual Drive for Big Data DeveloperDate of Interview: 13th Nov, 2025Location: Chennai, BangaloreYears of Experience: 5+ yearsMode of Interview: Virtual Mode( Teams, Cisco, Webex)Software developer with hands-on experience on Big Data technologies (Spark, Scala and Hadoop) with an experience of 5 years.Mandatory knowledge / skills:-...

  • Big Data Developer(Hadoop)

    5 days ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS is conducting weekday Virtual Drive for Big Data DeveloperDate of Interview: 13th Nov, 2025Location: Chennai, BangaloreYears of Experience: 5+ yearsMode of Interview: Virtual Mode( Teams, Cisco, Webex)Software developer with hands-on experience on Big Data technologies (Spark, Scala and Hadoop) with an experience of 5 years.Mandatory knowledge / skills:-...

  • Big Data Developer(Hadoop)

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS is conducting weekday Virtual Drive for Big Data Developer Date of Interview: 13th Nov, 2025 Location: Chennai, Bangalore Years of Experience: 5+ years Mode of Interview: Virtual Mode( Teams, Cisco, Webex) Software developer with hands-on experience on Big Data technologies (Spark, Scala and Hadoop) with an experience of 5 years. Mandatory knowledge /...

  • Big Data Architect

    4 weeks ago

    Pune, India Consulting Pandits Full time

    Big Data Architect - Build the Future of Data ManagementAre you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Bengaluru, India Fusion Plus Solutions Full time

    Job Description We are looking for a skilled Big Data Engineer with 5 to 7 years of hands-on experience in Big Data technologies. The ideal candidate should have strong expertise in Hadoop, HDFS, Hive, SQL, and Unix, and be able to work on large-scale data processing systems. Roles and Responsibilities: - Work on design, development, and optimization of Big...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...