Hadoop Developer

3 weeks ago


Bangalore, Karnataka, India Andor Tech Full time

Job Description :

We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team.

The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development.

This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a particular emphasis on Elasticsearch integration.

Responsibilities :

- Design, develop, and implement data processing solutions using Hadoop and Spark technologies.

- Work closely with cross-functional teams to understand data requirements and develop scalable solutions to meet business needs.

- Implement and maintain Elasticsearch integration with Hadoop and Spark for efficient data retrieval and analysis.

- Optimize and tune Hadoop and Spark jobs for performance and scalability.

- Develop and maintain ETL (Extract, Transform, Load) processes to ingest and process large volumes of data.

- Troubleshoot and debug issues related to Hadoop and Spark applications, ensuring smooth operation of data pipelines.

- Collaborate with data engineers, data scientists, and other stakeholders to deliver high-quality solutions.

- Stay updated on emerging technologies and best practices in big data processing and distributed computing.

Skills Required :

- Minimum of 2 years of experience in Hadoop development.

- Minimum of 2 years of experience in Spark development.

- Mandatory working experience in Elasticsearch.

- Strong understanding of big data concepts and distributed computing principles.

- Proficiency in programming languages such as Java, Scala, or Python.

- Experience with Hadoop ecosystem tools such as HDFS, MapReduce, Hive, and HBase.

- Experience with Spark RDDs, DataFrames, and Spark SQL.

- Familiarity with Elasticsearch querying, indexing, and data visualization.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

(ref:hirist.tech)
  • Big Data Developer

    2 months ago


    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Salary : 12 - 20 LPARequirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...

  • Unison Consulting

    2 months ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Technical Lead

    6 days ago


    Bangalore, Karnataka, India Suitable.AI Full time

    Skills required : - Minimum 2+ years in Data Engineering- Last 5 years of experience should be from consulting companies- Skillsets - (Java/Scala/Python) + Big Data stack+ DSA + cloud experience- Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred- Must have strong...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India gethyr Full time

    Responsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to improve quality.- Reviewing and approving high-level & detailed design to ensure that the solution delivers to the business needs and aligns with the data & analytics architecture principles and...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Gethyr Full time

    Responsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to improve quality.- Reviewing and approving high-level & detailed design to ensure that the solution delivers to the business needs and aligns with the data & analytics architecture principles and...

  • Data Scientist

    3 weeks ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Mandatory Skills:- Data scientist exp- Hadoop, Scala- Python- Machine learning- SQL- Only from product OrgsRequirements from Past Experience :- Prior experience of working with large-scale datasets (10s of millions of documents) is strongly preferred.- End-to-end ownership of developing the model, writing production quality code and deploying the model is an...

  • Data Scientist

    2 months ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Mandatory Skills:- Data scientist exp- Hadoop, Scala- Python- Machine learning- SQL- Only from product OrgsRequirements from Past Experience :- Prior experience of working with large-scale datasets (10s of millions of documents) is strongly preferred.- End-to-end ownership of developing the model, writing production quality code and deploying the model is an...


  • Bangalore, Karnataka, India Thoucentric Full time

    Job Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...


  • Bangalore, Karnataka, India Thoucentric Full time

    Job Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...

  • Big Data Engineer

    2 months ago


    Bangalore/Hyderabad, Karnataka, India TalentXo Full time

    Role & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...

  • Big Data Engineer

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India TalentXo Full time

    Role & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Business Fundamental Consultancy Full time

    Designation - Data Engineer Working Days - 5 DaysLocation - Bangalore (on-site)Experience - 5 -7 years ( experience in either Java or Python or Both)Big Data Experience - 2-5 Years - (Hadoop, snowflake, or Kafka)Notice period - Immediate or maximum up to 30 daysPosition Overview : We are excited to offer a challenging opportunity for an experienced Data...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Business Fundamental Consultancy Full time

    Designation - Data Engineer Working Days - 5 DaysLocation - Bangalore (on-site)Experience - 5 -7 years ( experience in either Java or Python or Both)Big Data Experience - 2-5 Years - (Hadoop, snowflake, or Kafka)Notice period - Immediate or maximum up to 30 daysPosition Overview : We are excited to offer a challenging opportunity for an experienced Data...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Andor Tech Full time

    This role is for staff augmentation support and resources will be assisting non-core activities MID (5-9 YRS OF EXPERIENCE).Roles & Responsibilities :- Support to Develop and test code to deliver functionality that meets the overall business strategy and objectives.- Support to Build the work needed to implement features from the product backlog.- Size user...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Andor Tech Full time

    This role is for staff augmentation support and resources will be assisting non-core activities MID (5-9 YRS OF EXPERIENCE).Roles & Responsibilities :- Support to Develop and test code to deliver functionality that meets the overall business strategy and objectives.- Support to Build the work needed to implement features from the product backlog.- Size user...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Consulting Pandits Full time

    Roles and Responsibilities :- Owning the design, operations and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from varying sources- Collaborate with others to construct complex data sources for algorithms and machine learning models- Gather business requirements from...

  • Senior Data Engineer

    2 months ago


    Bangalore, Karnataka, India Consulting Pandits Full time

    Roles and Responsibilities :- Owning the design, operations and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from varying sources- Collaborate with others to construct complex data sources for algorithms and machine learning models- Gather business requirements from...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India Huquo Full time

    Job Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Huquo Full time

    Job Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...