Hadoop Developer

2 weeks ago

Chennai, India Cortex Consulting Pvt. Ltd. Full time

We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.

The Ideal Candidate :

Experience :

- 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.

Technical Skills :

- In-depth knowledge of Apache Hadoop architecture and core components (HDFS, YARN, MapReduce).

- Proficiency in distributed data processing frameworks like Apache Spark (Spark SQL, Spark Streaming).

- Expertise in data warehousing and querying using Apache Hive and HiveQL.

- Strong understanding of Unix/Shell scripting for automating Hadoop tasks.

- Solid programming skills in Python or Scala for developing big data applications.

Additional Skills :

- Experience with data ingestion tools like Sqoop, Flume, or Kafka (a plus).

- Familiarity with data quality and data cleansing techniques.

- Understanding of distributed file systems like HDFS and alternatives like Apache Parquet or Apache ORC.

- Experience with big data visualization tools (e.g., Tableau, Power BI) is a plus.

Soft Skills :

- Excellent communication and collaboration skills to work effectively with cross-functional teams (data analysts, data scientists, etc.).

- Strong problem-solving and analytical skills.

- Ability to learn new technologies quickly and adapt to changing requirements.

- A proactive and results-oriented approach to work.

Responsibilities :

- Design, develop, and implement big data processing pipelines using Hadoop and Spark.

- Develop and maintain data extraction, transformation, and loading (ETL) processes using tools like Sqoop, Flume, or Kafka.

- Write efficient MapReduce and Spark jobs to process large datasets.

- Design and develop Hive tables and queries to store and analyze big data.

- Automate Hadoop tasks using Unix/Shell scripting.

- Troubleshoot and debug big data processing issues.

- Monitor and optimize Hadoop cluster performance.

- Work with data analysts and data scientists to understand data requirements and develop solutions.

- Stay up-to-date with the latest advancements in big data technologies and best practices.

(ref:hirist.tech)

  • Hadoop Developer

    6 days ago

    Chennai, Tamil Nadu, India Cortex Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience : 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills : Indepth knowledge of Apache...

  • Hadoop Developer

    6 days ago

    Chennai, Tamil Nadu, India Oracle Full time

    We are seeking a skilled Data Engineer with extensive experience in the Hadoop ecosystem and a strong background in integrating and managing data from FLEXCUBE core banking systems. The ideal candidate will play a key role in designing, implementing, and optimizing our data pipelines, ensuring seamless data flow and analysis.Career Level - IC1Key...

  • Hadoop Developer

    6 days ago

    Chennai, India Hirexa Solutions Full time

    Job Description :Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities : Interact with business stake holders and designers to implement to understand business requirements. Hadoop development and implementation. Loading from disparate data sets. Good to have...

  • Hadoop

    2 months ago

    Chennai, India Virtusa Full time

    Description Hands on & Consulting Skills on Hadoop development Framework. Hands-on experience on Big data technologies (Hortonworks HDP, Apache Hadoop, HDFS, Hive, Sqoop, Flume, Zookeeper and HBase, Oozie, Spark, Ni-Fi). Development capabilities using python, Spark, Scala programming skills. Ability to debug & write / modify Shell script. Good knowledge in...

  • Hadoop Developer/PySpark Developer

    4 weeks ago

    Chennai, India Citi Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • Hadoop Developer

    2 months ago

    Chennai, India Hirexa Solutions Full time

    Job Description :Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have...

  • Hadoop Developer

    2 months ago

    Chennai, Tamil Nadu, India Hirexa Solutions Full time

    Job Description :Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have...

  • Hadoop Developer

    2 months ago

    Chennai, India Hirexa Solutions Full time

    Job Description : Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to...

  • PySpark/Hadoop Developer

    6 days ago

    Chennai, Tamil Nadu, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • PySpark/Hadoop Developer

    4 weeks ago

    Chennai, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and development...

  • PySpark/Hadoop Developer

    3 weeks ago

    Chennai, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and development...

  • PySpark/Hadoop Developer

    3 weeks ago

    chennai, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and...

  • Hadoop Developer/PySpark Developer

    4 weeks ago

    Chennai, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • Hadoop Developer/PySpark Developer

    4 weeks ago

    Chennai, India Citi Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and development...

  • Hadoop Developer/PySpark Developer

    4 weeks ago

    chennai, India Citi Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and...

  • Hadoop Developer

    2 weeks ago

    Chennai, India Cortex Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience :- 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills :- In-depth knowledge of...

  • Hadoop Developer

    6 days ago

    Chennai, Tamil Nadu, India Cortex Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience :- 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills :- In-depth knowledge of...

  • Hadoop Developer/PySpark Developer

    4 weeks ago

    Chennai, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and development...

  • Hadoop Developer/PySpark Developer

    4 weeks ago

    chennai, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and...

  • Hadoop Support

    2 weeks ago

    Chennai, India Virtusa Full time

    Hadoop Support - CREQ183780 DescriptionTitle : Hadoop SupportTier : Tier 2/Lead Software EngineerP3C1STSJD-Expertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream ProcessingShould have experience in leading a team to complete development of new features.Experienced in SDLC concepts with extensive knowledge...