Hadoop Developer

1 week ago


Chennai, Tamil Nadu, India Cortex Consulting Pvt. Ltd. Full time

We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.

The Ideal Candidate :

Experience :

- 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.

Technical Skills :

- In-depth knowledge of Apache Hadoop architecture and core components (HDFS, YARN, MapReduce).

- Proficiency in distributed data processing frameworks like Apache Spark (Spark SQL, Spark Streaming).

- Expertise in data warehousing and querying using Apache Hive and HiveQL.

- Strong understanding of Unix/Shell scripting for automating Hadoop tasks.

- Solid programming skills in Python or Scala for developing big data applications.

Additional Skills :

- Experience with data ingestion tools like Sqoop, Flume, or Kafka (a plus).

- Familiarity with data quality and data cleansing techniques.

- Understanding of distributed file systems like HDFS and alternatives like Apache Parquet or Apache ORC.

- Experience with big data visualization tools (e.g., Tableau, Power BI) is a plus.

Soft Skills :

- Excellent communication and collaboration skills to work effectively with cross-functional teams (data analysts, data scientists, etc.).

- Strong problem-solving and analytical skills.

- Ability to learn new technologies quickly and adapt to changing requirements.

- A proactive and results-oriented approach to work.

Responsibilities :

- Design, develop, and implement big data processing pipelines using Hadoop and Spark.

- Develop and maintain data extraction, transformation, and loading (ETL) processes using tools like Sqoop, Flume, or Kafka.

- Write efficient MapReduce and Spark jobs to process large datasets.

- Design and develop Hive tables and queries to store and analyze big data.

- Automate Hadoop tasks using Unix/Shell scripting.

- Troubleshoot and debug big data processing issues.

- Monitor and optimize Hadoop cluster performance.

- Work with data analysts and data scientists to understand data requirements and develop solutions.

- Stay up-to-date with the latest advancements in big data technologies and best practices.

(ref:hirist.tech)
  • Hadoop Developer

    1 week ago


    Chennai, Tamil Nadu, India Cortex Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience : 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills : Indepth knowledge of Apache...

  • Hadoop Developer

    1 week ago


    Chennai, Tamil Nadu, India Oracle Full time

    We are seeking a skilled Data Engineer with extensive experience in the Hadoop ecosystem and a strong background in integrating and managing data from FLEXCUBE core banking systems. The ideal candidate will play a key role in designing, implementing, and optimizing our data pipelines, ensuring seamless data flow and analysis.Career Level - IC1Key...

  • Hadoop Developer

    2 months ago


    Chennai, Tamil Nadu, India Hirexa Solutions Full time

    Job Description :Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have...


  • Chennai, Tamil Nadu, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • Hadoop Developer

    1 week ago


    Chennai, Tamil Nadu, India timesjobs Full time

    Job Description Experience in Hadoop ecosystems data processing frameworks including Map Reduce, Spark with Scala, Python, SparkSQL, Pandas, NumPy toolkits etc.Strong Experience working on Hive, HBase.Strong analytical skills related to working with structured, semi-structured and unstructured datasetsSolid understanding of agile development methods and...

  • Hadoop Developer

    4 weeks ago


    Chennai, Tamil Nadu, India timesjobs Full time

    Job Description Experience in Hadoop ecosystems data processing frameworks including Map Reduce, Spark with Scala, Python, SparkSQL, Pandas, NumPy toolkits etc.Strong Experience working on Hive, HBase.Strong analytical skills related to working with structured, semi-structured and unstructured datasetsSolid understanding of agile development methods and...

  • Hadoop Support

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Hadoop Support - CREQ183780 Description Title : Hadoop Support Tier : Tier 2/Lead Software Engineer P3C1STSJD-Expertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream ProcessingShould have experience in leading a team to complete development of new features.Experienced in SDLC concepts with extensive...


  • Chennai, Tamil Nadu, India Jobs for Humanity Full time

    Company DescriptionJobs for Humanity is dedicated to building an inclusive and just employment ecosystem.Therefore, we have dedicated this job posting to individuals coming from the following communities: Refugee, Neurodivergent, Single Parent, Blind or Low Vision, Deaf of Hard of Hearing Black, Hispanic, Asian, Military Veterans, the Elderly, the LGBTQ, and...


  • Chennai, Tamil Nadu, India Capgemini Full time

    Job DescriptionBig Data Developer (3 – 10 Years)Primary SkillsGood understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robustExperience in designing application solutions in hadoop ecosystemDeep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and PysparkHDFS file formats and...


  • Chennai, Tamil Nadu, India Capgemini Full time

    Job Description Big Data Developer (3 – 10 Years) Primary Skills Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Design and develop test specifications based on various requirement documents for scheduled execution.- Conduct both functional and technical testing of ETL jobs, utilizing automation tools whenever possible.- Utilize your in-depth knowledge of Big Data ETL to identify and design effective test scenarios.- Experience with Hadoop Hive is...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Design and develop test specifications based on various requirement documents for scheduled execution.- Conduct both functional and technical testing of ETL jobs, utilizing automation tools whenever possible.- Utilize your in-depth knowledge of Big Data ETL to identify and design effective test scenarios.- Experience with Hadoop Hive is...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Big Data Developer - CREQ188115 Description Job Description: 5+ years of hands-on experience in designing, building and suapporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India Infogain Solutions Pte Ltd Full time

    Find Your Dream Job With UsWE ARE HIRING Apply now and make a difference.Job Title:DeveloperJob Requisition Number:UCIG-001Job Level:4-6 Years of experienceLocation:Chennai/BangaloreSalary: 15 to 16 Lakhs per AnnumKey Skills :Big Data, Hadoop, or Data warehouse tools and Cloud ComputingMust-Have**(Ideally should not be more than 3-5)·Working experience of...

  • Big data Developer

    1 week ago


    Chennai, Tamil Nadu, India Manvision Technologies Full time

    Role: Big Data Developer Exp: 3-6 Years Location: Chennai, Mumbai, Pune Skills: Bigdata like Hadoop, Hive, Pyspark, Spark, Cloudera

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India Infogain Solutions Pte Ltd Full time

    Job Title:Developer Job Requisition Number:UCIG-001 Job Level:4-6 Years of experience Location:Chennai/Bangalore Salary: 15 to 16 Lakhs per Annum. Key Skills : Big Data, Hadoop, or Data warehouse tools and Cloud Computing Must-Have(Ideally should not be more than 3-5) Working experience of Hadoop, Hive SQL's, Spark, Bigdata Eco System Tools.Should be able to...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    We are hiring a Data Engineer, and we are looking for someone to join our team. Check out the job details below:Design, develop, and maintain data processing pipelines using Apache Spark and ScalaOptimize Spark jobs for performance, scalability, and reliabilityCollaborate with data engineers and data scientists to implement data-driven solutionsDevelop and...

  • Sas Developer

    1 week ago


    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    5+ YearsSolid development skills in SAS and SQLClear hands-on mastery in big database systems - Hadoop ecosystem, Cloud technologies (AWS, Azure, Google), in-memory database systems (HANA, Hazel cast, etc) and other database systems - traditional RDBMS (Teradata, SQL Server, Oracle), and No SQL databases (Cassandra, Mongo DB, Dynamo DB)Good understanding of...

  • Spark/Scala Developer

    1 month ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance, scalability, and reliability- Work closely with data engineers and data scientists to implement data-driven solutions- Develop and maintain ETL processes to ingest, transform, and load large volumes of data- Perform data...