Hadoop Developer

1 week ago


Chennai, Tamil Nadu, India Oracle Full time

We are seeking a skilled Data Engineer with extensive experience in the Hadoop ecosystem and a strong background in integrating and managing data from FLEXCUBE core banking systems.

The ideal candidate will play a key role in designing, implementing, and optimizing our data pipelines, ensuring seamless data flow and analysis.

Career Level - IC1

Key Responsibilities:

Data Integration:
Lead the integration of data from FLEXCUBE core banking systems into our Hadoop-based data infrastructure. Develop and maintain efficient data ingestion processes.

Hadoop Ecosystem:
Design, build, and optimize data pipelines within the Hadoop ecosystem, including HDFS, Sqoop, Unix shell scripting, Python coding and Spark

Data Modelling:
Create and maintain data models, schemas, and structures to support data analysis and reporting requirements

ETL Processes:
Develop Extract, Transform, Load (ETL) processes to cleanse, enrich, and transform data for downstream consumption

Data Quality:
Implement data quality checks and monitoring processes to ensure the accuracy, completeness, and consistency of data

Performance Optimization:
Optimize data processing and query performance within the Hadoop ecosystem

Data Security:
Ensure data security and compliance with data privacy regulations during data handling and processing

Documentation:
Maintain thorough documentation of data pipelines, transformations, and data flow processes

Collaboration:

Collaborate with cross-functional teams, including FLEXCUBE consulting, data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.

Mastery of the FLEXCUBE

backend tables and data model is essential

Qualifications:


Bachelor's degree in Computer Science, Information Technology, or a related field.3 to 6 Years of proven experience in designing and implementing data solutions within the Hadoop ecosystem.

Strong expertise in Hadoop components such as HDFS, Sqoop, Unix shell scripting, Python coding and SparkExperience with FLEXCUBE integration and data extraction.

Proficiency in SQL and database systems.
Knowledge of data modelling and ETL processes.
Strong problem-solving and analytical skills.
Excellent communication and teamwork abilities.
Banking or financial industry experience is a plus.
Certifications in Hadoop or related technologies are beneficial.

Additional Information:


This role offers an exciting opportunity to work on cutting-edge data projects and contribute to data-driven decision-making in the financial sector.

The candidate should be prepared to work in a dynamic and collaborative environment. Candidates with a strong background in the Hadoop ecosystem and experience with FLEXCUBE integration are encouraged to apply. We are committed to fostering professional growth and providing opportunities for skill development.
  • Hadoop Developer

    1 week ago


    Chennai, Tamil Nadu, India Cortex Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience : 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills : Indepth knowledge of Apache...

  • Hadoop Developer

    2 months ago


    Chennai, Tamil Nadu, India Hirexa Solutions Full time

    Job Description :Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have...


  • Chennai, Tamil Nadu, India 12542 Citicorp Services India Private Limited Full time

    Data Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...

  • Hadoop Developer

    1 week ago


    Chennai, Tamil Nadu, India Cortex Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience :- 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills :- In-depth knowledge of...

  • Hadoop Developer

    1 week ago


    Chennai, Tamil Nadu, India timesjobs Full time

    Job Description Experience in Hadoop ecosystems data processing frameworks including Map Reduce, Spark with Scala, Python, SparkSQL, Pandas, NumPy toolkits etc.Strong Experience working on Hive, HBase.Strong analytical skills related to working with structured, semi-structured and unstructured datasetsSolid understanding of agile development methods and...

  • Hadoop Developer

    4 weeks ago


    Chennai, Tamil Nadu, India timesjobs Full time

    Job Description Experience in Hadoop ecosystems data processing frameworks including Map Reduce, Spark with Scala, Python, SparkSQL, Pandas, NumPy toolkits etc.Strong Experience working on Hive, HBase.Strong analytical skills related to working with structured, semi-structured and unstructured datasetsSolid understanding of agile development methods and...

  • Hadoop Support

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Hadoop Support - CREQ183780 Description Title : Hadoop Support Tier : Tier 2/Lead Software Engineer P3C1STSJD-Expertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream ProcessingShould have experience in leading a team to complete development of new features.Experienced in SDLC concepts with extensive...


  • Chennai, Tamil Nadu, India Jobs for Humanity Full time

    Company DescriptionJobs for Humanity is dedicated to building an inclusive and just employment ecosystem.Therefore, we have dedicated this job posting to individuals coming from the following communities: Refugee, Neurodivergent, Single Parent, Blind or Low Vision, Deaf of Hard of Hearing Black, Hispanic, Asian, Military Veterans, the Elderly, the LGBTQ, and...


  • Chennai, Tamil Nadu, India Capgemini Full time

    Job DescriptionBig Data Developer (3 – 10 Years)Primary SkillsGood understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robustExperience in designing application solutions in hadoop ecosystemDeep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and PysparkHDFS file formats and...


  • Chennai, Tamil Nadu, India Capgemini Full time

    Job Description Big Data Developer (3 – 10 Years) Primary Skills Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystem Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark HDFS file...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Design and develop test specifications based on various requirement documents for scheduled execution.- Conduct both functional and technical testing of ETL jobs, utilizing automation tools whenever possible.- Utilize your in-depth knowledge of Big Data ETL to identify and design effective test scenarios.- Experience with Hadoop Hive is...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Design and develop test specifications based on various requirement documents for scheduled execution.- Conduct both functional and technical testing of ETL jobs, utilizing automation tools whenever possible.- Utilize your in-depth knowledge of Big Data ETL to identify and design effective test scenarios.- Experience with Hadoop Hive is...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Big Data Developer - CREQ188115 Description Job Description: 5+ years of hands-on experience in designing, building and suapporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India Infogain Solutions Pte Ltd Full time

    Find Your Dream Job With UsWE ARE HIRING Apply now and make a difference.Job Title:DeveloperJob Requisition Number:UCIG-001Job Level:4-6 Years of experienceLocation:Chennai/BangaloreSalary: 15 to 16 Lakhs per AnnumKey Skills :Big Data, Hadoop, or Data warehouse tools and Cloud ComputingMust-Have**(Ideally should not be more than 3-5)·Working experience of...

  • Big data Developer

    1 week ago


    Chennai, Tamil Nadu, India Manvision Technologies Full time

    Role: Big Data Developer Exp: 3-6 Years Location: Chennai, Mumbai, Pune Skills: Bigdata like Hadoop, Hive, Pyspark, Spark, Cloudera

  • Big Data Developer

    1 week ago


    Chennai, Tamil Nadu, India Infogain Solutions Pte Ltd Full time

    Job Title:Developer Job Requisition Number:UCIG-001 Job Level:4-6 Years of experience Location:Chennai/Bangalore Salary: 15 to 16 Lakhs per Annum. Key Skills : Big Data, Hadoop, or Data warehouse tools and Cloud Computing Must-Have(Ideally should not be more than 3-5) Working experience of Hadoop, Hive SQL's, Spark, Bigdata Eco System Tools.Should be able to...


  • Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    We are hiring a Data Engineer, and we are looking for someone to join our team. Check out the job details below:Design, develop, and maintain data processing pipelines using Apache Spark and ScalaOptimize Spark jobs for performance, scalability, and reliabilityCollaborate with data engineers and data scientists to implement data-driven solutionsDevelop and...

  • Sas Developer

    1 week ago


    Chennai, Tamil Nadu, India Optimum Solutions Pte Ltd Full time

    5+ YearsSolid development skills in SAS and SQLClear hands-on mastery in big database systems - Hadoop ecosystem, Cloud technologies (AWS, Azure, Google), in-memory database systems (HANA, Hazel cast, etc) and other database systems - traditional RDBMS (Teradata, SQL Server, Oracle), and No SQL databases (Cassandra, Mongo DB, Dynamo DB)Good understanding of...

  • Spark/Scala Developer

    1 month ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    About the job :- Design, develop, and maintain data processing pipelines using Apache Spark and Scala- Optimize Spark jobs for performance, scalability, and reliability- Work closely with data engineers and data scientists to implement data-driven solutions- Develop and maintain ETL processes to ingest, transform, and load large volumes of data- Perform data...