Big Data Developer

4 months ago


Chennai, India Virtusa Full time
Big Data Developer - CREQ188135 Description Job Description:
5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive
Bachelors or masters degree in Computer Science or related field
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Advanced knowledge of the Hadoop ecosystem and its components
In-depth knowledge of Hive, Shell scripting, Python, Spark
Ability to write MapReduce jobs
Experience using Job Schedulers like Autosys
Hands on experience in HiveQL
Good knowledge on Hadoop Architecture and HDFS
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Experience with jenkins for Continuous Integration
Experience using Source Code and Version Control Systems like Bitbucket, Git
Good to have experience on Agile Development
Responsibilities: Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset
Participates and guides team in estimating work necessary to realize a story/requirement through the software delivery lifecycle
Responsible for developing and delivering complex software requirements to accomplish business goals
Ensures that software is developed to meet functional, non-functional, and compliance requirements
Codes solutions, Unit testing and ensure the solution can be integrated successfully into the overall application/system with clear robust, and well-tested interfaces

Required Skills: Hadoop, Hive, HDFS, Spark, Python, Unix
Nice to have skills: AML Domain knowledge
Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills PySpark, Kafka, ANSI SQL, Cloudera Data platform Years of Experience 5 Qualification

Job Description:
5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive
Bachelors or masters degree in Computer Science or related field
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Advanced knowledge of the Hadoop ecosystem and its components
In-depth knowledge of Hive, Shell scripting, Python, Spark
Ability to write MapReduce jobs
Experience using Job Schedulers like Autosys
Hands on experience in HiveQL
Good knowledge on Hadoop Architecture and HDFS
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Experience with jenkins for Continuous Integration
Experience using Source Code and Version Control Systems like Bitbucket, Git
Good to have experience on Agile Development
Responsibilities: Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset
Participates and guides team in estimating work necessary to realize a story/requirement through the software delivery lifecycle
Responsible for developing and delivering complex software requirements to accomplish business goals
Ensures that software is developed to meet functional, non-functional, and compliance requirements
Codes solutions, Unit testing and ensure the solution can be integrated successfully into the overall application/system with clear robust, and well-tested interfaces

Required Skills: Hadoop, Hive, HDFS, Spark, Python, Unix
Nice to have skills: AML Domain knowledge

Travel No
  • Big Data Developer

    3 weeks ago


    Chennai, India Mavinsys Full time

    Job Title: Big Data DeveloperMavinsys is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing and developing scalable data pipelines using Scala and Spark.Key Responsibilities:Design and develop scalable data pipelines using Scala and Spark.Implement robust and efficient Spark...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data DeveloperTata Consultancy Services is seeking a skilled Big Data Developer to join our team.Job Summary:We are looking for a highly motivated and experienced Big Data Developer to design and administer data projects using Big Data Services. The ideal candidate will have a strong background in Hadoop, Spark, Scala, and Hive, and will be...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperJob Summary:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will design, develop, and deploy scalable Big Data applications using Apache Spark.Responsibilities:Data Ingestion: Implement data ingestion processes from various data sources to the Big Data...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperAbout the Role:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies.Key Responsibilities:Design and develop scalable Big Data applications...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Key ResponsibilitiesRiskInsight Consulting Pvt Ltd is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in designing, developing, and deploying scalable Big Data applications using Apache Spark.Design and Develop Big Data Applications: Collaborate with data scientists and business analysts to...

  • Big Data Developer

    1 month ago


    Chennai, Tamil Nadu, India Mavinsys Full time

    Minimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...

  • Big Data Developer

    2 months ago


    Chennai, India Mavinsys Full time

    Minimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...

  • Big data developer

    3 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS! TCS is hiring for Big Data Developer Desired Experience: 5+ Years Job Location: Chennai/ Bangalore / Pune / Mumbai Require skillset: Big Data, Hadoop, Spark, Scala, Hive Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Scala Nice to Have Qualifications: Data Engineer Certification Experience with...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    3 days ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirement- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Experience - 5 to 10 yrs Requirement Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a...

  • Big Data Developer

    2 weeks ago


    chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Experience - 5 to 10 yrs Requirement Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a...

  • Big Data Developer

    2 weeks ago


    chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India Saransh Inc Full time

    Job Description:Saransh Inc is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in Java and experience with Big Data technologies such as Spark and Hive.Responsibilities:Design and implement scalable fault-tolerant ETL pipelines on Big Data platforms.Work with the onsite development team to...

  • Big Data Developer

    2 hours ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data DeveloperDescription:TCS is hiring a Big Data Developer to work on our exciting projects. As a Big Data Developer, you will be responsible for transferring and transforming data with Azure Synapse Analytics pipelines.Responsibilities:Transfer and transform data with Azure Synapse Analytics pipelines.Build a data pipeline in Azure Synapse...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data DeveloperAre you a skilled data engineer with a passion for designing and building scalable data applications? Do you have experience with Spark, Sqoop, and Hive? We're looking for a talented Big Data Developer to join our team at Virtusa.Responsibilities:Design and develop data applications using Spark, Sqoop, and HiveCollaborate with...

  • Big Data Developer

    3 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS! TCS is hiring for Big Data Developer Desired Experience: 5+ Years Job Location: Chennai/ Bangalore / Pune / Mumbai Require skillset: Big Data, Hadoop, Spark, Scala, Hive Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Scala Nice to Have Qualifications: Data Engineer Certification Experience with...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Virtusa. As a Big Data Developer, you will be responsible for designing, building, and supporting Data Applications using Spark, Sqoop, and Hive.Responsibilities:Develop components, application interfaces, and solution enablers while ensuring principal...