Big Data Developer

2 months ago


Chennai, India Mavinsys Full time

Minimum Required Skills & Experience :

1. Big Data Technologies (6+ years) :

- Extensive experience with Big Data frameworks like Hadoop and Spark.

- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).

- Familiarity with big data schedulers (e.g., Oozie, Airflow).

2. Scala & Spark Expertise (4+ years each) :

- Strong proficiency in Scala programming language.

- In-depth knowledge of Spark APIs for data processing and manipulation.

- Experience in developing scalable and efficient Spark applications.

3. Data Pipeline & API Development :

- Proven experience in designing and building data pipelines using Scala.

- Ability to develop RESTful APIs to expose data to various applications.

Additional Skills :

- Experience with Apache Kafka for real-time data streaming (2+ years).

- Proficiency in SQL for data querying and manipulation (4+ years).

- Strong understanding of Unix/Linux operating systems and shell scripting (2+ years).

- Familiarity with Citi VDI (Virtual Development Infrastructure) is a plus.

Key Responsibilities :

- Design and develop scalable data pipelines using Scala and Spark.

- Implement robust and efficient Spark applications for data processing.

- Develop RESTful APIs to provide access to processed data for various applications.

- Optimize and maintain existing big data infrastructure and pipelines.

- Collaborate with data analysts and scientists to understand data needs and translate them into technical solutions.

- Troubleshoot and debug big data related issues.

- Stay up-to-date with the latest advancements in big data technologies and best practices

(ref:hirist.tech)
  • Big Data Developer

    4 weeks ago


    Chennai, India Mavinsys Full time

    Job Title: Big Data DeveloperMavinsys is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing and developing scalable data pipelines using Scala and Spark.Key Responsibilities:Design and develop scalable data pipelines using Scala and Spark.Implement robust and efficient Spark...

  • Big Data Developer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data DeveloperTata Consultancy Services is seeking a skilled Big Data Developer to join our team.Job Summary:We are looking for a highly motivated and experienced Big Data Developer to design and administer data projects using Big Data Services. The ideal candidate will have a strong background in Hadoop, Spark, Scala, and Hive, and will be...

  • Big Data Developer

    2 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperJob Summary:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will design, develop, and deploy scalable Big Data applications using Apache Spark.Responsibilities:Data Ingestion: Implement data ingestion processes from various data sources to the Big Data...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperAbout the Role:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies.Key Responsibilities:Design and develop scalable Big Data applications...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Key ResponsibilitiesRiskInsight Consulting Pvt Ltd is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in designing, developing, and deploying scalable Big Data applications using Apache Spark.Design and Develop Big Data Applications: Collaborate with data scientists and business analysts to...

  • Big Data Developer

    1 month ago


    Chennai, Tamil Nadu, India Mavinsys Full time

    Minimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...

  • Big data developer

    3 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS! TCS is hiring for Big Data Developer Desired Experience: 5+ Years Job Location: Chennai/ Bangalore / Pune / Mumbai Require skillset: Big Data, Hadoop, Spark, Scala, Hive Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Scala Nice to Have Qualifications: Data Engineer Certification Experience with...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    6 days ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirement- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum...

  • Big Data Developer

    3 days ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job DescriptionAs a Data Architecture Specialist at Virtusa, you will have the opportunity to design and build high-performance big data applications using Spark, Sqoop, and Hive.We are seeking a highly experienced and skilled professional with a strong background in big data processing and a bachelor's or master's degree in Computer Science or a related...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Experience - 5 to 10 yrs Requirement Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a...

  • Big Data Developer

    2 weeks ago


    chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Experience - 5 to 10 yrs Requirement Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    3 days ago


    chennai, India ZF Group Full time

    Job Description: We are currently seeking dynamic individuals to join our team and contribute to the success for our organization. Experience - 5 to 10 yrs Requirement Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a...

  • Big Data Developer

    2 weeks ago


    Chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    2 weeks ago


    chennai, India ZF Group Full time

    Job Description:We are currently seeking dynamic individuals to join our team and contribute to the success for our organization.Experience - 5 to 10 yrsRequirementBachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Saransh Inc Full time

    Job Description:Saransh Inc is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in Java and experience with Big Data technologies such as Spark and Hive.Responsibilities:Design and implement scalable fault-tolerant ETL pipelines on Big Data platforms.Work with the onsite development team to...

  • Big Data Developer

    4 days ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data DeveloperDescription:TCS is hiring a Big Data Developer to work on our exciting projects. As a Big Data Developer, you will be responsible for transferring and transforming data with Azure Synapse Analytics pipelines.Responsibilities:Transfer and transform data with Azure Synapse Analytics pipelines.Build a data pipeline in Azure Synapse...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data DeveloperAre you a skilled data engineer with a passion for designing and building scalable data applications? Do you have experience with Spark, Sqoop, and Hive? We're looking for a talented Big Data Developer to join our team at Virtusa.Responsibilities:Design and develop data applications using Spark, Sqoop, and HiveCollaborate with...

  • Big Data Developer

    3 weeks ago


    Chennai, India Tata Consultancy Services Full time

    Greetings from TCS! TCS is hiring for Big Data Developer Desired Experience: 5+ Years Job Location: Chennai/ Bangalore / Pune / Mumbai Require skillset: Big Data, Hadoop, Spark, Scala, Hive Job Description:- Must Have Technical Qualifications: Spark Hadoop Hive Scala Nice to Have Qualifications: Data Engineer Certification Experience with...