Big Data Developer

3 weeks ago


Chennai, India Wipro Full time

Candidate Requirement

Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.

Associate should be self-driven, can work with minimal guidance and guide the team technically.

Job Details:

  1. Expertise in Spark framework with scala language and Pyspark
  2. Expertise in ETL and Data Warehousing and cloud concepts
  3. Good work experience in SQL in hive and impala
  4. Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts
  5. Knowledge in shell scripting and git commands
  6. Able to design and create data flows diagrams and do data modelling.
  7. Expertise in data profiling and decision making.
  8. Able to understand the Architecture and design end-to-end data flow.
  9. Excellent logical and analytical, troubleshooting, and problem-solving skills.
  10. Excellent working knowledge of version control system like GitHub and branching strategies.
  11. Able to understand and implement the spark optimization techniques and implement the same in the code.’
  12. Communicate effectively and concisely with multiple stakeholders.
  13. To monitor and support the year end activities, if needed
  14. Ability to co-ordinate and collaborate with cross functional teams.
  15. Well versed with security and compliance aspects in Cloud.
  16. Good to have Big data related certifications and health care domain knowledge

Work Location

Chennai, Noida, Gurugram, Mumbai


  • Big Data Developer

    2 months ago


    Chennai, India Virtusa Full time

    Big Data Developer - CREQ188135 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...

  • Big Data Developer

    4 months ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • GCP Big Data Engineer

    2 weeks ago


    Chennai, India IntraEdge Full time

    About the Role: We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...

  • GCP Big Data Engineer

    3 weeks ago


    Chennai, India IntraEdge Full time

    About the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...

  • Big Data Developer

    2 weeks ago


    Chennai, India Wipro Full time

    Candidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts ...

  • Big Data Developer

    3 weeks ago


    Chennai, India Wipro Full time

    Candidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts Good work...

  • Big Data Architect

    3 months ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Lead

    2 months ago


    Chennai, India Virtusa Full time

    Big Data Lead - CREQ194625 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...

  • Big Data Developer

    3 months ago


    Chennai, India ProPMO Services Private Limited Full time

    GCP + Big Data DeveloperExperience : 2-5 YearsNotice Period : Immediate Joiners only (max 2 weeks)Location : Bangalore, Chennai, GurgaonEmployment Type : Contract BasisJob Overview :We are seeking a highly skilled and motivated GCP + Big Data Developer to join our team on a contract basis. The ideal candidate will have 2-5 years of relevant experience and...

  • Solution Architect

    2 months ago


    Chennai, India Recro Full time

    Responsibilities :- Work collaboratively with product managers, engineers, and data scientists to understand business requirements and translate them into scalable, secure, and cost-effective big data solutions leveraging AWS services.- Design and document big data architectures that incorporate data ingestion, processing, storage, analytics, and...

  • Big Data Engineer

    4 weeks ago


    Chennai, India People Prime Worldwide Full time

    About Company: Our client is a global technologyconsulting and digital solutions company that enables enterprisesto reimagine business models and accelerate innovation throughdigital technologies. Powered by more than 84000 entrepreneurialprofessionals across more than 30 countries it caters to over 700clients with its extensive domain and technology...


  • Chennai, India Sriven Full time

    Job Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing...


  • Chennai, India Sriven Full time

    Job Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data...


  • Chennai, India Sriven Full time

    Job Title: Senior Big Data EngineerExperience Required: 7+ yearsEducational Qualification: Bachelor's degree from an accredited college or universityJob Description:We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data pipelines...


  • Chennai, India Sriven Full time

    Job Title: Senior Big Data EngineerExperience Required: 7+ yearsEducational Qualification: Bachelor's degree from an accredited college or universityJob Description:We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data pipelines...

  • Big Data Developer

    4 months ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Hadoop ecosystem technologies (Hadoop, HDFS, Hive, etc.). Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement...

  • Data Engineer IV

    1 month ago


    Chennai, India Sadup Softech Full time

    Must have skills :- Minimum of 5-7 years of experience in software development, with a focus on Java and infrastructure tools.- Min 6+ years of experience as a Data Engineer.- Good Experience in handling Big Data Spark, Hive SQL, BigQuery, SQL.- Candidate worked on cloud platforms and GCP would be an added advantage.- Good understanding of Hadoop based...


  • Chennai, India Trinity Technology solutions Full time

    We're seeking a highly skilled and experienced Senior Data Engineer to join our team! You will play a pivotal role in designing, developing, and deploying robust data pipelines and data warehouse solutions leveraging Google Cloud Platform (GCP). You will leverage your expertise in big data technologies like Hadoop, Spark, and Airflow to build scalable...

  • Big Data Engineer

    23 hours ago


    Chennai, India Tata Consultancy Services Full time

    Greetings fromTATA Consultancy Services !!We are currently Hiring ForBIG DATA ENGINEERJob Location :CHENNAIExp 5+Interview Mode: FACE TO FACEINTERVIEW DATE : 21-Aug-24Job description3+ years of relevant experience in Pyspark and Hive, HBaseProficiency in integrating, transforming, and consolidating data from various structured and unstructured data...

  • Big Data Architect

    1 month ago


    Chennai, India Selsoftinc Full time

    Job Description :- Design and implement scalable big data architectures on Microsoft Azure and Azure Fabric to handle large volumes of data efficiently and securely.- Develop and manage data pipelines for ingesting, processing, and analyzing large datasets, ensuring data quality and integrity.- Collaborate with data scientists, data engineers, and business...