Big Data Developer

3 days ago


chennai, India Wipro Full time

Candidate Requirement

Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.

Associate should be self-driven, can work with minimal guidance and guide the team technically.

Job Details:

  • Expertise in Spark framework with scala language and Pyspark
  • Expertise in ETL and Data Warehousing and cloud concepts
  • Good work experience in SQL in hive and impala
  • Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts
  • Knowledge in shell scripting and git commands
  • Able to design and create data flows diagrams and do data modelling.
  • Expertise in data profiling and decision making.
  • Able to understand the Architecture and design end-to-end data flow.
  • Excellent logical and analytical, troubleshooting, and problem-solving skills.
  • Excellent working knowledge of version control system like GitHub and branching strategies.
  • Able to understand and implement the spark optimization techniques and implement the same in the code.’
  • Communicate effectively and concisely with multiple stakeholders.
  • To monitor and support the year end activities, if needed
  • Ability to co-ordinate and collaborate with cross functional teams.
  • Well versed with security and compliance aspects in Cloud.
  • Good to have Big data related certifications and health care domain knowledge

Work Location

Chennai, Noida, Gurugram, Mumbai


  • Big Data Developer

    2 days ago


    Chennai, India Mavinsys Full time

    Minimum Required Skills & Experience :1. Big Data Technologies (6+ years) :- Extensive experience with Big Data frameworks like Hadoop and Spark.- Deep understanding of Hadoop ecosystem (HDFS, YARN, MapReduce).- Familiarity with big data schedulers (e.g., Oozie, Airflow).2. Scala & Spark Expertise (4+ years each) :- Strong proficiency in Scala programming...

  • Big Data Developer

    2 months ago


    Chennai, India Virtusa Full time

    Big Data Developer - CREQ188135 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...

  • Big Data Developer

    11 hours ago


    Chennai, India Saransh Inc Full time

    Skills: Spark, Big Data, Hive, Java Job Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...

  • Big Data Developer

    6 hours ago


    chennai, India Saransh Inc Full time

    Skills: Spark, Big Data, Hive, JavaJob Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...

  • Big Data Developer

    5 hours ago


    Chennai, India Saransh Inc Full time

    Skills: Spark, Big Data, Hive, JavaJob Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...

  • Big Data Developer

    20 hours ago


    Chennai, India Saransh Inc Full time

    Skills: Spark, Big Data, Hive, JavaJob Description: 4+yrs with hands-on on Java 1.8 and Above is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting (Good to have). Design implementation of scalable fault tolerant ETL...

  • Big Data Developer

    4 months ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • GCP Big Data Engineer

    3 weeks ago


    Chennai, India IntraEdge Full time

    About the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...


  • chennai, India IntraEdge Full time

    About the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...

  • GCP Big Data Engineer

    3 weeks ago


    Chennai, India IntraEdge Full time

    About the Role: We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...

  • Big Data Developer

    3 weeks ago


    Chennai, India Wipro Full time

    Candidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts Good work...

  • Big Data Developer

    3 weeks ago


    Chennai, India Wipro Full time

    Candidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts Good work...

  • Big Data Developer

    3 weeks ago


    Chennai, India Wipro Full time

    Candidate Requirement Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts ...

  • Big Data Architect

    4 months ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Lead

    2 months ago


    Chennai, India Virtusa Full time

    Big Data Lead - CREQ194625 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...

  • Solution Architect

    2 months ago


    Chennai, India Recro Full time

    Responsibilities :- Work collaboratively with product managers, engineers, and data scientists to understand business requirements and translate them into scalable, secure, and cost-effective big data solutions leveraging AWS services.- Design and document big data architectures that incorporate data ingestion, processing, storage, analytics, and...

  • Big Data Engineer

    2 days ago


    Chennai, India People Prime Worldwide Full time

    About Company: Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...

  • Big Data Engineer

    4 weeks ago


    Chennai, India People Prime Worldwide Full time

    About Company: Our client is a global technologyconsulting and digital solutions company that enables enterprisesto reimagine business models and accelerate innovation throughdigital technologies. Powered by more than 84000 entrepreneurialprofessionals across more than 30 countries it caters to over 700clients with its extensive domain and technology...


  • Chennai, India Sriven Full time

    Job Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing...


  • Chennai, India Sriven Full time

    Job Title: Senior Big Data Engineer Experience Required: 7+ years Educational Qualification: Bachelor's degree from an accredited college or university Job Description: We are looking for a highly skilled Senior Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and developing complex Big Data...