Big Data Consultant

4 weeks ago


gurugram, India IQuest Management Consultants Full time

JD and company profile Data Consultant - Spark Developer with AWS position Gurgaon location:

  • Position Title : Data Consultant - Spark Developer with AWS
  • Mandatory Skills: Experience working on Big Data Consultant with PySpark /Scala or Java, AWS Glue, EMR and Lambda, Cloudera Data Platform (CDP) Rest as per below JD.
  • Exp 7 to 12 years
  • Qualification : B Tech/BE
  • Job Location Gurgaon (Remote during pandemic)
  • Interview procedure: Video (MS Teams) interviews in weekdays. (Google & MS team )
  • Shift Timing : NA


JOB DESCRIPTION

A passionate Big Data Consultant with PySpark/Scala or Java


Desired Candidate Profile


- Strong Programming skill in Spark, Scala or Java

- must have implemented solutions on AWS Glue, EMR and Lambda

- worked with s3 based data lakes, crawlers and Athena for data exploration

- integration with various source systems for data ingestion pipelines

- Experience with Impala, Kafka or other streaming solutions is good to have

- JIRA, GitLab, Jenkins is a must

- IntelliJ IDEA, Eclipse

- Strong knowledge in Cloudera Data Platform (CDP)

Roles and Responsibilities

- Hands on Spark/Scala programming experience

- Participating in agile development projects for batch and real time data ingestion.

- Integration with AWS, Real-Time Systems, Data Warehouses, and Analytics solutions.

- Working with business and peers to define, estimate, and deliver functionality.

- Produce unit tests for Spark transformations and helper methods

- Design data processing pipelines

- Good in writing Scaladoc-style documentation with all code





  • Big Data Developer

    3 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    2 weeks ago


    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data

    1 week ago


    Gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188335 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data. Demonstrate proficiency in writing shell script and SQL queries. Hands on Exp with Oracle and DB2 databases. Must have Big Data tech stack experience Hadoop, Hive, Mapr etc. Good...

  • Big Data

    7 days ago


    gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188335 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data.Demonstrate proficiency in writing shell script and SQL queries.Hands on Exp with Oracle and DB2 databases.Must have Big Data tech stack experience Hadoop, Hive, Mapr etc.Good Communication...

  • Big Data

    1 week ago


    gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data.Demonstrate proficiency in writing shell script and SQL queries.Hands on Exp with Oracle and DB2 databases.Must have Big Data tech stack experience Hadoop, Hive, Mapr etc.Good Communication...

  • Big Data

    1 week ago


    Gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data. Demonstrate proficiency in writing shell script and SQL queries. Hands on Exp with Oracle and DB2 databases. Must have Big Data tech stack experience Hadoop, Hive, Mapr etc. Good...

  • Big Data Developer

    3 weeks ago


    Gurugram, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    1 month ago


    Gurugram, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    4 weeks ago


    Gurugram, India Impetus Full time

    Title: Big data Developer Type: Full-Time Location: Gurgaon Experience: 6-9 Years Preference - Immediate Joiners Qualifications: 3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Able to write Glue jobs. Hands-on experience with...

  • Big Data Developer

    4 weeks ago


    Gurugram, India IntraEdge Full time

    Big Data Engineer Position Available in Gurgaon We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners, so...

  • Big Data Developer

    4 weeks ago


    gurugram, India IntraEdge Full time

    Big Data Engineer Position Available in Gurgaon We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent). The candidate will work closely with the engineering team and product owners, so...

  • Big Data Developer

    4 weeks ago


    Gurugram, India IntraEdge Full time

    🔴 Big Data Engineer Position Available in Gurgaon 🔴We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners,...

  • Solution Architect

    4 weeks ago


    Gurugram, India USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...

  • Big Data Developer

    4 weeks ago


    gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 weeks ago


    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...


  • gurugram, India Virtusa Full time

    Java Big Data Developer - CREQ188170 Description Responsibilities include, but are not limited to - Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality Primary focus is spent writing code, API specs, conducting code reviews and testing in ongoing sprints, or doing proof of...


  • gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand and create...


  • Gurugram, India Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...


  • Gurugram, India Virtusa Full time

    Java Big Data Developer - CREQ188170 Description Responsibilities include, but are not limited to - Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality Primary focus is spent writing code, API specs, conducting code reviews and testing in ongoing sprints, or doing proof of...


  • gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...