Big Data Engineer

3 weeks ago


Gurugram, India Virtusa Full time
Big Data Engineer - CREQ190572 Description

Qualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark) Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus
Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis, design, development, testing, and implementation of system applications Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
Preferred Qualifications: Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage 1 + years of experience in designing and building solutions using Kafka streams or queues Experience with GitHub/Bitbucket and leveraging CI/CD pipelines Experience with NoSQL , HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude Good communication skills Excellent Project management skills

6+ years of software development experience and leading teams of engineers and scrum teams
3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus

Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting
Ability to design and develop optimized Data pipelines for batch and real time data processing

Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage 1 + years of experience in designing and building solutions using Kafka streams or queues
Experience with GitHub/Bitbucket and leveraging CI/CD pipelines Experience with NoSQL , HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude Good communication skills Excellent Project management skills

Primary Location Gurgaon, Haryana, India Job Type Experienced Primary Skills PySpark Years of Experience 6 Qualification

Qualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark) Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus
Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis, design, development, testing, and implementation of system applications Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
Preferred Qualifications: Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage 1 + years of experience in designing and building solutions using Kafka streams or queues Experience with GitHub/Bitbucket and leveraging CI/CD pipelines Experience with NoSQL , HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude Good communication skills Excellent Project management skills

6+ years of software development experience and leading teams of engineers and scrum teams
3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus

Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting
Ability to design and develop optimized Data pipelines for batch and real time data processing

Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage 1 + years of experience in designing and building solutions using Kafka streams or queues
Experience with GitHub/Bitbucket and leveraging CI/CD pipelines Experience with NoSQL , HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude Good communication skills Excellent Project management skills

Travel No
  • Big Data Engineer

    4 weeks ago


    gurugram, India OmegaHires Full time

    Job Title: Big Data Engineer  Duration: Full-time on OmegaHires Payroll  Location: Gurugram (Should be located near NCR to attend office for 3 days a week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...

  • Big Data Engineer

    5 days ago


    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Big Data Engineer

    1 month ago


    Gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    3 weeks ago


    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    3 weeks ago


    Gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...

  • Big Data Engineer

    1 month ago


    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...


  • gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...


  • gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Publicis Sapient

    3 weeks ago


    Gurugram, India Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Engineer

    1 day ago


    gurugram, India Virtusa Full time

    Big Data Engineer - CREQ190592 Description Qualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Big Data Engineer

    1 month ago


    Gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    1 month ago


    gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...

  • Big Data Engineer

    3 weeks ago


    Gurugram, India Intraedge Technologies Ltd. Full time

    Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...


  • Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...


  • Gurgaon/Gurugram, India Paisabazaar.com Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...

  • Publicis Sapient

    4 weeks ago


    Gurugram, India Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Developer

    2 months ago


    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    2 months ago


    gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    3 weeks ago


    Gurugram, India Shya Workforce Solutions Full time

    Collaborate with enterprise architects, data architects, developers & engineers, data scientists, andinformation designers to lead the identification and definition of required data structures, formats,pipelines, metadata, and workload orchestration capabilitiesExperience in service architecture, development, and high performance and scalability.Experience...

  • Big Data Developer

    3 weeks ago


    Gurugram, India Shya Workforce Solutions Full time

    Collaborate with enterprise architects, data architects, developers & engineers, data scientists, andinformation designers to lead the identification and definition of required data structures, formats,pipelines, metadata, and workload orchestration capabilitiesExperience in service architecture, development, and high performance and scalability.Experience...