![Virtusa](https://media.trabajo.org/img/noimg.jpg)
Big Data Engineer
4 days ago
Qualifications Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark) Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus
Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing Should have experience in analysis, design, development, testing, and implementation of system applications Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
Preferred Qualifications: Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage 1 + years of experience in designing and building solutions using Kafka streams or queues Experience with GitHub/Bitbucket and leveraging CI/CD pipelines Experience with NoSQL , HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude Good communication skills Excellent Project management skills
6+ years of software development experience and leading teams of engineers and scrum teams
3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus
Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data Experience in UNIX shell scripting
Ability to design and develop optimized Data pipelines for batch and real time data processing
Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage 1 + years of experience in designing and building solutions using Kafka streams or queues
Experience with GitHub/Bitbucket and leveraging CI/CD pipelines Experience with NoSQL , HBase, Couchbase, MongoDB is good to have Excellent technical and analytical aptitude Good communication skills Excellent Project management skills
-
Senior Big Data Engineer
6 hours ago
gurugram, India PAR Technology Full timeTitle Senior Big Data Engineer Reporting Manager, Big Data Job location Jaipur/Gurugram About the role Sr Big Data Engineer is critical in leading Punchh’s data innovations. By leveraging prior industrial experience in big data, he/she will help create cutting-edge data and analytics products for Punchh’s business partners. This role requires close...
-
Big Data Engineer
4 weeks ago
gurugram, India OmegaHires Full timeJob Title: Big Data Engineer Duration: Full-time on OmegaHires Payroll Location: Gurugram (Should be located near NCR to attend office for 3 days a week) Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...
-
Big Data Engineer
1 week ago
Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full timeJob Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...
-
Big Data Engineer
2 months ago
Gurugram, India dunnhumby Full timeWe’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...
-
Big Data Engineer
1 month ago
gurugram, India dunnhumby Full timeWe’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...
-
Big Data Engineer
3 weeks ago
gurugram, India dunnhumby Full timeWe’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...
-
Big Data Engineer
3 weeks ago
Gurugram, India dunnhumby Full timeWe’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...
-
Lead Big Data Software Engineer
2 months ago
gurugram, India Epam Full timeDescription EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...
-
Senior Big Data Software Engineer
2 months ago
gurugram, India Epam Full timeDescription EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...
-
Publicis Sapient
3 weeks ago
Gurugram, India Publicis Sapient Full timeJob Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...
-
Big Data Engineer
1 month ago
Gurugram, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Big Data Engineer
1 month ago
gurugram, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Big Data Engineer
3 weeks ago
Gurugram, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Publicis Sapient
1 month ago
Gurugram, India Publicis Sapient Full timeJob Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...
-
Gurgaon/Gurugram, India Paisabazaar.com Full timeJob Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...
-
Paisabazaar - Data Engineer - Big Data Technologies
2 months ago
Gurgaon/Gurugram, India Paisabazaar.com Full timeJob Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...
-
Big Data Developer
4 weeks ago
Gurugram, India Shya Workforce Solutions Full timeCollaborate with enterprise architects, data architects, developers & engineers, data scientists, andinformation designers to lead the identification and definition of required data structures, formats,pipelines, metadata, and workload orchestration capabilitiesExperience in service architecture, development, and high performance and scalability.Experience...
-
Big Data Developer
4 weeks ago
Gurugram, India Shya Workforce Solutions Full timeCollaborate with enterprise architects, data architects, developers & engineers, data scientists, andinformation designers to lead the identification and definition of required data structures, formats,pipelines, metadata, and workload orchestration capabilitiesExperience in service architecture, development, and high performance and scalability.Experience...
-
Big Data Developer
4 weeks ago
gurugram, India Shya Workforce Solutions Full timeCollaborate with enterprise architects, data architects, developers & engineers, data scientists, and information designers to lead the identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities Experience in service architecture, development, and high performance and scalability....
-
Big Data Developer
2 months ago
Gurugram, India Rocket Consulting Full timeBig Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...