![Ikrux](https://media.trabajo.org/img/noimg.jpg)
Big Data- Gcp
3 months ago
Hadoop BigData Pyspark SQL
Hands on experience is mandatory for the GCP Python Java Spark SQL and Bigdata
Key Responsibilities
- You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers Software Engineers who join our Loyalty Technology team will be assigned to one of several exciting teams that are developing a new nimble and modern loyalty platform which will support the key element of connecting with our customers where they are and how they choose to interact with American Express
- Be part of an enthusiastic high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand
- The position will also play a critical role partnering with other development teams testing and quality and production support to meet implementation dates and allow smooth transition throughout the development life cycle
Must Have Qualifications
- Deep understanding of Hadoop and Spark Architecture and its working principle
- Deep understanding of Data warehousing concepts
- Ability to design and develop optimized Data pipelines for batch and real time data processing
- 5 years of software development experience
- 5 years’ experience on Python or Java Hands on experience on writing and understanding complex SQL Hive PySpark data frames optimizing joins while processing huge amount of data
- 3 years of hands on experience of working with Map Reduce Hive Spark core SQL and PySpark
- Hands on Experience on Google Cloud Platform BigQuery DataProc Cloud Composer
- 3 years of experience in UNIX shell scripting
- Ability to effectively communicate with internal and external business partners
Additional Good to have requirements
- Understanding of Distributed eco system
- Experience in designing and building solutions using Kafka streams or queues
- Experience with NoSQL i e HBase Cassandra Couchbase or MongoDB
- Experience with Data Visualization tools like Tableau SiSense Looker
- Knowledge of Financial reporting ecosystem will be a plus
- Experience in leading teams of engineers and scrum teams
**Primary Skills**:
Big Data-Hadoop-Spark-Python/Scala
**No of Position**: 1
**Experience Range**: 8-12 years
**Budget**: 25 LPA
-
Big Data Engineer
2 months ago
Gurugram, India Chiselon Technologies Pvt Ltd Full time# Hiring Alert #We are looking for Immediate Joiners Skills:Big Data with GCP GCP; Hive; PySpark; Python GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization "Join us and become an integral part of our success story. Apply today and let's achieve great things...
-
Gcp Data Architect
6 months ago
Gurugram, Haryana, India Virtusa Full timePython Knowledge with Py spark, Pandas and Python Objects Knowledge of Google Cloud Platform GCP Certified Prof. Data Engineer. Google Cloud GCP cloud composer, cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Py spark DWH Data warehousing concepts & dimension modeling GIT Teams Leading Experience Apache...
-
Opening for Gcp Architect
6 months ago
Gurugram, Haryana, India Cognizant Full time**Title - GCP Architect** **Location - Chennai /Blr/GGN/HYD/Pune/Kolkata** Level - M/SM - 8 to 16 years RR-58704631 JD - **GCP Architect who can design data services (any location)** GCP Data Engineer with hands on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization. LI-RK6
-
Gcp Solutions Architect
6 months ago
Gurugram, Haryana, India Clairvoyant Full time**About Clairvoyant** Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...
-
Senior Associate Data Engineering L2 DE
2 months ago
gurugram, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...
-
Senior Associate Data Engineering L2 DE
3 months ago
Gurugram, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...
-
Senior Associate Data Engineering L2 DE
3 months ago
gurugram, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...
-
Senior Associate Data Engineering L2 DE
3 months ago
Gurugram, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...
-
Senior Associate Data Engineering L2 DE
3 months ago
Gurugram, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...
-
Google Cloud Platform Architect
1 month ago
Gurugram, India SMARTWORK IT SERVICES Full timeRole : GCP Architect Big Data Engineering. Location : Bangalore, Chennai, Kolkata, Gurugram, Pune. Experience : 13-17 years. Mandatory Skills : GCP, GCS, BigQuery, SQL, Data Flow, DataProc with PySpark, Pub/Sub, Airflow, Python, Spark. Job Description : We are looking for a Big Data Engineer to work on collecting, storing, processing, and analyzing large...
-
Senior GCP Data Engineer
2 months ago
Bangalore/Kolkata/Chennai/Pune/Gurgaon/Gurugram, India Tredence Analytics Solutions Private Limited Full timeJob Title: Senior GCP Data EngineerAbout the Role:We are seeking an experienced Senior GCP Data Engineer to join our team at Tredence Analytics Solutions Private Limited. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines on Google Cloud Platform (GCP).Key...
-
Big Data Engineer
18 hours ago
Gurugram, India SMARTWORK IT SERVICES Full timeJob Description : We are looking for a Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets. The primary focus will be on choosing optimal solutions for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating these solutions with the architecture used across our...
-
Big Data Developer
2 months ago
Gurugram, India Spectral Consultants – Search & Recruitment firm Full timeSALARY : Description :We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or ScalaKey Responsibilities : - Develop and maintain...
-
Opening for Gcp Expert
6 months ago
Gurugram, Haryana, India Cognizant Full timeSkill - GCP, **BigQuery, Python, DataProc, Dataflow** **Notice period - Immediate** **Location - Gurgaon** **Level of hire - SA/M- 5 to 12 years** - Should be an experienced GCP expert with strong and hands-on knowledge in **BigQuery, Python, DataProc, Dataflow** - Should be able to guide client on data ingestion, data storage, data extraction &...
-
Big Data Solutions Architect
2 weeks ago
Pune/Gurgaon/Gurugram, India Talent Toppers LLP Full timeTalent Toppers LLP Seeks a Big Data Solutions ArchitectAbout the Role:We are seeking an experienced Big Data Solutions Architect to join our team at Talent Toppers LLP. As a key member of our data solutions team, you will be responsible for designing and implementing scalable big data architectures using various technologies such as Hadoop, Spark, and cloud...
-
Big Data Developer
3 months ago
Gurugram, India Spectral Consultants Full timeUndertake completeownership in accomplishing activities and assigned responsibilitiesacross all phases of project lifecycle to solve business problemsacross one or more client engagements; Apply appropriatedevelopment methodologies (e.g.: agile waterfall) and bestpractices (e.g.: middevelopment client reviews embedded QAprocedures unit testing) to ensure...
-
Engineer III- Big Data
5 months ago
Gurugram, India AMEX Full timeYou Lead the Way. Weve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, youll learn and grow as we help you create a...
-
Big Data Administrator
2 months ago
Gurugram, India Intuitive Apps Full timeAs a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :Hadoop Installation and Deployment :- Install Hadoop in Linux environments.- Deploy and maintain Hadoop clusters.- Monitor cluster health to ensure continuous uptime.- Analyze storage...
-
Big Data Developer
2 weeks ago
Gurgaon/Gurugram, India Spectral Consultants – Search & Recruitment firm Full timeSALARY : Description : We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or Scala Key Responsibilities : - Develop and maintain...
-
Java GCP Engineer
1 week ago
Gurugram, India Impetus Full timePerson should have 7-9 years of work exp.Should be good in solution design, architecture principals. Hands on in UML designs. Strong hands-on Core Java or any other programming language. Should have knowledge on distributed computing, big data & Microservice architectures.Knowledge on RDBMS (e.g mysql, postgres), NoSQL (redis, hbase or Cassandra)Knowledge on...