
Big Data- Gcp
1 week ago
Hadoop BigData Pyspark SQL
Hands on experience is mandatory for the GCP Python Java Spark SQL and Bigdata
Key Responsibilities
- You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers Software Engineers who join our Loyalty Technology team will be assigned to one of several exciting teams that are developing a new nimble and modern loyalty platform which will support the key element of connecting with our customers where they are and how they choose to interact with American Express
- Be part of an enthusiastic high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand
- The position will also play a critical role partnering with other development teams testing and quality and production support to meet implementation dates and allow smooth transition throughout the development life cycle
Must Have Qualifications
- Deep understanding of Hadoop and Spark Architecture and its working principle
- Deep understanding of Data warehousing concepts
- Ability to design and develop optimized Data pipelines for batch and real time data processing
- 5 years of software development experience
- 5 years’ experience on Python or Java Hands on experience on writing and understanding complex SQL Hive PySpark data frames optimizing joins while processing huge amount of data
- 3 years of hands on experience of working with Map Reduce Hive Spark core SQL and PySpark
- Hands on Experience on Google Cloud Platform BigQuery DataProc Cloud Composer
- 3 years of experience in UNIX shell scripting
- Ability to effectively communicate with internal and external business partners
Additional Good to have requirements
- Understanding of Distributed eco system
- Experience in designing and building solutions using Kafka streams or queues
- Experience with NoSQL i e HBase Cassandra Couchbase or MongoDB
- Experience with Data Visualization tools like Tableau SiSense Looker
- Knowledge of Financial reporting ecosystem will be a plus
- Experience in leading teams of engineers and scrum teams
**Primary Skills**:
Big Data-Hadoop-Spark-Python/Scala
**No of Position**: 1
**Experience Range**: 8-12 years
**Budget**: 25 LPA
-
Gcp Data Architect
2 weeks ago
Gurugram, Haryana, India Virtusa Full timePython Knowledge with Py spark, Pandas and Python Objects Knowledge of Google Cloud Platform GCP Certified Prof. Data Engineer. Google Cloud GCP cloud composer, cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Py spark DWH Data warehousing concepts & dimension modeling GIT Teams Leading Experience Apache...
-
API Engineer with GCP
1 week ago
Bengaluru, Gurugram, India Augusta Infotech Full time ₹ 9,00,000 - ₹ 12,00,000 per yearMandatory SkillsGCP; API; ETL - Big Data / Data Warehousing; Big Data; PythonAPI Engineer - Auditboard SaaS integrations (Mandatory) with on-pem and GCP.
-
Gcp, Dag Testing
24 hours ago
Gurugram, Haryana, India Cognizant Full time**Location**: Bangalore **Grade**: SA/M **Skills**: GCP, Big Query, Hive, PySpark, DAG Testing, airflow
-
DevOps - Big Data
1 week ago
Gurugram, Haryana, India HoonarTek Full timeGurugram **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.- Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.- Using centuries of cumulative experience, research and...
-
Gcp Solutions Architect
2 weeks ago
Gurugram, Haryana, India Clairvoyant Full time**About Clairvoyant** Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...
-
Big Data Tester
1 week ago
Bengaluru, Gurugram, India Kezan Consulting Full time ₹ 1,04,000 - ₹ 1,30,878 per year**ONLY FOR IMMEDIATE JOINERS**Position: Big Data TesterExperience: 4+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerJob Summary:We are seeking an experienced Big Data Tester with a strong background in HDFS, Hive, ETL testing, and SQL. The ideal candidate will have a experience in Big Data ecosystems, ETL/SQL testing, and in the...
-
Big Data QA
1 week ago
Gurugram, Haryana, India HoonarTek Full timeGurugram, Pune **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.- Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.- Using centuries of cumulative experience, research...
-
Gcp Data Engineer
6 days ago
Delhi, Gurugram, NCR, Noida, India Moptra Infotech Full time ₹ 1,04,000 - ₹ 1,30,878 per yearData Engineer (GCP)Company: Moptra Infotech Pvt. Ltd.Location: Noida, Sector 63Website: Work Schedule: 5 days working (Saturday & Sunday fixed off)About Moptra InfotechMoptra Infotech Pvt. Ltd. is a fast-growing IT services and consulting company headquartered in Noida, India. We specialize in delivering data engineering, cloud solutions, business...
-
GCP Data Lead
4 days ago
Haryana, India 9NEXUS Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: GCP Data Lead Experience: 5 to 8 Years Location: [ Remote] Employment Type: Full-Time Job Summary: We are seeking an experienced GCP Data Lead with a strong background in data engineering and cloud architecture on Google Cloud Platform (GCP). The ideal candidate will be responsible for designing scalable data solutions, leading data teams, and...
-
Data Engineer-GCP 6+ Yrs C2H
6 days ago
Bengaluru, Chennai, Gurugram, India Bcforward Full time ₹ 1,04,000 - ₹ 1,30,878 per yearGreetings from BCforward INDIA TECHNOLOGIES PRIVATE LIMITED.Contract To Hire(C2H) RoleLocation: Delhi/Bengaluru/Gurgaon/Chennai-HybridPayroll: BCforwardWork Mode: HybridDomain: Banking & FinanceJDSkills: GCP; ETL - Big Data / Data Warehousing; SQL; Python; PySpark, AirflowExperienced data engineer with hands on experience on GCP offerings Experienced in...