Big Data- Gcp

17 hours ago

Gurugram Haryana, India Ikrux Full time

Hadoop BigData Pyspark SQL
Hands on experience is mandatory for the GCP Python Java Spark SQL and Bigdata
Key Responsibilities
- You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers Software Engineers who join our Loyalty Technology team will be assigned to one of several exciting teams that are developing a new nimble and modern loyalty platform which will support the key element of connecting with our customers where they are and how they choose to interact with American Express
- Be part of an enthusiastic high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand
- The position will also play a critical role partnering with other development teams testing and quality and production support to meet implementation dates and allow smooth transition throughout the development life cycle
Must Have Qualifications
- Deep understanding of Hadoop and Spark Architecture and its working principle
- Deep understanding of Data warehousing concepts
- Ability to design and develop optimized Data pipelines for batch and real time data processing
- 5 years of software development experience
- 5 years’ experience on Python or Java Hands on experience on writing and understanding complex SQL Hive PySpark data frames optimizing joins while processing huge amount of data
- 3 years of hands on experience of working with Map Reduce Hive Spark core SQL and PySpark
- Hands on Experience on Google Cloud Platform BigQuery DataProc Cloud Composer
- 3 years of experience in UNIX shell scripting
- Ability to effectively communicate with internal and external business partners
Additional Good to have requirements
- Understanding of Distributed eco system
- Experience in designing and building solutions using Kafka streams or queues
- Experience with NoSQL i e HBase Cassandra Couchbase or MongoDB
- Experience with Data Visualization tools like Tableau SiSense Looker
- Knowledge of Financial reporting ecosystem will be a plus
- Experience in leading teams of engineers and scrum teams

**Primary Skills**:
Big Data-Hadoop-Spark-Python/Scala

**No of Position**: 1
**Experience Range**: 8-12 years
**Budget**: 25 LPA

  • Gcp Data Architect

    4 days ago

    Gurugram, Haryana, India Virtusa Full time

    Python Knowledge with Py spark, Pandas and Python Objects Knowledge of Google Cloud Platform GCP Certified Prof. Data Engineer. Google Cloud GCP cloud composer, cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Py spark DWH Data warehousing concepts & dimension modeling GIT Teams Leading Experience Apache...

  • GCP Data Engineer

    6 days ago

    Bengaluru, Gurugram, India IntraEdge Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Bachelors/Masters degree in Computer Science, Management of Information System or equivalent.2+ years of experience in GCP - BigQuery, Dataproc, Dataflow.4 or more years of relevant software engineering experience (Big Data: Python, SQL, Hadoop, Hive, Spark) in a data-focused role.Strong experience in Big Data, Python, SQL, Spark and cloud exp...

  • Data Engineer

    2 days ago

    Gurugram, India Source4hire Full time

    Below is the Job requirement :- Provides technical leadership in the Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc.) and contributes to open-source Big Data technologies. Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions,...

  • Gcp Platform Migration

    2 weeks ago

    Gurugram, Haryana, India Clairvoyant Full time

    **About Clairvoyant** Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • ▷ Immediate Start! GCP Data Engineer

    3 weeks ago

    Gurugram, Gurugram, India Impetus Full time

    Job Description Qualification Need to hire GCP enabled Module Leads and Leads with proficiency on data engineering technologies and languages. These folks should be able to to drive and lead migration from On Prem to GCP for Amex use cases Role 7-10 years of experience in the role of implementation of high end software products. Provides technical leadership...

  • Big Data Developer

    2 weeks ago

    Gurugram, India Intraedge Technologies Ltd. Full time

    Job Title : Big Data Developer (Java/Python)Location : Chennai, Bangalore, GurugramExperience Required : 5+ years (5 to 15 yrs)Joining : Immediate or Early Joiners PreferredEmployment Type : Full-timeJob Summary : We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal...

  • Gcp Data Engineer

    2 weeks ago

    Delhi, Gurugram, NCR, Noida, India Moptra Infotech Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineer (GCP)Company: Moptra Infotech Pvt. Ltd.Location: Noida, Sector 63Website: Work Schedule: 5 days working (Saturday & Sunday fixed off)About Moptra InfotechMoptra Infotech Pvt. Ltd. is a fast-growing IT services and consulting company headquartered in Noida, India. We specialize in delivering data engineering, cloud solutions, business...

  • Big Data Hadoop Administrator

    4 days ago

    Gurugram, Haryana, India Valiance Solutions Full time

    Gurugram, Haryana, India - Job posted on - Location **Gurgaon** - Functional **Adminstration** - Department **Data Engineering** - Designation **Big Data Admin** - Entity **Valiance Analytics** - Business Unit **N/A** - Number of Position(s) **1** - Openings Valid Till **Company Description**: - Valiance is a global AI & Data analytics firm helping...

  • Big Data Manual QA

    18 hours ago

    Gurugram, Haryana, India Harman International Full time

    Location: - Gurgaon - Haryana, India - Additional Location: - Bangalore - Karnataka, India - Manyata Park Outer Ring Road, IN_Chennai_RMZ One Paramount_HII, IN_Coimbatore_Echo Point Plaza_HCS, IN_Hyderabad_AWFIS Space Solutions_HCS, Pune - Maharashtra, India - Rajiv Ganhi Infotec Park - Job Family: - Engineering - Worker Type Reference: - Regular -...

  • Big Data Manual QA

    18 hours ago

    Gurugram, Haryana, India Harman International Full time

    Location: - Gurgaon - Haryana, India - Additional Location: - Bangalore - Karnataka, India - Manyata Park Outer Ring Road, IN_Chennai_RMZ One Paramount_HII, IN_Coimbatore_Echo Point Plaza_HCS, IN_Hyderabad_AWFIS Space Solutions_HCS, Pune - Maharashtra, India - Rajiv Ganhi Infotec Park - Job Family: - Engineering - Worker Type Reference: - Regular -...