Big Data- Gcp

3 months ago


Gurugram Haryana, India Ikrux Full time

Hadoop BigData Pyspark SQL
Hands on experience is mandatory for the GCP Python Java Spark SQL and Bigdata
Key Responsibilities
- You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers Software Engineers who join our Loyalty Technology team will be assigned to one of several exciting teams that are developing a new nimble and modern loyalty platform which will support the key element of connecting with our customers where they are and how they choose to interact with American Express
- Be part of an enthusiastic high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand
- The position will also play a critical role partnering with other development teams testing and quality and production support to meet implementation dates and allow smooth transition throughout the development life cycle
Must Have Qualifications
- Deep understanding of Hadoop and Spark Architecture and its working principle
- Deep understanding of Data warehousing concepts
- Ability to design and develop optimized Data pipelines for batch and real time data processing
- 5 years of software development experience
- 5 years’ experience on Python or Java Hands on experience on writing and understanding complex SQL Hive PySpark data frames optimizing joins while processing huge amount of data
- 3 years of hands on experience of working with Map Reduce Hive Spark core SQL and PySpark
- Hands on Experience on Google Cloud Platform BigQuery DataProc Cloud Composer
- 3 years of experience in UNIX shell scripting
- Ability to effectively communicate with internal and external business partners
Additional Good to have requirements
- Understanding of Distributed eco system
- Experience in designing and building solutions using Kafka streams or queues
- Experience with NoSQL i e HBase Cassandra Couchbase or MongoDB
- Experience with Data Visualization tools like Tableau SiSense Looker
- Knowledge of Financial reporting ecosystem will be a plus
- Experience in leading teams of engineers and scrum teams

**Primary Skills**:
Big Data-Hadoop-Spark-Python/Scala

**No of Position**: 1
**Experience Range**: 8-12 years
**Budget**: 25 LPA


  • Big Data Engineer

    2 months ago


    Gurugram, India Chiselon Technologies Pvt Ltd Full time

    # Hiring Alert #We are looking for Immediate Joiners Skills:Big Data with GCP GCP; Hive; PySpark; Python GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization "Join us and become an integral part of our success story. Apply today and let's achieve great things...

  • Gcp Data Architect

    6 months ago


    Gurugram, Haryana, India Virtusa Full time

    Python Knowledge with Py spark, Pandas and Python Objects Knowledge of Google Cloud Platform GCP Certified Prof. Data Engineer. Google Cloud GCP cloud composer, cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Py spark DWH Data warehousing concepts & dimension modeling GIT Teams Leading Experience Apache...


  • Gurugram, Haryana, India Cognizant Full time

    **Title - GCP Architect** **Location - Chennai /Blr/GGN/HYD/Pune/Kolkata** Level - M/SM - 8 to 16 years RR-58704631 JD - **GCP Architect who can design data services (any location)** GCP Data Engineer with hands on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization. LI-RK6


  • Gurugram, Haryana, India Clairvoyant Full time

    **About Clairvoyant** Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...


  • gurugram, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...


  • Gurugram, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...


  • gurugram, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...


  • Gurugram, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...


  • Gurugram, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...


  • Gurugram, India SMARTWORK IT SERVICES Full time

    Role : GCP Architect Big Data Engineering. Location : Bangalore, Chennai, Kolkata, Gurugram, Pune. Experience : 13-17 years. Mandatory Skills : GCP, GCS, BigQuery, SQL, Data Flow, DataProc with PySpark, Pub/Sub, Airflow, Python, Spark. Job Description : We are looking for a Big Data Engineer to work on collecting, storing, processing, and analyzing large...


  • Bangalore/Kolkata/Chennai/Pune/Gurgaon/Gurugram, India Tredence Analytics Solutions Private Limited Full time

    Job Title: Senior GCP Data EngineerAbout the Role:We are seeking an experienced Senior GCP Data Engineer to join our team at Tredence Analytics Solutions Private Limited. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines on Google Cloud Platform (GCP).Key...

  • Big Data Engineer

    18 hours ago


    Gurugram, India SMARTWORK IT SERVICES Full time

    Job Description : We are looking for a Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets. The primary focus will be on choosing optimal solutions for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating these solutions with the architecture used across our...

  • Big Data Developer

    2 months ago


    Gurugram, India Spectral Consultants – Search & Recruitment firm Full time

    SALARY : Description :We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or ScalaKey Responsibilities : - Develop and maintain...

  • Opening for Gcp Expert

    6 months ago


    Gurugram, Haryana, India Cognizant Full time

    Skill - GCP, **BigQuery, Python, DataProc, Dataflow** **Notice period - Immediate** **Location - Gurgaon** **Level of hire - SA/M- 5 to 12 years** - Should be an experienced GCP expert with strong and hands-on knowledge in **BigQuery, Python, DataProc, Dataflow** - Should be able to guide client on data ingestion, data storage, data extraction &...


  • Pune/Gurgaon/Gurugram, India Talent Toppers LLP Full time

    Talent Toppers LLP Seeks a Big Data Solutions ArchitectAbout the Role:We are seeking an experienced Big Data Solutions Architect to join our team at Talent Toppers LLP. As a key member of our data solutions team, you will be responsible for designing and implementing scalable big data architectures using various technologies such as Hadoop, Spark, and cloud...

  • Big Data Developer

    3 months ago


    Gurugram, India Spectral Consultants Full time

    Undertake completeownership in accomplishing activities and assigned responsibilitiesacross all phases of project lifecycle to solve business problemsacross one or more client engagements; Apply appropriatedevelopment methodologies (e.g.: agile waterfall) and bestpractices (e.g.: middevelopment client reviews embedded QAprocedures unit testing) to ensure...

  • Engineer III- Big Data

    5 months ago


    Gurugram, India AMEX Full time

    You Lead the Way. Weve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, youll learn and grow as we help you create a...

  • Big Data Administrator

    2 months ago


    Gurugram, India Intuitive Apps Full time

    As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :Hadoop Installation and Deployment :- Install Hadoop in Linux environments.- Deploy and maintain Hadoop clusters.- Monitor cluster health to ensure continuous uptime.- Analyze storage...

  • Big Data Developer

    2 weeks ago


    Gurgaon/Gurugram, India Spectral Consultants – Search & Recruitment firm Full time

    SALARY : Description : We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or Scala Key Responsibilities : - Develop and maintain...

  • Java GCP Engineer

    1 week ago


    Gurugram, India Impetus Full time

    Person should have 7-9 years of work exp.Should be good in solution design, architecture principals. Hands on in UML designs. Strong hands-on Core Java or any other programming language. Should have knowledge on distributed computing, big data & Microservice architectures.Knowledge on RDBMS (e.g mysql, postgres), NoSQL (redis, hbase or Cassandra)Knowledge on...