Current jobs related to GCP Data Lead - bangalore - Cygnus Professionals Inc.

  • GCP Data Engineer

    2 months ago

    bangalore, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • GCP Data Engineer

    2 months ago

    bangalore, India Tech Mahindra Full time

    Responsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...

  • Gcp data engineer

    2 months ago

    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore / Pune/ Chennai / Mumbai Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and...

  • Gcp data engineer

    3 weeks ago

    Bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: Big Query Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query. Analyze query performance and implement...

  • Gcp site lead

    2 weeks ago

    Bangalore, India Infosys Full time

    Position - GCP Site Lead LOP - Bangalore EXP range - 16+ About this job As the GCP Site Lead, you will be responsible for overseeing the day-to-day operations of our Google Cloud Platform (GCP) site from offshore. Your role involves driving business KPIs, managing escalations, and ensuring smooth operations. You’ll collaborate closely with...

  • GCP Data Engineer

    2 months ago

    Bangalore Metropolitan Area, India Tech Mahindra Full time

    Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using...

  • GCP Site Lead

    1 month ago

    Bangalore, India Infosys Full time

    Position - GCP Site Lead LOP - Bangalore EXP range - 16+ About this job As the GCP Site Lead, you will be responsible for overseeing the day-to-day operations of our Google Cloud Platform (GCP) site from offshore. Your role involves driving business KPIs, managing escalations, and ensuring smooth operations. You’ll collaborate closely with...

  • Cloud Data Architect for GCP

    1 month ago

    Bangalore/Chennai, India MNR Solutions Private Limited Full time

    Job Summary: We are seeking an experienced Cloud Data Architect to join our team at MNR Solutions Private Limited. As a Cloud Data Architect, you will be responsible for designing and implementing scalable data models and architecture on Google Cloud Platform (GCP).About the Role: The ideal candidate will have 8-10 years of experience in data modeling and...

  • Gcp data quality observability engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP Dev Ops Observability Engineer Overall Experience: 10+ years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), Dev Ops, Terraform, Python Roles and Responsibilities Lead the overall technical strategy for Cloud Observability...

  • Data engineer

    2 months ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    2 months ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Deloitte | GCP Data Engineer

    13 hours ago

    bangalore, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: BigQuery Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery. Analyze query performance and implement optimization...

  • Gcp data quality observability engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP Dev Ops Observability Engineer Overall Experience:8 + years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), Dev Ops, Terraform, Python We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join...

  • Data Engineer

    2 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETL Job Location: Bangalore Job Type: Permanent Key Responsibilities: Data Engineering on Google Cloud Platform (GCP): Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub. Implement and optimize ETL processes to ensure efficient data...

  • Apptad Inc. | GCP Data Engineer | bangalore

    4 weeks ago

    bangalore, India Apptad Inc. Full time

    Job Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation and...

  • Data Engineer

    3 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    3 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • GCP Data Quality Observability Engineer

    2 weeks ago

    Bangalore, India Tredence Inc. Full time

    Role - GCP DevOps Observability Engineer Overall Experience:8 + years Relevant: 3+ years Hybrid role from Bangalore, Chennai, Pune, Gurgaon, Kolkata Required Skills - Cloud(GCP) Observability(logs, metrics, and traces), DevOps, Terraform, Python We are seeking a highly skilled Data Observability Engineer with 6+ years of experience to join...

GCP Data Lead

2 months ago

bangalore, India Cygnus Professionals Inc. Full time

Role: Google Cloud Platform (GCP) Data Lead
Location: Bangalore, India (Day 1 Onsite)
Job Type: Contract

Job Description:

Strong GCP experience
Prior experience in building pipelines using dataflow, data fusion, data proc, etc
Very strong python coding skill
Experience in optimising GCP resources for cost and performance
Experience in containerisation of applications
CI/CD using GIThub actions
Exposure to DataPlex, Data Catalog, and metadata management
GCP IAM and role management
Design and implement end-to-end data architectures leveraging GCP services (e.g., Big Query, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer ) for large-scale data ingestion and processing.
Build and optimize large-scale data pipelines using Apache Spark on GCP (via Dataproc or other Spark services). Ensure high performance and scalability in Spark-based data processing workloads.
Develop and manage scalable data ingestion pipelines for structured and unstructured data using tools like Cloud Dataflow , Cloud Pub/Sub , and Apache Spark .
Provide guidance for designing secure, scalable, and efficient data solutions on the Google Cloud Platform , integrating with on-premise/cloud systems like SAP S/4HANA .
Implement both real-time streaming and batch processing pipelines using Apache Spark , Dataflow , and other GCP services to meet business requirements.
Implement data governance, access controls, and security best practices to ensure the integrity, confidentiality, and compliance of data across systems.
Collaborate with business stakeholders, data scientists, and engineering teams to define data requirements, ensuring the architecture aligns with business goals.
Optimize Apache Spark jobs for performance, scalability, and cost-efficiency, ensuring that the architecture can handle growing data volumes.
Provide technical leadership to the data engineering team, mentoring junior engineers in data architecture, Apache Spark development, and GCP best practices.

Technical Expertise:

Expert-level programming proficiency in Python, Java, and Scala.
Extensive hands-on experience with big data technologies, including Spark, Hadoop, Hive, Yarn, MapReduce, Pig, Kafka, and PySpark.
Proficient in Google Cloud Platform services, such as BigQuery , Dataflow , Cloud Storage , Dataproc , and Cloud Composer Google Pub/Sub, and Google Cloud Functions.Expertise in Apache Spark for both batch and real-time processing, as well as proficiency in Apache Beam , Hadoop , or other big data frameworks. Experienced in using Cloud SQL, BigQuery, and Looker Studio (Google Data Studio) for cloud-based data solutions.
Skilled in orchestration and deployment tools like Cloud Composer, Airflow, and Jenkins for continuous integration and deployment (CI/CD).
Expertise in designing and developing integration solutions involving Hadoop/HDFS, real-time systems, data warehouses, and analytics solutions.
Experience with DevOps practices, including version control ( Git ), CI/CD pipelines, and infrastructure-as-code (e.g., Terraform , Cloud Deployment Manager ). Strong background in working with relational databases, NoSQL databases, and in-memory databases.
Experience managing large datasets within Data Lake and Data Fabric architectures.
Strong knowledge of security best practices, IAM, encryption mechanisms, and compliance frameworks (GDPR, HIPAA) within GCP environments.
Experience in implementing data governance, data lineage, and data quality frameworks.
In-depth knowledge of web technologies, application programming languages, OLTP/OLAP technologies, data strategy disciplines, relational databases, data warehouse development, and big data solutions.
Led end-to-end processes for the design, development, deployment, and maintenance of data engineering projects.
Excellent debugging and problem-solving skills.
Retail and e-commerce domain knowledge is a plus.
Positive attitude with strong analytical skills and the ability to guide teams effectively.

Preferred Qualifications:

GCP Certifications : Such as Professional Data Engineer / Apache Spark and Python certifications.
Experience with Data visualization tools like Tableau, Power BI etc.

Nice to have (but not mandatory):

Experience in integration with S4 Hana
Experience with integration with Salesforce