Senior Consultant – Cloud Data Engineer – GCP

3 weeks ago

Gurgaon, Haryana, India Sirius AI Full time

Key Responsibilities:

  • Design, develop, and manage scalable, secure, and efficient data pipelines on Google Cloud Platform (GCP) to process and transform large datasets from multiple sources.
  • Implement and optimize GCP data services such as BigQuery, Cloud Storage, Cloud SQL, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.
  • Architect and maintain ETL/ELT processes to ensure efficient data ingestion, transformation, and storage using Cloud Data Fusion, Dataflow (Apache Beam), or Composer (Airflow).
  • Architect and implement data models on GCP to support efficient data storage and retrieval in BigQuery, Cloud Spanner, or Firestore.
  • Collaborate with data architects to design and implement data lakes, data warehouses, and data marts on GCP.
  • Build and maintain data integration workflows using tools like Cloud Composer (Apache Airflow), Cloud Functions, or Dataflow.
  • Utilize GCP DevOps tools for source control, build automation, release management, and infrastructure as code (IaC) using Terraform or Deployment Manager.
  • Implement CI/CD pipelines within Google Cloud Build to automate the build, test, and deployment of data pipelines and infrastructure changes, ensuring rapid and reliable delivery of data solutions.
  • Utilize big data technologies such as Dataproc (Apache Spark, Hadoop, etc.) to handle large volumes of data and perform complex analytics tasks.
  • Implement real-time data processing solutions using streaming technologies like Pub/Sub and Dataflow (Apache Beam) to enable timely insights and actions.
  • Implement data governance policies and security controls within GCP environments to protect sensitive data and ensure compliance with regulatory requirements such as GDPR, HIPAA, or PCI DSS.
  • Optimize data pipelines and processing workflows for performance, scalability, and cost-effectiveness on GCP, leveraging BigQuery optimizations, Autoscaling, and cost management techniques.
  • Monitor, troubleshoot, and optimize the performance of data pipelines and cloud-based systems to ensure high availability, low latency, and scalability.
  • Work closely with cross-functional teams to understand business requirements and translate them into scalable GCP data solutions.
  • Ensure data security and compliance with industry best practices, including IAM roles, VPC configurations, encryption, and access controls.
  • Conduct regular code reviews, provide feedback, and ensure adherence to best practices and standards.
  • Stay up to date with the latest GCP services and cloud technologies to drive innovation within the team.

Job Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 4-6 years of experience as a Cloud Data Engineer or similar role, with a strong focus on GCP cloud services.
  • Proficiency in designing and building scalable data architectures using GCP data services such as BigQuery, Cloud Storage, Dataflow, Cloud SQL, and Dataproc.
  • Strong experience with ETL/ELT frameworks and tools like Cloud Composer (Apache Airflow), Cloud Data Fusion, or Dataflow (Apache Beam).
  • Expertise in SQL, Python, or other programming languages used in data engineering.
  • Hands-on experience with data lakes, data warehouses, and data pipeline orchestration on GCP.
  • Familiarity with CI/CD pipelines and infrastructure-as-code (IaC) tools like Terraform, Deployment Manager, or Cloud Build.
  • Understanding data governance, security, and compliance standards, including encryption, IAM policies, and role-based access control (RBAC).
  • Experience in data modeling, data normalization, and performance optimization for cloud-based data solutions.
  • GCP Certifications such as Google Cloud Professional Data Engineer or Google Cloud Professional Cloud Architect.
  • Experience with Apache Spark or Databricks on GCP.
  • Knowledge of machine learning workflows and working with data science teams is a plus.
  • Familiarity with DevOps practices and tools such as Docker and Kubernetes.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • Strong problem-solving and troubleshooting skills, with a proactive approach to identifying and resolving issues.
  • Ability to adapt to a fast-paced, agile environment and manage multiple priorities effectively.

About SiriusAI

Sirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies.

We are an innovation driven AI and data driven consulting services firm with a high focus on delivering business outcomes for our clients. The Sirius AI team is a mix of talent from a diverse background of Consulting, Industry and Product companies which bring together their Data, Platform, Ecosystem, Technology, Project management and AI skills to develop new solutions and deliver client engagements.

  • GCP Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Zone IT Solutions Full time

    We are seeking a talented GCP Data Engineer based in Gurugram. You will be responsible for designing, building, and maintaining robust data pipelines and data solutions on the Google Cloud Platform.RequirementsStrong experience as a GCP Data Engineer, with proven experience in designing and implementing data pipelines and solutions on the Google Cloud...

  • Azure and GCP Cloud Solutions Manager

    15 hours ago

    Gurgaon, Haryana, India PRONTO CONSULTING SERVICES Full time

    About Pronto Consulting ServicesJob Overview:We are looking for a Senior Cloud Engineer to manage our cloud infrastructure and solutions across Azure and Google Cloud Platform (GCP). This role involves leading a team of cloud engineers in designing, implementing, and managing cloud solutions.The ideal candidate will have strong hands-on experience in cloud...

  • Gcp Data Engineer

    3 days ago

    Gurgaon, Haryana, India Infosys Limited Full time

    Job Description- Experienced Data Engineer with hands on experience on GCP offerings experienced in BigQuery/BigTable/Pyspark- Worked on prior data engineering projects leveraging GCP product offerings- Strong SQL background- Prior Amex experience is a big Plus

  • P&A-GCP | Consultant

    3 weeks ago

    Gurgaon, Haryana, India Evalueserve Full time

    Elevate Your Impact Through Innovation and LearningEvalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 500 companies. With presence in more than 45 countries across five continents, we excel in leveraging state of-the-art technology, artificial intelligence, and...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Admin Looks Full time

    Urgently looking for the Senior Data Engineer for onsite at the location of GurgaonJob description:We are seeking a passionate, hands-on and experienced Senior Data Engineer to join our team. You will play a key role in implementing large scale Data platforms with our customers. The candidate will collaborate with internal and customer teams on multiple...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Admin Looks Full time

    Job DescriptionUrgently looking for the Senior Data Engineer for onsite at the location of GurgaonJob description:We are seeking a passionate, hands-on and experienced Senior Data Engineer to join our team. You will play a key role in implementing large scale Data platforms with our customers. The candidate will collaborate with internal and customer teams...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Orange Business Full time

    Job Overview We are seeking a creative and motivated Sr. Cloud Data Engineer to work in our growing India Development Center. In this role, you will be instrumental in architecting, building, and managing our data infrastructure on Google Cloud Platform (GCP) and Big Data Setup on premises. Your Role As a Big Data Engineer in the Data & Referential domain,...

  • Senior Cloud Engineer

    11 hours ago

    Gurgaon, Haryana, India PRONTO CONSULTING SERVICES Full time

    About Pronto Consulting ServicesJob Description:We are seeking a Cloud Solutions Manager to lead a team of cloud engineers in designing, implementing, and managing cloud solutions on Azure and Google Cloud Platform (GCP).This role requires strong hands-on experience in cloud architecture, migration, and security services, as well as excellent communication...

  • Senior Data Engineer

    4 days ago

    Gurgaon, Haryana, India Orange Business Full time

    Overview We are looking for a creative, talented, and motivated Sr. Cloud Data Engineer to work in our growing India Development Center. In this role, you will be instrumental in architecting, building, and managing our data infra on Google Cloud Platform GCP and Big Data Setup on prem. The ideal candidate will be well versed in data engineering and cloud...

  • Senior Data Engineer

    2 days ago

    Gurgaon, Haryana, India Orange Business Full time

    Sr. Cloud Data Engineer We are seeking a highly skilled and motivated Sr. Cloud Data Engineer to work in our growing India Development Center. Your Role Support the definition of ingestion pipelines for Business Units and subsidiaries. Industrialize data movement between sources and data lakes. Develop data preparation pipelines for further use cases. You...

  • Senior Cloud Client Partner

    3 weeks ago

    Gurgaon, Haryana, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Technical Consultant, Data

    2 weeks ago

    Gurgaon, Haryana, India AHEAD Full time

    AHEAD is looking for a Senior Data Engineer to work closely with our dynamic project teams (both on-site and remotely). This Senior Data Engineer will be responsible for strategic planning and hands-on engineering of Big Data and cloud environments that support our clients' advanced analytics, data science, and other data platform initiatives. This...

  • Data Engineer-gcp-migration-7 To 10 Years-gurgaon

    3 weeks ago

    Gurgaon, Haryana, India Crescendo Global Full time

    Data Engineer - GCP Migration ArchitectLocation GurgaonWe are looking data professional who is expertise in data engineering and programming to build systems that collect manager and convert raw data into usable information for business analyst Your future employer Join a leading global AI and analytics consulting firm that s transforming industries...

  • Cloud Data Engineer Specialist

    4 days ago

    Gurgaon, Haryana, India ANSR Summit Consulting Full time

    **Overview**ANSR Summit Consulting is a leading consulting firm that specializes in data-driven solutions. We're looking for an experienced Cloud Data Engineer to join our team and help us design and implement modern data architectures.**Job Summary:**We're seeking a skilled Cloud Data Engineer to lead the development of our data platform. The ideal...

  • Senior Consultant

    3 weeks ago

    Gurgaon, Haryana, India Evalueserve Full time

    Elevate Your Impact Through Innovation and LearningEvalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 500 companies. With presence in more than 45 countries across five continents, we excel in leveraging state of-the-art technology, artificial intelligence, and...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Invokhr Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience: 3-8 years Salary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position,...

  • Google Cloud Platform Engineer

    3 weeks ago

    Gurgaon, Haryana, India Populace World Solution Full time

    Job Description :Key Responsibilities :- Design and implement cloud-native solutions on the GCP platform, including infrastructure provisioning, application deployment, and data processing.- Develop and maintain Infrastructure-as-Code (IaC) using Terraform.- Automate and streamline cloud operations using scripting languages such as Python, Shell, and Go.-...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Think Future Tech Full time

    About the Job :We are looking for a talented and driven GCP Data Engineer with strong SQL skills to join our growing team. You will be instrumental in building and maintaining our data infrastructure on Google Cloud Platform (GCP), enabling data-driven insights and informed business decisions. This role offers the opportunity to work on diverse global...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Think Future Tech Full time

    About the Job : We are looking for a talented and driven GCP Data Engineer with strong SQL skills to join our growing team. You will be instrumental in building and maintaining our data infrastructure on Google Cloud Platform (GCP), enabling data-driven insights and informed business decisions. This role offers the opportunity to work on diverse global...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Valiance Solutions Full time

    About the Role: We are seeking a highly skilled AWS Data Engineer with expertise in PySpark, Python, SQL, ETL, Amazon QuickSight, and Redshift . The ideal candidate should have experience working in a fast-paced environment , demonstrate a high degree of ownership , and be comfortable working independently with minimal oversight . A strong ability to learn...