Consultant – Cloud Data Engineer – GCP

4 weeks ago


Guntur, India Sirius AI Full time

Key Responsibilities:

  • Design, develop, and manage scalable, secure, and efficient data pipelines on Google Cloud Platform (GCP) to process and transform large datasets from multiple sources.
  • Implement and optimize GCP data services such as BigQuery, Cloud Storage, Cloud SQL, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.
  • Architect and maintain ETL/ELT processes to ensure efficient data ingestion, transformation, and storage using Cloud Data Fusion, Dataflow (Apache Beam), or Composer (Airflow).
  • Architect and implement data models on GCP to support efficient data storage and retrieval in BigQuery, Cloud Spanner, or Firestore.
  • Collaborate with data architects to design and implement data lakes, data warehouses, and data marts on GCP.
  • Build and maintain data integration workflows using tools like Cloud Composer (Apache Airflow), Cloud Functions, or Dataflow.
  • Utilize GCP DevOps tools for source control, build automation, release management, and infrastructure as code (IaC) using Terraform or Deployment Manager.
  • Implement CI/CD pipelines within Google Cloud Build to automate the build, test, and deployment of data pipelines and infrastructure changes, ensuring rapid and reliable delivery of data solutions.
  • Utilize big data technologies such as Dataproc (Apache Spark, Hadoop, etc.) to handle large volumes of data and perform complex analytics tasks.
  • Implement real-time data processing solutions using streaming technologies like Pub/Sub and Dataflow (Apache Beam) to enable timely insights and actions.
  • Implement data governance policies and security controls within GCP environments to protect sensitive data and ensure compliance with regulatory requirements such as GDPR, HIPAA, or PCI DSS.
  • Optimize data pipelines and processing workflows for performance, scalability, and cost-effectiveness on GCP, leveraging BigQuery optimizations, Autoscaling, and cost management techniques.
  • Monitor, troubleshoot, and optimize the performance of data pipelines and cloud-based systems to ensure high availability, low latency, and scalability.
  • Work closely with cross-functional teams to understand business requirements and translate them into scalable GCP data solutions.
  • Ensure data security and compliance with industry best practices, including IAM roles, VPC configurations, encryption, and access controls.
  • Conduct regular code reviews, provide feedback, and ensure adherence to best practices and standards.
  • Stay up to date with the latest GCP services and cloud technologies to drive innovation within the team.

Job Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 2-3 years of experience as a Cloud Data Engineer or similar role, with a strong focus on GCP cloud services.
  • Proficiency in designing and building scalable data architectures using GCP data services such as BigQuery, Cloud Storage, Dataflow, Cloud SQL, and Dataproc.
  • Strong experience with ETL/ELT frameworks and tools like Cloud Composer (Apache Airflow), Cloud Data Fusion, or Dataflow (Apache Beam).
  • Expertise in SQL, Python, or other programming languages used in data engineering.
  • Hands-on experience with data lakes, data warehouses, and data pipeline orchestration on GCP.
  • Familiarity with CI/CD pipelines and infrastructure-as-code (IaC) tools like Terraform, Deployment Manager, or Cloud Build.
  • Understanding data governance, security, and compliance standards, including encryption, IAM policies, and role-based access control (RBAC).
  • Experience in data modeling, data normalization, and performance optimization for cloud-based data solutions.
  • GCP Certifications such as Google Cloud Professional Data Engineer or Google Cloud Professional Cloud Architect.
  • Experience with Apache Spark or Databricks on GCP.
  • Knowledge of machine learning workflows and working with data science teams is a plus.
  • Familiarity with DevOps practices and tools such as Docker and Kubernetes.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • Strong problem-solving and troubleshooting skills, with a proactive approach to identifying and resolving issues.
  • Ability to adapt to a fast-paced, agile environment and manage multiple priorities effectively.

  • GCP & GKE Engineer

    7 days ago


    Guntur, India RED Global Full time

    GCP + GKE + DevOps Engineer – Bangalore or Gurugram (Hybrid)We are seeking a hands-on GCP + GKE + DevOps Engineer to join a major enterprise engineering program. This is a design and delivery–focused role requiring deep expertise across Google Cloud, Kubernetes, and modern CI/CD automation frameworks.You will be responsible for building, deploying, and...

  • Cloud architect

    2 days ago


    Guntur, India Green HR Solutions Full time

    Hiring for a USA based multinational Company (MNC)We are seeking an experienced and visionary Cloud Architect to design, implement, and manage scalable cloud infrastructure solutions. The ideal candidate will be responsible for creating secure, efficient, and cost-effective cloud systems that align with the company’s business objectives. You will work...

  • Lead Data Engineer

    3 weeks ago


    Guntur, India Searce Inc Full time

    Who we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving...


  • Guntur, India Cube Hub Inc. Full time

    We are seeking an experienced OpenText SME to provide technical leadership, strategic guidance, and hands-on expertise in managing and implementing OpenText-based solutions (such as OpenText B2B, Trading Grid, VIM, Content Server, or Exstream). The SME will play a critical role in designing, integrating, and optimizing OpenText platforms in alignment with...

  • Data Analyst

    7 days ago


    Guntur, India Bits In Glass Full time

    Title:Google Cloud Infrastructure / DevOps Engineer Location: Pune / Hyderabad / MohaliJob Summary: As a Google Cloud Infrastructure / DevOps Engineer, you will be responsible for designing, implementing, and maintaining our cloud infrastructure while ensuring efficient development operations. Your role bridges the gap between development and operations,...

  • SAP FICO Consultant

    7 days ago


    Guntur, India People Prime Worldwide Full time

    About Company :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business...


  • Guntur, India Arcana Full time

    As our Lead Security Engineer, you'll own and elevate Arcana's overall security posture - cloud, on-prem, and everything in between. You'll design and enforce policies, automate controls, and harden infrastructure end-to-end. While your primary focus will be on our GCP resources, you'll also partner with teams across networking, applications, and compliance...

  • Oracle ERP Cloud

    7 days ago


    Guntur, India Affintrix Technologies Full time

    - Candidates should have at-least 5-8 years of experience in the ERP/Fusion Cloud who can join us immediately or within 15days. - Candidate should have hands-on experience in integrating and extending ERP Cloud and/or On-Prem ERP applications (Financials, Distribution, and Manufacturing) - Experience (In-Depth Understanding of Data Model and Business process...


  • Guntur, India Maitsys Full time

    Job Summary:We are looking for an AI Engineer with strong expertise in designing and deploying AI/ML solutions that solve real-world business problems. The ideal candidate combines a deep understanding of machine learning with strong Python scripting skills, enabling them to move from concept to production quickly.Key Responsibilities:· Apply AI/ML...

  • Data Scientist

    7 days ago


    Guntur, India Qubryx Full time

    Job Title: Senior Data Scientist (Remote – India) – Predictive Modeling & Machine LearningLocation: Remote (India)Job Type: Full-timeExperience: 5+ YearsJob Summary:We are looking for a highly skilled Senior Data Scientist to join our India-based team in a remote capacity. This role focuses on building and deploying advanced predictive models to...