GCP Data Engineer

1 day ago

Remote, India Redlinux Full time ₹ 3,60,000 - ₹ 4,80,000 per year

Freelancing Opportunity

Job Title: Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize large-scale data pipelines across batch and real-time systems. The ideal candidate is strong with PySpark and GCP, understands orchestration, real-time ingestion, API-driven workflows, and is comfortable working in modular, config-driven environments.

Key Responsibilities

  • Design and develop complex data transformation pipelines using PySpark (Spark SQL).
  • Build and orchestrate workflows using Airflow or similar tools.
  • Develop scalable data solutions on Google Cloud Platform (BigQuery, GCS, Pub/Sub, Cloud Run, Functions, Cloud SQL).
  • Implement real-time ingestion frameworks using Kafka, webhooks, and file-based triggers.
  • Build and manage API integrations (REST/webhooks) and payload-driven workflows.
  • Deploy, monitor, and scale workloads on Kubernetes (GKE).
  • Develop YAML-driven, UI-configurable, modular pipeline components.
  • Implement schema transformations, data validation, hashing techniques, and DQF logic.
  • Manage secure data transfers via BASH, SFTP, and handle basic networking and access management.
  • Contribute to CI/CD, observability, monitoring dashboards, and lightweight UI tools as needed.
  • Demonstrate strong ownership and deliver reliable solutions under fast-paced environments.

Required Technical Skills

  • Python & PySpark (Spark SQL): 5+ years (Must)
  • Airflow / Orchestration: 2+ years (Must)
  • Google Cloud Platform: 3+ years (BigQuery, GCS, Pub/Sub, Cloud Run, Functions, Cloud SQL)
  • Real-time ingestion: 2+ years (Kafka, webhook-based, file-based)
  • API integrations (REST/webhooks): 2+ years
  • Kubernetes (GKE preferred): 1–2 years
  • BigQuery SQL & PostgreSQL: 2+ years
  • YAML/config-driven pipeline design: 2+ years
  • Schema transformation, hashing, data quality frameworks (DQF): 2+ years
  • CI/CD, Observability, Dashboards (Grafana/Streamlit/Flask): 1+ year

Nice-to-Have

  • Experience in Logistics or Healthcare domain.
  • Exposure to monitoring tooling, lightweight UI components, or frontend basics.

Job Types: Part-time, Freelance

Contract length: 12 months

Pay: ₹30, ₹40,000.00 per month

Benefits:

  • Work from home

Experience:

  • total work: 7 years (Required)

Shift availability:

  • Night Shift (Required)
  • Overnight Shift (Required)

Work Location: Remote

  • GCP Data Engineer

    24 hours ago

    Remote, India Code Ninjas Full time ₹ 2,40,000 - ₹ 3,60,000 per year

    We require an expert GCP Data & AI Agent Engineer skilled in designing and deploying scalable automation solutions. Core technical proficiency must include the Agent Development Kit (ADK) for building custom agents, deep expertise in BigQuery for data warehousing and optimization, and practical experience using Vertex AI for robust agent deployment and...

  • GCP Data Engineer

    2 weeks ago

    Remote, India Mobile Programming Full time ₹ 50,000 - ₹ 15,42,514 per year

    Associate Technical Architect (Data Engineer - GCP)Work Location: Mumbai / Bangalore / TrivandrumExperience Level: 6 to 9 YearsMust-Have SkillsStrong expertise in Google Cloud Platform (GCP) services:BigQueryDataprocPub/SubDataflowProficiency in SQL queries and Python.Hands-on experience with Apache SparkInterested candidates (kindly mention ID :JR7400) can...

  • Algotale- GCP Data engineer

    1 day ago

    Remote, India Nexthire Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data...

  • GCP Data Engineer_Bharti_INT

    1 day ago

    Remote, India Coders Brain Technology Full time ₹ 1,20,00,000 - ₹ 2,40,00,000 per year

    *Act as a subject matter expert in data engineering and GCP data technologies.  *Knowledge of how to maintain ETLs operating on a variety of structured and unstructured sources.  *Liaise and be part of our extensive GCP community, contributing to the knowledge exchange learning programme of the platform.  *In-depth knowledge about SQL databases and...

  • GCP Data Engineer_Roji_Thetechglor

    1 day ago

    Remote, India Coders Brain Technology Full time ₹ 60,00,000 - ₹ 1,20,00,000 per year

    GCP Data Engineer (CDF)   Experience : 3 - 8 years Timings - IST Rate: 1.25k Primary Skills : Python, SQL, GCP, CDF, CDAP Secondary Skills: GCP (BigQuery/ Dataproc) / other Cloud DW/ETL - IICS, AWS Glue, AZURE Synapse, Snowflake, Talend   Required Experience ● Must be able to code in Python and SQL on Big Data platforms ● Must have vast experience of...

  • Gcp Data Architect

    6 days ago

    Remote, India RARR Technologies Pvt Ltd Full time

    We are seeking a skilled Data Engineer to join our team, proficient in **BigQuery, Dataflow, and Airflow,** with expertise in either **Python or Java programming languages**. As a Data Engineer, you will play a key role in designing, implementing, and optimizing data pipelines for our organization s data infrastructure. **Responsibilities**: - Design and...

  • AWS/Snowflake Support Engineer

    2 weeks ago

    Remote, India Data Engineer Academy LLP Full time ₹ 10,000 - ₹ 1,50,000 per year

    We're Hiring: AWS/Snowflake Support Engineer (SME Role)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...

  • Gcp Data Architect

    4 days ago

    Remote, India Techolution Full time

    **2 hours ago** - Remote, India - | - Full Time - | - Architect **Skills Required**: - Non-Negotiable Skills: Solution Designing & Architecture Google Cloud Data Services GCP Java/Go/Python Kafka/RabbitMQ NO SQL Ownership Seeker Mindset Passionate Towards Work Extremely Ambitious Unbeatable Work Ethics Ability to comprehend - Negotiable Skills: data...

  • GCP & GKE Staff Engineer

    4 days ago

    Remote, India TriDevSofts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title / Role: GCP & GKE Staff EngineerExperience: 8 to 10 YearsBGV: Address, Education, Employment, CriminalJob Description:Primary Skill: Cloud-Infrastructure-Google Cloud PlatformTechnical Qualification/ Knowledge:Expertise in assessment, designing and implementing GCP solutions including aspects like compute, network, storage, identity, security ,...

  • Operation Analyst

    3 days ago

    Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Job Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...