GCP Data Engineer

2 weeks ago

Madurai, Tamil Nadu, India TechMango Full time ₹ 15,00,000 - ₹ 20,00,000 per year

We are seeking a hands-on GCP Data Engineer/Lead/Architect with deep expertise in real-time streaming data architectures to help design, build, and optimize data pipelines in our Google Cloud Platform (GCP) environment. The ideal candidate will have strong architectural vision and be comfortable rolling up their sleeves to build scalable, low-latency streaming data pipelines using Pub/Sub, Dataflow (Apache Beam), and BigQuery.

Tasks

Key Responsibilities

  • Architect and implement end-to-end streaming data solutions on GCP using Pub/Sub, Dataflow, and BigQuery.
  • Design real-time ingestion, enrichment, and transformation pipelines for high-volume event data.
  • Work closely with stakeholders to understand data requirements and translate them into scalable designs.
  • Optimize streaming pipeline performance, latency, and throughput.
  • Build and manage orchestration workflows using Cloud Composer (Airflow).
  • Drive schema design, partitioning, and clustering strategies in BigQuery for both real-time and batch datasets.
  • Define SLAs, monitoring, logging, and alerting for streaming jobs using Cloud Monitoring, Error Reporting, and Stackdriver.
  • Experience with the data modeling.
  • Ensure robust security, encryption, and access controls across all data layers.
  • Collaborate with DevOps for CI/CD automation of data workflows using Terraform, Cloud Build, and Git.
  • Document streaming architecture, data lineage, and deployment runbooks.
Requirements

Required Skills & Experience

  • 5+ years of experience in data engineering or architecture.

  • 3+ years of hands-on GCP data engineering experience.

  • Strong expertise in:

  • Google Pub/Sub

  • Dataflow (Apache Beam)

  • BigQuery (including streaming inserts)

  • Cloud Composer (Airflow)

  • Cloud Storage (GCS)

  • Solid understanding of streaming design patterns, exactly-once delivery, and event-driven architecture.

  • Deep knowledge of SQL and NoSQL data modeling.

  • Hands-on experience with monitoring and performance tuning of streaming jobs.

  • Experience using Terraform or equivalent for infrastructure as code.

  • Familiarity with CI/CD pipelines for data workflows.

Benefits

Benefits

Great work takes place when people feel appreciated and supported. That's why Techmango believes in shaping an environment where you can bloom, stay inspired, and benefit from a healthy work-life balance. Because you're not just an employee but a part of something greater.

Badminton Ground

Free Accommodation

Cab Facility for Female Employees

Insurance

GYM

Subsidised Food

Awards and Recognition

Medical Checkup

Join TechMango as a GCP Data Engineer to innovate and drive data excellence. Leverage cutting-edge technology in a dynamic team environment. Apply now for an exciting career opportunity

  • Data Engineering Specialist

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering SpecialistDesign, build, and maintain large-scale data pipelines using Spark and SQL. This role involves managing big data flows, collaborating with cross-functional teams, and driving business growth through data insights.About the Role:Create scalable data architectures using cloud-based platforms (AWS, Azure, GCP, Databricks).Analyze and...

  • Highly Skilled Data Engineer Wanted

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a seasoned data engineer to lead the design and implementation of large-scale data platforms on Google Cloud (GCP).The ideal candidate will have extensive experience in designing, building, and deploying robust data pipelines for ingestion, transformation, and analytics.Key ResponsibilitiesDesign and build scalable data pipelines...

  • Chief Data Engineering Architect

    5 days ago

    Madurai, Tamil Nadu, India beBeeDataLeader Full time ₹ 14,20,000 - ₹ 21,10,000

    Transform Your Career as a Data Leader with Our Enterprise Analytics and AI TeamAbout the RoleWe're seeking an accomplished Snowflake Developer to spearhead full lifecycle implementations – from secure platform setup and cloud integration to high-performance data pipeline development.This is a role for those who excel at the intersection of data...

  • Leading Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a seasoned Data Engineering professional to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems that drive business intelligence and analytics.Your primary focus will be on architecting and implementing scalable and robust data pipelines...

  • Advanced Data Engineering Solutions Specialist

    3 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Apache DruidJob Summary:We are seeking an experienced data engineer to design, develop, and deploy scalable data processing pipelines using Apache Druid.Develop and maintain ETL processes using SQL, query optimization, and data modeling for Druid.Collaborate with cross-functional teams to identify and resolve complex data...

  • Cloud Data Architect

    4 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    About UsWe are seeking a skilled Data Engineer to design, build, and optimize scalable data solutions.The ideal candidate will have hands-on experience in developing robust data pipelines, implementing efficient data models, and ensuring performance optimization for enterprise-level analytics.Key Responsibilities:Work with AtScale and GCP services to build...

  • Senior Data Engineering Specialist

    2 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerWe are seeking an experienced Senior Data Engineer with expertise in Python, Pyspark, and SQL to join our team. This role requires a deep understanding of big data concepts, hands-on coding experience, and the ability to implement streaming analytics and data processing.Key Requirements:5+ years of experience as a Senior Data...

  • Data Engineering Professional

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Are you a data enthusiast eager to explore a role where you can build, scale and innovate?Job OverviewWe are seeking skilled professionals with hands-on experience in:Databricks, SQL, PySpark and Python programming languages.A strong understanding of Spark, Delta Lake and Data Lakehouse architecture.Hands-on experience with cloud platforms – AWS, Azure or...

  • Data Engineer

    7 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Data InsightsAs a key member of our dynamic data team, you will play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform.Design and implement enterprise-grade data pipelines for marketing data ingestion and processing.Build and optimize data warehouses and data lakes to support digital...

  • Chief Data Strategist

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataStrategy Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    About Invokhr Solutions We are a boutique AI and data engineering firm that empowers Fortune 1000 companies through AI-powered decision intelligence.Key Responsibilities: You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.Data Architecture Expertise: Design and...