Senior GCP Data engineer
1 day ago
Job Title: Technical GCP Data
Engineer
Location:
Madurai/Chennai - Remote
Experience:
5+ Years
Notice Period:
Immediate
Job Summary
We are seeking a hands-on Technical GCP Data Engineer
with deep expertise in
real-time streaming data architectures
to help design, build, and optimize data pipelines in our Google Cloud Platform (GCP) environment. The ideal candidate will have strong architectural vision and be comfortable rolling up their sleeves to build
scalable, low-latency streaming data pipelines
using
Pub/Sub, Dataflow (Apache Beam)
, and
BigQuery
.
Key Responsibilities
- Architect and implement end-to-end
streaming data solutions
on GCP using
Pub/Sub
,
Dataflow
, and
BigQuery
. - Design real-time ingestion, enrichment, and transformation pipelines for high-volume event data.
- Work closely with stakeholders to understand data requirements and translate them into scalable designs.
- Optimize streaming pipeline performance, latency, and throughput.
- Build and manage orchestration workflows using
Cloud Composer (Airflow)
. - Drive schema design, partitioning, and clustering strategies in BigQuery for both real-time and batch datasets.
- Define SLAs, monitoring, logging, and alerting for streaming jobs using
Cloud Monitoring
,
Error Reporting
, and
Stackdriver
. - Experience with the data modeling.
- Ensure robust security, encryption, and access controls across all data layers.
- Collaborate with DevOps for CI/CD automation of data workflows using
Terraform
,
Cloud Build
, and
Git
. - Document streaming architecture, data lineage, and deployment runbooks.
Required Skills & Experience
- 5+ years of experience in data engineering or architecture.
- 3+ years of
hands-on GCP data engineering
experience. - Strong expertise in:
- Google Pub/Sub
- Dataflow (Apache Beam)
- BigQuery (including streaming inserts)
- Cloud Composer (Airflow)
- Cloud Storage (GCS)
- Solid understanding of
streaming design patterns
,
exactly-once delivery
, and
event-driven architecture
. - Deep knowledge of SQL and NoSQL data modeling.
- Hands-on experience with
monitoring and performance tuning
of streaming jobs. - Experience using
Terraform
or equivalent for infrastructure as code. - Familiarity with
CI/CD pipelines
for data workflows.
-
Senior GCP Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 15,00,000 - ₹ 25,00,000 per yearOverviewProdapt is looking for senior data engineers having 3+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL.ResponsibilitiesUnderstanding the requirementsPerforming in-depth analysis on dataSetting up secure data pipelines from ingestion to deliveryIndividual contributorRequirements3- 5 years of experience in Data...
-
GCP Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Raah Techservices Full time ₹ 47,300 - ₹ 20,00,000 per yearJob Summary:We are seeking an experienced and results-driven GCP Data Engineer with over 5 years of hands-on experience in building and optimizing data pipelines and architectures using Google Cloud Platform (GCP). The ideal candidate will have strong expertise in data integration, transformation, and modeling, with a focus on delivering scalable, efficient,...
-
Gcp Data Engineer
3 days ago
Chennai, Tamil Nadu, India Altimetrik Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Description:We are seeking a skilled and proactive GCP Data Engineer with strong experience in Python and SQL to build and manage scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will work closely with data analysts, architects, and business teams to enable data-driven decision-making.Key Responsibilities:Design and develop...
-
GCP Data Engineer
1 day ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole:GCP Data Engineer (BI Focus)Required Technical Skill Set:GCP Data Engineer (BI Focus)Desired Experience Range:4-10 yrsLocation of Requirement:Chennai/Bangalore/GandhinagarNotice period:Immediate joiner onlyAre you able to attend the Virtual Interview on these weekdays?Job Description:Experience:Associate should have 4+ years of IT experience with good...
-
GCP data engineer
7 days ago
Chennai, Tamil Nadu, India Prodapt Full time ₹ 6,00,000 - ₹ 18,00,000 per yearOverviewDesign and implement complex ETL/ELT pipelines using PySpark and Airflow for large-scale data processing on GCP.Lead data migration initiatives, including automating the movement of Teradata tables to BigQuery, ensuring data accuracy and consistency.Develop robust frameworks to streamline batch and streaming data ingestion workflows, leveraging...
-
GCP Data Engineer
2 days ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeTCS Hiring for GCP Data Engineers Role - GCP Data EngineersExperience - 10 to 12 Years Location - Bengaluru, Chennai, Hyderabad, Pune Roles & ResponsibilitiesProficiency in programming languages: Python, JavaExpertise in data processing frameworks: Apache Beam (Data Flow)Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud...
-
Senior Software Engineer
1 week ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...
-
Senior Data scientist
1 week ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...
-
GCP Data Engineer
1 week ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeng, transformation, and performance tuning. Experience with Apache Airflow for orchestration of data workflows. Familiarity with CI/CD pipelines and version control (e.g., Git). Strong problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications: GCP Professional Data Engineer certification. Experience with data modeling...
-
Hybrid Mode| GCP Data Engineer
1 week ago
Chennai, Tamil Nadu, India Getronics Full time ₹ 20,00,000 - ₹ 25,00,000 per yearGreetings from GetronicsWe have permanent opportunities for GCP Data Engineers in Chennai Location.Hope you are doing well This is Narmadha from Getronics Talent Acquisition team. We have multiple opportunities for GCP Data Engineers for our automotive client in Chennai Sholinganallur location. Please find below the company profile and Job Description. If...