Sr. GCP Data Engineer
1 week ago
Job Description
: Sr. GCP Data Engineer
Experience
: 7 to 12 Years
Work location
: Chennai, Bangalore, Hyderabad, Pune-Hybrid
Shift Timing
: 2 to 11 PM
I
nterview proces
s : L1 and L2 round
Job description:
- 5+ years experience
- Should have experience in GCP BigQuery, DataProc(PySpark)
- Good to have experience on Informatica
Requirements
- How do you upload files to GCS?
- Using Google Cloud Console (UI) – drag and drop files into a bucket.
- Using gsutil CLI:
- How do you query data in BigQuery?
Write SQL queries in:
- BigQuery Console (UI)
- bq CLI → bq query "SELECT ..."
APIs or client libraries (Python, Java, etc.)Cluster monitoring with Cloud Monitoring & alerts.Upload the script to the DAGs folder in Composer's GCS bucket → Composer automatically deploys it.
- What is the purpose of a Dataproc job? Dataproc job is a task you submit to a cluster to process data, such as:
- Spark job (Scala/Python/Java)
- Hive query
- Pig script
- Hadoop MapReduce job
- How do you handle errors in Dataproc jobs?
- Job retry policies (set retries in workflow templates).
- Error logs in Cloud Logging (examine stdout/stderr).
- Graceful failure handling with workflow DAG (e.g., skip/stop).
- How do you create an Airflow DAG in Cloud Composer?
- Write a Python script defining the DAG (dag_id, schedule_interval, default_args).
- Define tasks using operators (e.g., PythonOperator, BashOperator, BigQueryOperator)
-
GCP Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 12,00,000 - ₹ 30,00,000 per yearPosition Overview Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present. - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member of our data infrastructure...
-
GCP Data engineer
1 week ago
Chennai, Tamil Nadu, India LatentView Analytics Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJob Summary:We are seeking a Senior Data Engineer to join a Global Data Analytics & Insights team focused on transforming enterprise data management and democratizing access to insights. This role will lead a large-scale data migration from external agency-managed environments into an internal Google Cloud Platform (GCP) ecosystem. You will drive discovery,...
-
GCP Data Engineer
1 week ago
Chennai, Tamil Nadu, India TalentoNova Full time US$ 60,000 - US$ 1,80,000 per yearPosition: GCP Data EngineerLocation: Chennai (Hybrid)Duration: Contract to hireResponsibilities:Design, develop, and maintain data pipelines using GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc).Implement ETL/ELT workflows to ingest, transform, and load data from diverse sources.Optimize BigQuery datasets for performance and cost...
-
Data Engineer-GCP
4 days ago
Chennai, Tamil Nadu, India, Tamil Nadu Forward Biz Pvt Ltd Full timeApply only if you are interested in taking an in-person assessment either in Bangalore or ChennaiRole DescriptionThis is a full-time Data Engineer-GCP role based in Chennai. The role involves designing, building, and maintaining data pipelines and workflows, implementing data models, performing ETL processes, and managing data warehousing. The candidate will...
-
GCP Data engineer
4 days ago
Chennai, Tamil Nadu, India, Tamil Nadu LatentView Analytics Full timeJob Summary:We are seeking a Senior Data Engineer to join a Global Data Analytics & Insights team focused on transforming enterprise data management and democratizing access to insights. This role will lead a large-scale data migration from external agency-managed environments into an internal Google Cloud Platform (GCP) ecosystem. You will drive discovery,...
-
GCP Data Engineer
6 days ago
Chennai, Tamil Nadu, India Virtusa Full timeDesign and develop robust ETL pipelines using Python, PySpark, and GCP services.Build and optimize data models and queries in BigQuery for analytics and reporting.Ingest, transform, and load structured and semi-structured data from various sources.Collaborate with data analysts, scientists, and business teams to understand data requirements.Ensure data...
-
GCP Data Engineers
2 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeGreetings From TCS! GCP Senior Data Engineers 5 to 10 yearsChennaiInterview Date: weekend Virtual Drive 22-Nov-25Last Date of form submission: Today/ASAPFollow me for more Job updates!
-
Snowflake Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Randomtrees Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole: Data EngineerExperience: 3 to 16 YearsLocation: Chennai(3 days office in a week)Mandatory Skills: Data Warehousing, Data Modelling, Snowflake, Data Build Tool(DBT), SQL, Any cloud(AWS/Azure/GCP), Python/Pyspark(Good to have)Overview of the requirement:We are looking for a skilled Data Architect/ Sr. Data Engineer to design and implement data solutions...
-
Sr Data Engineer
1 week ago
Chennai, Tamil Nadu, India PayPal Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLead the design and development of complex data pipelines for data collection and processing. Develop and maintain advanced data storage solutions. Ensure data quality and consistency through sophisticated validation and cleansing processes. Implement advanced data transformation techniques to prepare data for analysis. Collaborate with cross-functional...
-
GCP Data Architect
2 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Mastech Digital Full timeJob Title: Data Architect - GCPLocation: Chennai/HyderabadExperience: 10-15 years overall | 5+ years in GCP ArchitectureBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysResponsibilities: 1. Understand customers’ overall data platform, business and IT priorities and success measures to...