Sr. GCP Data Engineer
2 days ago
Job Description : Sr. GCP Data Engineer Experience : 5 to 12 Years Work location : Chennai, Bangalore, Hyderabad, Pune-Hybrid Shift Timing : 2 to 11 PM Interview proces s : L1 and L2 round Job description: 5+ years experience Should have experience in GCP BigQuery, DataProc(PySpark) Good to have experience on Informatica Requirements How do you upload files to GCS? Using Google Cloud Console (UI) – drag and drop files into a bucket. Using gsutil CLI: How do you query data in BigQuery? Write SQL queries in: BigQuery Console (UI) bq CLI → bq query "SELECT ..." APIs or client libraries (Python, Java, etc.) 3) What is the purpose of a Dataproc job? Dataproc job is a task you submit to a cluster to process data, such as: Spark job (Scala/Python/Java) Hive query Pig script Hadoop MapReduce job How do you handle errors in Dataproc jobs? Job retry policies (set retries in workflow templates). Error logs in Cloud Logging (examine stdout/stderr). Graceful failure handling with workflow DAG (e.g., skip/stop). Cluster monitoring with Cloud Monitoring & alerts. 5. How do you create an Airflow DAG in Cloud Composer? Write a Python script defining the DAG (dag_id, schedule_interval, default_args). Define tasks using operators (e.g., PythonOperator, BashOperator, BigQueryOperator) Upload the script to the DAGs folder in Composer’s GCS bucket → Composer automatically deploys it.
-
Urgent Hiring For Sr. GCP Data Engineer
1 week ago
Bengaluru, Chennai, Pune, India Ascendion Engineering Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole & responsibilitiesJob Description : Sr. GCP Data EngineerExperience : 6 to 13 YearsWork location: Chennai, Bangalore, Hyderabad, Pune-HybridShift Timing : 2 to 11 PMInterview process : L1 and L2 roundJob description:6+ years experienceShould have experience in GCP BigQuery, DataProc(PySpark)Good to have experience on InformaticaPreferred candidate...
-
GCP Data Engineer
1 week ago
Chennai, India Tata Consultancy Services Full timeRole- GCP Data Engineer Exp Range-6 to 12 Years Location- Chennai GCP Professional Data Engineer certification. Experience with data modeling and data warehousing concepts. Exposure to other cloud platforms (AWSJob Summary: We are seeking a highly skilled and experienced GCP Data Engineer to join our dynamic data engineering team. The ideal candidate will...
-
GCP Data Engineer
2 weeks ago
Chennai, India Tata Consultancy Services Full timeRole- GCP Data Engineer Exp Range-6 to 12 Years Location- Chennai GCP Professional Data Engineer certification. Experience with data modeling and data warehousing concepts. Exposure to other cloud platforms (AWS Job Summary: We are seeking a highly skilled and experienced GCP Data Engineer to join our dynamic data engineering team. The ideal candidate will...
-
GCP Data Engineer
3 days ago
Chennai, India Tata Consultancy Services Full time- Role- GCP Data Engineer- Exp Range-6 to 12 Years- Location- Chennai- GCP Professional Data Engineer certification.- Experience with data modeling and data warehousing concepts.- Exposure to other cloud platforms (AWSJob Summary:- We are seeking a highly skilled and experienced GCP Data Engineer to join our dynamic data engineering team. The ideal candidate...
-
GCP Data Engineer
12 hours ago
Chennai, India Tata Consultancy Services Full time- Role- GCP Data Engineer- Exp Range-6 to 12 Years- Location- Chennai- GCP Professional Data Engineer certification.- Experience with data modeling and data warehousing concepts.- Exposure to other cloud platforms (AWSJob Summary:- We are seeking a highly skilled and experienced GCP Data Engineer to join our dynamic data engineering team. The ideal candidate...
-
GCP Data Engineer
4 weeks ago
Chennai, India Tata Consultancy Services Full timeTCS Hiring for GCP Data Engineers Role - GCP Data Engineers Experience - 10 to 12 Years Location - Bengaluru, Chennai, Hyderabad, Pune Roles & Responsibilities Proficiency in programming languages: Python, Java Expertise in data processing frameworks: Apache Beam (Data Flow) Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud...
-
GCP Data Engineer
5 days ago
Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Summary:We are seeking a skilled GCP Data Engineer to design, develop, and manage large-scale data pipelines and cloud-based data solutions on Google Cloud Platform (GCP). The role requires expertise in data engineering, ETL/ELT processes, and GCP services to deliver scalable, reliable, and high-performance data platforms that support analytics and...
-
Sr. Data Engineer
1 week ago
Chennai, India PERMEVO Full time: Sr. Data Engineer: Chennai, Tamil Nadu, India: Permanent: On-Site:We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building and managing data pipelines. The ideal candidate will have a strong proficiency in relational and NoSQL databases, as well as experience with data warehouses and real-time data streaming. This role requires...
-
Sr. Data Engineer
1 week ago
Chennai, India PERMEVO Full time: Sr. Data Engineer: Chennai, Tamil Nadu, India: Permanent: On-Site:We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building and managing data pipelines. The ideal candidate will have a strong proficiency in relational and NoSQL databases, as well as experience with data warehouses and real-time data streaming. This role requires...
-
Sr. data engineer
6 days ago
Chennai, India PERMEVO Full time???????????? ????????????????????: Sr. Data Engineer ???????????? ????????????????????????????????: Chennai, Tamil Nadu, India ???????????? ????????????????????????????????: Permanent ???????????? ????????????????: On-Site ???????????? ????????????????????????????????????: We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building...
