GCP Data Engineer
2 months ago
Responsibilities:
• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.
• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.
• Use Pub/Sub for real-time data ingestion and streaming analytics.
• Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed.
• Optimize data storage and retrieval processes to enhance performance and reduce costs.
• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services.
• Ensure data quality and integrity through robust testing and validation processes.
• Stay updated with the latest GCP features and best practices, integrating them into existing workflows.
• Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.
Requirements:
• Proven experience as a Data Engineer with a focus on GCP services.
• Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.
• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.
• Proficiency in SQL and Python for data manipulation and analysis.
• Solid understanding of data warehousing concepts and ETL processes.
• Experience with real-time data processing and streaming analytics.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
Preferred Qualifications:
• Google Cloud Professional Data Engineer certification.
• Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer.
• Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager.
• Experience with containerization technologies like Docker and Kubernetes.
• Knowledge of data security and governance practices.
-
GCP Data Engineer
2 months ago
Greater Bengaluru Area, India Tech Mahindra Full timeResponsibilities: • Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. • Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. • Use Pub/Sub for real-time data ingestion and streaming analytics. • Provision and manage GCP infrastructure...
-
GCP Data Engineer
4 days ago
Greater Bengaluru Area, India Infogain Full time🚀 We're Hiring! Data Engineer (Python, Java, GCP, PySpark) 🚀Location: Bangalore, IndiaExperience: 5-10 yearsAre you a skilled Data Engineer with expertise in Google Cloud Platform (GCP), BigQuery, ETL processes, and PySpark? We’re looking for someone like you to join our dynamic team and work on cutting-edge data engineering solutions!What you'll...
-
Gcp Data Science
1 month ago
Bengaluru, Karnataka, India NTT DATA Full time**Statistical Modeling**: Strong understanding of statistical techniques and experience leveraging BigQuery ML and Vertex AI for model development. **Machine Learning Algorithms**: Experience with GCP's pre-built ML APIs (e.g., Vision AI, Natural Language API) and custom model building using Vertex AI. **Feature Engineering**: Ability to create meaningful...
-
Data Engineer
4 weeks ago
Greater Bengaluru Area, India Capgemini Full timeLocation: PAN IndiaJob Description (GCP Data Engineer):• Experience in GCP Data Engineering.• Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud.• Should have worked on handling big data.• Strong communication skills.• experience in Agile methodologies ETL, ELT skills, Data movement skills, Data...
-
Data Engineer
4 weeks ago
Greater Bengaluru Area, India Capgemini Full timeLocation: PAN India Job Description (GCP Data Engineer): • Experience in GCP Data Engineering. • Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. • Should have worked on handling big data. • Strong communication skills. • experience in Agile methodologies ETL, ELT skills, Data movement...
-
Gcp data engineer
4 weeks ago
Bengaluru, India Apptad Inc. Full timeJob Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as Big Query, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation...
-
GCP Data Engineer
3 months ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!!TCS is hiring for GCP Data EngineerDesired Experience Range: 5+ YearsJob Location: Gurgaon / Bangalore / Pune/ Chennai / MumbaiKey responsibilities:As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code...
-
GCP Data Engineer
4 weeks ago
Bengaluru, India Apptad Inc. Full timeJob Title: GCP Data Engineer - Teradata, ETLJob Location: BangaloreJob Type: PermanentKey Responsibilities:Data Engineering on Google Cloud Platform (GCP):Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub.Implement and optimize ETL processes to ensure efficient data transformation and...
-
GCP Data Engineer
4 weeks ago
Bengaluru, India Apptad Inc. Full timeJob Title: GCP Data Engineer - Teradata, ETL Job Location: Bangalore Job Type: Permanent Key Responsibilities: Data Engineering on Google Cloud Platform (GCP): Design, develop, and maintain data pipelines using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Pub/Sub. Implement and optimize ETL processes to ensure efficient data...
-
GCP Data Engineer
4 weeks ago
Bengaluru, India Tata Consultancy Services Full timeRole - GCP Data EngineerExperience - 5 to 12 yrsLocation - Chennai,Hyderabad,Bangalore,Pune,GurgaonMust Have -Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flowMust-Have· Google Data Engineer (Overall 5+ Years with 2 years relevant experience)· Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging...
-
GCP Data Engineer
4 weeks ago
Bengaluru, India Tata Consultancy Services Full timeRole - GCP Data Engineer Experience - 5 to 12 yrs Location - Chennai,Hyderabad,Bangalore,Pune,Gurgaon Must Have - Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flow Must-Have · Google Data Engineer (Overall 5+ Years with 2 years relevant experience) · Experience working in GCP based Big Data deployments (Batch/Realtime)...
-
GCP Data Engineer
3 weeks ago
Bengaluru, India Move Forward Technologies Pvt. Ltd. Full timeGCP Data Engineer (5-8 Years Experience)Are you passionate about leveraging cutting-edge technologies to build scalable, transformative data solutions? We are seeking an experienced and dynamic GCP Data Engineer to join our innovative team in Bangalore. In this role, you will work on both real-time and batch data systems, ensuring the delivery of...
-
GCP Data Engineer
3 months ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!!TCS is hiring for GCP Data EngineerDesired Experience Range: 5+ YearsJob Location: Gurgaon / Bangalore / Pune/ Chennai / MumbaiKey responsibilities:As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and maintain code...
-
GCP Data Engineer
3 months ago
Bengaluru, India Tata Consultancy Services Full timeGreetings from TCS!! TCS is hiring for GCP Data Engineer Desired Experience Range: 5+ Years Job Location: Gurgaon / Bangalore / Pune/ Chennai / Mumbai Key responsibilities: As a GCP data engineer the colleague should be able to designs scalable data architectures on Google Cloud Platform, using services like Big Query and Dataflow. They write and...
-
GCP Data Engineer
1 month ago
Bengaluru, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...
-
GCP Engineer
2 weeks ago
Bengaluru, Karnataka, India Torry Harris Business Solutions Full timeTorry Harris Business Solutions is looking for a skilled GCP Engineer - Data Solutions to work on our cloud-based data projects. As a key member of our team, you will design and implement data engineering solutions using GCP services.We are offering a salary of $145,000 per annum, along with opportunities for career advancement and professional growth.Job...
-
Gcp data engineer
1 month ago
Bengaluru, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:Big Query Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in Big Query.Analyze query performance and implement optimization...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India QWINIX TECHNOLOGIES PRIVATE LIMITED66degrees Full timeAbout QWINIX TECHNOLOGIES PRIVATE LIMITED / 66degreesWe are a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. Our unmatched engineering capabilities and vast industry experience enable us to help the world's leading brands transform their...
-
GCP Data Engineer
1 month ago
Bengaluru, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaResponsibilities:BigQuery Development & Optimization:Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery.Analyze query performance and implement optimization techniques...
-
GCP Data Engineer
1 month ago
Bengaluru, India Deloitte Full timeHi, We are looking for Candidates who are having experience as GCP Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Responsibilities: BigQuery Development & Optimization: Write and optimize complex SQL queries for efficient data processing and retrieval in BigQuery. Analyze query performance and implement optimization...