GCP Data Engineer
6 months ago
Job Description :
Must-Have :
- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.
- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure
- Strong technical expertise in Python and SQL
- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud Composer, DataProc, Dataflow, Pub/Sub.
- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)
- Experience Developing DAGs in Apache Airflow 1.10.x or 2. x
- Good Problem-Solving Skills
- Detail Oriented
- Strong Analytical skills working with a large store of Databases and Tables
- Ability to work with geographically diverse teams.
Good to Have :
- Certification in GCP service.
- Experience with Kubernetes.
- Experience with Docker
- Experience with CircleCI for Deployment
- Experience with Great Expectations.
Responsibilities :
- Build Data and ETL pipelines in GCP.
- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Talend, Java
- Interact with customers on daily basis to ensure smooth engagement.
- Responsible for timely and quality deliveries.
- Fulfill organization responsibilities : Sharing knowledge and experience with the other groups in the organization, and conducting various technical training sessions.
Location : Pune, Hyderabad, Remote
Education : Bachelors or Masters (preferably BE/B.Tech) - Computer Science/IT.
-
GCP Data Engineer
1 month ago
Anywhere in India/Multiple Locations IT Source Global Full timeRole : GCP Data EngineerJob Description :Data Pipeline Development : - Design, implement, and maintain scalable data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub. - Ensure efficient extraction, transformation, and loading (ETL) of data.Cloud Infrastructure Management : - Manage and optimize GCP data storage and processing...
-
Senior Data Architect
3 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob Title: GCP Data EngineerData Pipeline Development:As a GCP Data Engineer at IT Source Global, you will design, implement, and maintain scalable data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub.Key Responsibilities:Ensure efficient extraction, transformation, and loading (ETL) of data.Implement best practices for data security,...
-
GCP Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob SummaryIT Source Global is seeking a highly skilled GCP Data Engineer to design and implement scalable data pipelines using GCP services.Data Pipeline DevelopmentDesign and implement efficient data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub.Develop and maintain Python scripts and applications to automate data processing...
-
GCP Cloud Engineer
3 weeks ago
Pune/Hyderabad/Anywhere in India/Multiple Locations Huquo Full timeJob Title: GCP Cloud EngineerJob Summary:We are seeking a highly skilled GCP Cloud Engineer to join our team at Huquo. As a GCP Cloud Engineer, you will be responsible for designing and implementing large-scale data pipelines using Google Cloud Platform.Key Responsibilities:Design and implement large-scale data pipelines using GCPSupport migration of data to...
-
Senior GCP Migration Engineer
3 weeks ago
Anywhere in India/Multiple Locations Hum Technologies Full timeAbout this role:We are seeking a highly skilled GCP Migration Engineer to join our team at Hum Technologies.Key responsibilities:Design and implement GCP infrastructure, including compute, storage, networking, and security components.Migrate applications, databases, and workloads from on-premises to GCP.Optimize GCP resources to ensure cost-efficiency and...
-
Data Engineering Specialist
3 weeks ago
Anywhere in India/Multiple Locations DoublU Pty Ltd Full timeJob Title: Data EngineerJob Overview:We at DoublU Pty Ltd are seeking a skilled and experienced Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP).Key Responsibilities:Design, develop, and implement data...
-
Data Engineering Manager
3 weeks ago
Anywhere in India/Multiple Locations HuQuo Consulting Pvt. Ltd. Full timeJob Summary:As a Data Engineering Manager at HuQuo Consulting Pvt. Ltd., you will be responsible for driving the design, architecting, and implementing of GCP Cloud-based big data solutions for clients. Your role will involve delivering high-quality solutions by leading design discussions related to Data Ingestion, Transformation & Consumption, Data Storage...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN DoublU Pty Ltd Full timeJob Overview :We are seeking a skilled GCP Data Engineer to join our dynamic data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures in Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible,...
-
Senior Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations DoublU Pty Ltd Full timeJob OverviewWe are seeking a skilled GCP Data Engineer to design, build, and maintain scalable data pipelines and architectures in Google Cloud Platform (GCP).The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure that data is accessible, reliable, and ready for analysis.Key Responsibilities- Design, develop,...
-
Senior Cloud Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Techwaukee Full timeJob Description:As a Senior Cloud Data Engineer at Techwaukee, you will play a crucial role in designing and implementing scalable data architectures on Google Cloud Platform (GCP).Key Responsibilities:Lead the development of data pipelines using GCP Dataflow and Cloud Pub/Sub.Design and implement data quality frameworks and data governance...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Hum Technologies Full timeCompany Description : Hum Technologies is a data solutions/AI services company in Noida. We specialize in advance data management, cloud transformation, custom AI Development, and talent management. With a focus on enabling businesses to become data-led enterprises powered by AI, we offer comprehensive solutions to overcome complex data and AI...
-
GCP Data Engineer
2 weeks ago
India Mastech InfoTrellis Full timePosition: GCP Data Engineer Location: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months) Duration: Full Time Service based Company: Mastech InfoTrellis and Mastech Digital Notice Period: 15-45 days (Non negotiable) Job Description: We are seeking a talented and motivated Data Engineer with expertise in Google Cloud...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full timeJob Title: Data EngineerAt Orangeskill Technologies Pvt Ltd, we are seeking a highly skilled Data Engineer to design, build, and maintain data pipelines, workflows, and infrastructure to support efficient data processing and analysis.Key Responsibilities:Design and implement data pipelines for large-scale data processing.Develop and manage workflow...
-
Senior Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations MindBrain Full timeJob Title :Data Engineering Lead.Location :Remote.Experience : 6+ Years.Contract : 6 Months (Extendable).Key Responsibilities :Design and develop robust data pipelines and ETL processes to handle large volumes of data, ensuring data integrity, consistency, and security.Collaborate with cross-functional teams, including data scientists, analysts, and business...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Orangeskill Technologies Pvt Ltd Full timeJob Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...
-
GCP Data Engineer
1 month ago
India Tata Consultancy Services Full timeRole : GCP Data Engineer Required Technical Skill Set :Airflow , BigQuery, Dataflow, DataProc, Cloud Functions, Cloud Composer, Sql Desired Experience Range: 5 – 7 Years Location of Requirement : Chennai, Bangalore, Kochi, Hyderabad, Mumbai, Pune, Delhi, Trivandrum, Indore, Ahmedabad, Kolkata, BBSR Must-Have Strong and working experience in data...
-
GCP Data Engineer
2 weeks ago
pune, India Tata Consultancy Services Full timeInviting applications for GCP Data Engineer (5 - 10 years) Location : Pune/ Bengaluru -Google Data Engineer (Overall 5+ Years with 3 years relevant experience in GCP) -Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc. -Good...
-
Data Engineer: Efficient Data Solutions
3 weeks ago
Anywhere in India/Multiple Locations Info Services Full timeData EngineerAt Info Services, we're seeking a skilled Data Engineer to drive efficient data solutions across our organization.Main Responsibilities:- Develop and implement scalable data pipelines using big data frameworks like Spark for efficient data processing.- Utilize strong coding skills in Scala, Python, or Java to create high-performance data...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Qualintia solutions Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Qualintia Solutions. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesCollaborate with cross-functional teams to translate business requirements into software solutions.Develop...
-
GCP Data Engineer
13 hours ago
Pune, India Tekgence Inc Full time1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference.Role: GCP Data Engineer (SME - Sr. Developer)Experience: 5 - 10 YearsNotice Period: Immediate - 2 months serving maxBudget: 20 - 32 LPA maxLocation: Pune/Chennai/HyderabadMandate Skills:GCP BigQuery, SQL Scripting & Python coding...