Gcp data engineer
3 weeks ago
About the Role: We are seeking an experienced GCP Data Engineer to join our dynamic data engineering team. As a Data Engineer, you will design, develop, and maintain data pipelines on Google Cloud Platform (GCP) to support large-scale data analytics and machine learning initiatives. The ideal candidate will have a strong background in working with Big Query , Python , and Databricks.
Key Responsibilities: Design and Build Data Pipelines: Develop scalable and efficient data pipelines using GCP services such as Big Query , Cloud Dataflow , Cloud Storage , and Pub/Sub.
Big Query Optimization: Optimize queries, build materialized views, and ensure the efficiency and performance of large datasets in Big Query.
Data Modeling and ETL: Create and maintain ETL (Extract, Transform, Load) processes, transforming raw data into structured, easily accessible formats for analytics.
Automation and Scripting: Write Python scripts to automate data workflows, integrate data sources, and manage metadata for data governance.
Databricks Integration: Work with Databricks for data processing, including the use of Apache Spark for batch and stream processing.
Collaboration: Collaborate with Data Scientists, Analysts, and other stakeholders to understand data requirements and provide effective solutions.
Data Quality and Governance: Ensure data integrity, quality, and security by following best practices for data governance, monitoring, and logging.
Required Skills and Qualifications: Experience with GCP Services: Hands-on experience with Google Cloud Platform tools, especially Big Query , Dataflow , Pub/Sub , Cloud Storage , Cloud Functions , and Cloud Composer.
Proficiency in Python: Strong Python programming skills, especially for data engineering, data transformation, automation, and working with APIs.
Databricks/Apache Spark: Experience working with Databricks or Apache Spark for distributed data processing and data pipeline orchestration.
SQL Expertise: Advanced knowledge of SQL, specifically with Big Query for creating complex queries and optimizing large-scale datasets.
Data Modeling: Experience with data modeling and designing data architectures that support high-performance analytics and reporting.
ETL Tools: Experience with ETL tools and frameworks (e.g., Apache Airflow , Dataflow , or dbt ).
Version Control: Experience with Git or similar version control systems.
Cloud Data Architecture: Familiarity with best practices for cloud data architecture, including data lakes, data warehouses, and cloud-native technologies.
Agile Methodology: Experience working in Agile development environments, collaborating in cross-functional teams.
Desired Skills: Data Engineering Frameworks: Familiarity with frameworks such as Apache Kafka , Apache Beam , or Flink for real-time data processing.
Machine Learning Integration: Basic understanding of integrating data pipelines with machine learning models and platforms.
Security & Compliance: Knowledge of GCP security best practices (e.g., IAM, data encryption, auditing) and compliance standards (e.g., GDPR, HIPAA).
CI/CD Pipelines: Familiarity with setting up CI/CD pipelines for automated testing and deployment of data pipelines.
Education & Experience: Bachelor’s or Master’s degree in Computer Science , Information Technology , Engineering , or a related field.
5+ years of experience as a Data Engineer, with a focus on GCP, data pipelines, and analytics.
-
GCP Data Engineer
2 months ago
Delhi, India Mastech InfoTrellis Full timePosition:GCP Data EngineerLocation:Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)Duration:Full TimeService based Company:Mastech InfoTrellis Mastech Digital Period:15-45 days (Non negotiable)Job Description:We are seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP) and PySpark to join our...
-
GCP Data Engineer
2 months ago
delhi, India Mastech InfoTrellis Full timePosition: GCP Data EngineerLocation: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)Duration: Full TimeService based Company: Mastech InfoTrellis and Mastech Digital Period: 15-45 days (Non negotiable)Job Description:We are seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP) and...
-
GCP Data Engineer
2 weeks ago
Delhi, India Infogain Full timeWe're Hiring! Data Engineer (Python, Java, GCP, PySpark)Location: Bangalore, IndiaExperience: 5-10 yearsAre you a skilled Data Engineer with expertise in Google Cloud Platform (GCP) , BigQuery , ETL processes , and PySpark ? We’re looking for someone like you to join our dynamic team and work on cutting-edge data engineering solutions!What you'll...
-
GCP Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole - GCP Data Engineer Experience - 5 to 12 yrsLocation - Chennai,Hyderabad,Bangalore,Pune,GurgaonMust Have -Big query, Dataflow , Cloud SQL , Cloud composer , Python , Vertex and Data flowMust-Have· Google Data Engineer (Overall 5+ Years with 2 years relevant experience)· Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging...
-
GCP Data Engineer
2 weeks ago
Delhi, India Infogain Full timeWe're Hiring! Data Engineer (Python, Java, GCP, PySpark)Location:Bangalore, IndiaExperience:5-10 yearsAre you a skilled Data Engineer with expertise inGoogle Cloud Platform (GCP) ,BigQuery ,ETL processes , andPySpark ? We’re looking for someone like you to join our dynamic team and work on cutting-edge data engineering solutions!What you'll do:Design,...
-
GCP Data Engineer
3 weeks ago
Delhi, India NASTech, IT Full timeJob Title:GCP Data EngineerAbout the Role:We are seeking an experiencedGCP Data Engineerto join our dynamic data engineering team. As a Data Engineer, you will design, develop, and maintain data pipelines on Google Cloud Platform (GCP) to support large-scale data analytics and machine learning initiatives. The ideal candidate will have a strong background in...
-
GCP Data Engineering Lead
3 weeks ago
Delhi, Delhi, India CYMETRIX INFOTECH PRIVATE LIMITED Full timeJob Title: GCP Data Engineering LeadCymetrix Infotech Private Limited is looking for a seasoned GCP Data Engineering Lead to lead our data engineering team. In this role, you will oversee the design and implementation of scalable data pipelines on GCP to support business growth.We estimate the salary for this position to be around ₹1,500,000 per annum,...
-
GCP Data Engineer
3 months ago
Delhi, India Quantiphi Full timeDesignation:Data EngineerExperience Level:4-16 YearsLocation:Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of relational...
-
NASTech, IT | GCP Data Engineer
3 weeks ago
Delhi, India NASTech, IT Full timeJob Title: GCP Data EngineerAbout the Role: We are seeking an experienced GCP Data Engineer to join our dynamic data engineering team. As a Data Engineer, you will design, develop, and maintain data pipelines on Google Cloud Platform (GCP) to support large-scale data analytics and machine learning initiatives. The ideal candidate will have a strong...
-
NASTech, IT | GCP Data Engineer
3 weeks ago
delhi, India NASTech, IT Full timeJob Title: GCP Data EngineerAbout the Role: We are seeking an experienced GCP Data Engineer to join our dynamic data engineering team. As a Data Engineer, you will design, develop, and maintain data pipelines on Google Cloud Platform (GCP) to support large-scale data analytics and machine learning initiatives. The ideal candidate will have a strong...
-
GCP Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Role: GCP Data EngineerJob Location: ChennaiJob Mode: Work From OfficeExperience Range: Min 5 - 7 yearsDesired Competencies (Technical/Behavioral Competency):Skills: Hadoop, BigQuery, Dataproc, DataFlow, PySpark/Scala, Google Cloud1. Experience in delivering Big Data solutions.2. Experience in developing and deploying big data pipelines in Cloud...
-
GCP Data Engineer
2 weeks ago
Delhi, India LTIMindtree Full timeExperience: 3 to 12 Yrs.Joining Time: Less than 30-45 daysLocation: AnyIf the above criteria are matching your profiles, please share your profile to with below details.Total Experience:Relevant in GCP:Relevant in Big Query:Relevant in Python:Current CTC:Expected CTC:Current Location:Preferred LocationOffer in hand if any:Pan Card No:Notice period/how...
-
Gcp data architect
2 weeks ago
Delhi, India Tata Consultancy Services Full timeRole: GCP Data Architect Experience range: 10 - 20 years Location: PAN India. Responsibilities : As a member of Data on Cloud Co E (Centre of Excellence) Provide Technical pre-sales enablement covering data architecture, data engineering, data modelling, data consumption, data platform migration and data governance focusing on GCP data...
-
GCP Data Architect
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole: GCP Data Architect Experience range: 10 - 20 yearsLocation: PAN India.Responsibilities :As a member of Data on Cloud CoE (Centre of Excellence) Provide Technical pre-sales enablement covering data architecture, data engineering, data modelling, data consumption, data platform migration and data governance focusing on GCP data platform.Expert...
-
Gcp data architect
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole: GCP Data ArchitectExperience range: 10 - 20 yearsLocation: PAN India.Responsibilities :As a member of Data on Cloud Co E (Centre of Excellence) Provide Technical pre-sales enablement covering data architecture, data engineering, data modelling, data consumption, data platform migration and data governance focusing on GCP data platform.Expert level...
-
GCP Data Architect
2 months ago
delhi, India Mastech InfoTrellis Full timePosition: Data Architect - GCPLocation: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)Duration: Full TimeService based Company: Mastech InfoTrellis and Mastech Digital period: 15-45 days(Non negotiable)Responsibilities:1. Understand customers’ overall data platform, business and IT priorities and success measures to...
-
GCP Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Role: GCP Data EngineerJob Location: ChennaiJob Mode: Work From OfficeExperience Range: Min 5 - 7yearsDesired Competencies (Technical/Behavioral Competency):Skills: Hadoop, BigQuery, Dataproc, DataFlow, PySpark/Scala, Google CloudExperience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...
-
GCP Engineer
1 month ago
Delhi, India Birlasoft Full timeAbout Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...
-
GCP Data Architect
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole: GCP Data ArchitectExperience range: 10 - 20 yearsLocation: PAN India.Responsibilities: As a member of Data on Cloud CoE (Centre of Excellence) Provide Technical pre-sales enablement covering data architecture, data engineering, data modelling, data consumption, data platform migration and data governance focusing on GCP data platform. Expert level...
-
GCP Data Architect
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole: GCP Data Architect Experience range: 10 - 20 years Location: PAN India. Responsibilities : As a member of Data on Cloud CoE (Centre of Excellence) Provide Technical pre-sales enablement covering data architecture, data engineering, data modelling, data consumption, data platform migration and data governance focusing on GCP data platform. Expert...