GCP Data Engineer

5 days ago

Navi Mumbai, Maharashtra, India contactX Full time

About the Role :


We are seeking an experienced GCP Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with extensive experience in Google Cloud Platform (GCP), SQL, Python, and PySpark. You will be responsible for designing, developing, and maintaining data pipelines and solutions that support our business Responsibilities : and Development : - Design, develop, and maintain scalable data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage.

- Implement ETL processes to extract, transform, and load data from various sources into GCP.

- Strong hands on experience in writing Stored Procedures

- Develop and optimize SQL queries for data analysis and Management :

- Manage and monitor data workflows to ensure data integrity and availability.

- Implement data governance and security best practices within GCP.

- Perform data quality checks and validation to ensure accuracy and and PySpark Programming :

- Develop and maintain Python scripts for data processing and automation.

- Utilize Python libraries such as Pandas, NumPy, and PySpark for data manipulation and analysis.

- Develop and optimize PySpark applications for large-scale data processing.

- Integrate Python and PySpark applications with GCP services for seamless data and Support :

- Collaborate with cross-functional teams to understand data requirements and deliver solutions.

- Provide technical support and guidance to junior data engineers and other team members.

- Participate in code reviews and contribute to continuous improvement of data engineering Optimization :

- Optimize data pipelines for performance and scalability. Knowledge on Optimization techniques and features within Bigquery.

- Monitor and troubleshoot data pipeline issues to ensure timely resolution.

- Implement best practices for cost management and resource utilization within :

- Bachelor's or Master's degree in Computer Science, Engineering, or related field.

- 6 - 9 years of experience in data engineering, with a focus on GCP, Python, and PySpark.

- Strong proficiency in GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage.

- Advanced skills in Python programming and related libraries (Pandas, NumPy, PySpark).

- Experience with SQL and database management.

- Knowledge of data governance, security, and compliance best practices.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration Qualifications :

- GCP certification (e.g., Professional Data Engineer).

- Experience with other cloud platforms (e.g., AWS, Azure).

- Familiarity with containerization and orchestration tools (e.g., Docker, Proficiency in programming languages : SQL, Python and Pyspark

- Expertise in data Ingestion frameworks : Apache Beam (Data Flow) or Apache Kafka

- Hands-on experience with GCP services : Big Query, Google Cloud Storage, Cloud Functions, Pub/Sub, Dataflow, Composer

- Knowledge of data modeling and database design

- Experience in ETL (Extract, Transform, Load) processes

- Familiarity with cloud storage solutions

- Strong problem-solving abilities in data engineering challenges

- Understanding of data security and scalability
- Proficiency in relevant tools like Apache Airflow

(ref:hirist.tech)

  • gcp data engineer

    1 week ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Position- GCP Data EngineerExperience-7-10 YearsLocation- Bengaluru, Pune, MumbaiNotice Period- Immediately Joiner/0-15 or 0-30 DaysMust Have Hands on Experience:Good Hands on knowledge on GCP Should have worked on Data Migration projects, from On-prem to CloudShould have Cloud Storage Knowledge, Big Query, Cluster KnowledgeSound programming knowledge on...

  • GCP Cloud Engineer

    3 weeks ago

    Navi Mumbai, Maharashtra, India Bajaj Technology Services Full time

    We are looking for immediate joiner for below position. GCP Cloud Engineer Exp :: 7 to 10 Years Location :: Airoli (Navi Mumbai) Key responsibilities needed: • Cloud infrastructure expert – He/She should know how to use well architected review framework, should have managed various applications/ infrastructure • Should be expert in infrastructure...

  • GCP Cloud Engineer

    3 weeks ago

    Navi Mumbai, Maharashtra, India Bajaj Technology Services Full time

    We are looking for immediate joiner for below position. GCP Cloud Engineer Exp :: 7 to 10 Years Location :: Airoli (Navi Mumbai) Key responsibilities needed: • Cloud infrastructure expert – He/She should know how to use well architected review framework, should have managed various applications/ infrastructure • Should be expert in infrastructure...

  • GCP Cloud Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Bajaj Technology Services Full time

    We are looking for immediate joiner for below position.GCP Cloud EngineerExp :: 7 to 10 YearsLocation :: Airoli (Navi Mumbai)Key responsibilities needed:• Cloud infrastructure expert – He/She should know how to use well architected review framework, should have managed various applications/ infrastructure• Should be expert in infrastructure creation,...

  • GCP Cloud Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Bajaj Technology Services Full time

    We are looking for immediate joiner for below position.GCP Cloud EngineerExp :: 7 to 10 YearsLocation :: Airoli (Navi Mumbai)Key responsibilities needed:• Cloud infrastructure expert – He/She should know how to use well architected review framework, should have managed various applications/ infrastructure • Should be expert in infrastructure creation,...

  • Gcp Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Rigvedit Full time

    Job Description- We are looking for a skilledGCP Cloud Engineerwith a minimum of 5+ years of hands-on experience in designing, implementing, and managing cloud infrastructure onGoogle Cloud Platform (GCP). The ideal candidate must have strong expertise inTerraformfor infrastructure as code (IaC) and should be well-versed with GCP-native services, cloud...

  • GCP Data Processing Expert

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time

    As a seasoned data engineer, you will play a pivotal role in designing and deploying scalable data processing systems on Google Cloud Platform. Your expertise in big data technologies and frameworks will enable our organization to efficiently process and store large volumes of data.The ideal candidate will have a strong understanding of GCP services such as...

  • GCP Cloud Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Bajaj Technology Services Full time

    We are looking for immediate joiner for below position. GCP Cloud Engineer Exp :: 7 to 10 Years Location :: Airoli (Navi Mumbai) Key responsibilities needed: • Cloud infrastructure expert – He/She should know how to use well architected review framework, should have managed various applications/ infrastructure • Should be expert in infrastructure...

  • Cloud Data Engineering Specialist

    14 hours ago

    Navi Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Cloud Data Engineering Specialist">We are seeking an experienced Cloud Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience in Google Cloud Platform (GCP), SQL, Python, and PySpark.Key Responsibilities:","1. Design, develop, and maintain scalable data pipelines using GCP...

  • Cloud Data Solutions Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India beBeeDataengineering Full time

    About the Role:We are seeking an experienced Cloud Data Solutions Engineer to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience in Google Cloud Platform (GCP), SQL, Python, and PySpark.Responsibilities:Design, develop, and maintain scalable data pipelines using GCP services such as BigQuery,...