Cloud Data Engineering Specialist

1 day ago

Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title:

GCP Data Engineer Position

Role Overview:

We are seeking a highly skilled data engineer to design, build, and maintain large-scale data pipelines in Google Cloud Platform (GCP). As a key member of our team, you will be responsible for developing, constructing, testing, and maintaining data acquisition pipelines for large volumes of structured and unstructured data using GCP services.

Responsibilities:

  • Develop complex datasets based on business requirements.
  • Construct 'big data' pipeline architecture using GCP services such as Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.
  • Identify opportunities for data acquisition via working with stakeholders and business clients.
  • Translate business needs to technical requirements.
  • Leverage a variety of tools in the GCP Ecosystem such as Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines.
  • Use logs & alerts to effectively monitor pipelines.
  • Use SAP SLT to replicate SAP tables to GCP using SLT.
  • Develop JSON messaging structure for integrating with various applications.
  • Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.
  • Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data.
  • Use roles to secure access to datasets, authorized views to share data between projects.
  • Design and build an ingestion pipeline using Rest API.
  • Recommends ways to improve data quality, reliability, and efficiency.

Requirements:

  • 5-7 years of experience in a data engineering role – with core GCP experience of 3-4 years.
  • Ability to work in a distributed team environment with minimal supervision.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and interpersonal skills.

  • Cloud Data Engineering Specialist

    2 days ago

    Vadodara, Gujarat, India beBeeProficiency Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineering SpecialistAbout Our Vision:We aim to be a leader in digital transformation, driving clients' success through advanced engineering expertise and innovative solutions.Our Mission:Empowering clients to achieve their goals and unlock new growth opportunities by providing cutting-edge cloud services.Mandatory Skills:ELT Expertise,...

  • Cloud Data Engineer Specialist

    1 week ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data Engineer SpecialistPosition Overview:We are seeking a highly skilled Cloud Data Engineer to play a key role in our data-driven organization. The ideal candidate will have a strong background in data engineering, cloud computing, and software development.Key Responsibilities:Collaborate with the data science team to design and implement complex...

  • Senior Data Engineer

    7 days ago

    Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 18,35,000 - ₹ 23,40,000

    Job Title: Senior Data Engineer - Cloud Services Specialist We are seeking a highly skilled Senior Data Engineer to design and develop high-performance data pipelines using AWS cloud services and Databricks. This role involves building scalable ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML,...

  • Cloud Data Engineering Specialist

    23 hours ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Cloud Data Engineer RoleA cloud data engineer plays a crucial role in designing and implementing scalable data pipelines, ensuring seamless data flow across various systems.

  • Cloud Data Engineer

    2 days ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 23,00,000

    Cloud Data EngineerJob Title: Cloud Data EngineerAbout the Role:We are seeking a highly skilled and experienced Cloud Data Engineer to join our team.

  • Data Engineering Specialist

    2 weeks ago

    Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opportunity: Data Engineering SpecialistAt our organization, we are currently seeking an experienced data engineering specialist to lead the design, development, and optimization of ETL pipelines. The ideal candidate will possess strong programming skills in Python and Scala, with hands-on experience working with Spark (PySpark & Scala Spark)....

  • Cloud Data Engineer

    2 days ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineer Opportunity">We are seeking a skilled Cloud Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining scalable data processing systems on Google Cloud Platform.As a Cloud Data Engineer, you will collaborate with cross-functional teams to ensure data is accessible, reliable, and...

  • Cloud Engineering Specialist

    1 day ago

    Vadodara, Gujarat, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Cloud Engineering Specialist to join our team. The ideal candidate will have deep expertise in cloud infrastructure, automation tooling, and CI/CD orchestration.The successful candidate will be instrumental in designing, implementing, and maintaining scalable, secure, and resilient cloud-native systems....

  • Cloud Data Engineering Specialist

    7 days ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a seasoned Data Engineer to spearhead the development and implementation of data processing systems using GCP services such as BigQuery and Cloud Storage.Key Responsibilities:Design and develop data processing pipelines leveraging cloud-based technologies.Collaborate with cross-functional teams to identify business requirements and deliver...

  • Leading Cloud Data Engineering Specialist

    23 hours ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 28,00,000 - ₹ 32,00,000

    Cloud Data Engineer PositionAt Jade Business Services, we are seeking a seasoned data engineer with expertise in building robust data pipelines on the Google Cloud Platform. The ideal candidate will have a strong understanding of different file formats and be proficient in Python and SQL.We require a senior GCP data engineer with 10+ years of experience to...