Senior Cloud Data Engineering Specialist

2 weeks ago

Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Overview

We are seeking an experienced GCP Data Engineer to lead our data engineering initiatives. This role will involve designing, developing, and maintaining scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN.

Key Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines and ETL processes using GCP services.
  • Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Data Integration: Implement data integration solutions to ingest, process, and store large volumes of structured and unstructured data from various sources.
  • Performance Optimization: Optimize and tune data pipelines for performance, reliability, and cost-efficiency.
  • Data Quality Assurance: Ensure data quality and integrity through data validation, cleansing, and transformation processes.
  • Data Modeling: Develop and maintain data models, schemas, and metadata to support data analytics and reporting.
  • Troubleshooting: Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to data workflows.
  • Professional Development: Stay up-to-date with the latest GCP technologies and best practices, and provide recommendations for continuous improvement.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 4 to 6 years of experience in data engineering, with a strong focus on GCP.
  • Proficiency in GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN.
  • Strong programming skills in Python, PLSQL.
  • Experience with SQL and NoSQL databases.
  • Knowledge of data warehousing concepts and best practices.
  • Familiarity with data integration tools and frameworks.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work in a fast-paced, dynamic environment.

  • Senior Data Engineer

    2 weeks ago

    Belgaum, Karnataka, India beBeeAirflowExpert Full time ₹ 15,00,000 - ₹ 19,00,000

    Senior Data Engineer - Airflow ExpertWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of robust data pipelines using Airflow.The ideal candidate will have in-depth knowledge of Python, with experience in data engineering and cloud-based data warehousing solutions.Key responsibilities include:Designing and developing...

  • Cloud Data Specialist

    1 week ago

    Belgaum, Karnataka, India beBeeCloudDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Opportunity: Cloud Data SpecialistExperience the thrill of working on a scrum team as a full-stack engineer.Design and develop scalable software modules that meet customer requirements while upholding high standards of reliability, security, maintainability, and performance.Collaborate with peers in defining product technical architecture.Deliverables...

  • Senior Cloud Data Architect

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 40,00,000

    Lead Data Engineering ExpertWe are seeking a highly experienced and skilled Senior Data Engineering Lead with expertise in Databricks and cloud-based data engineering to lead our data engineering team.This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines while mentoring and inspiring a team...

  • Senior Cloud Data Specialist

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Data EngineerAbout the Role:We are seeking a seasoned data engineer with hands-on expertise in crafting scalable data pipelines on Google Cloud Platform. This role involves collaborating closely with cross-functional teams to identify and deliver efficient solutions that meet our data-driven needs.Main Responsibilities:Design, develop, and...

  • Senior Cloud Data Specialist

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 17,50,000

    Job DescriptionWe are seeking a Senior Data Engineer to support a large financial institution in modernizing their platform and going through the architecture, ingestion and ETL process based on requirements.This role will be responsible for designing data pipelines, orchestrating workflows, processing data, managing datasets and integrating with various...

  • # Cloud-Based Data Engineering Expert

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Senior Data Engineer Position Overview**We are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and optimizing scalable data pipelines on AWS.The ideal candidate will have strong programming skills in Python and/or Scala, hands-on experience with...

  • Data Engineering Specialist

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistJob Summary:We are seeking an experienced data engineering specialist to join our team. The ideal candidate will have a strong background in data engineering and experience with Google Cloud Platform.The successful candidate will be responsible for developing, constructing, testing and maintaining large-scale data acquisition...

  • Senior Cloud Data Engineer

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering LeadWe are seeking a seasoned data engineering professional to lead our multi-year data engineering projects and teams. This is a unique opportunity for an individual with exceptional technical expertise, leadership skills, and business acumen.The ideal candidate will have a deep understanding of cloud and big data technologies, as well as...

  • Data Engineering Solutions Specialist

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineering Solutions SpecialistJob Summary:We are seeking an experienced Data Engineering Solutions Specialist to design, develop and maintain large-scale data engineering solutions using Azure Databricks.Main Responsibilities:Develop and implement ETL (Extract, Transform, Load) processes to integrate data from various sources.Design and implement data...

  • Cloud Data Architect Specialist

    7 days ago

    Belgaum, Karnataka, India beBeeDataArchitecture Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Cloud Data Architect SpecialistWe are seeking a highly skilled Cloud Data Architect Specialist with expertise in designing and implementing scalable data architectures on Google Cloud Platform (GCP).The ideal candidate has hands-on experience with cloud-based data pipelines, data storage solutions, and data orchestration tools.Data Architecture...