Lead Data Engineering Specialist

5 days ago


Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Data Engineer Position Overview

Job Summary:

We are seeking an experienced Data Engineer to develop and implement large-scale data acquisition pipelines using Google Cloud Platform tools.

The ideal candidate will have a strong background in developing, constructing, testing, and maintaining complex data pipelines.

Key Responsibilities
  • Develop and implement data pipelines using Google Cloud Platform tools such as Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.
  • Design and build large and complex datasets based on business requirements.
  • Construct 'big data' pipeline architecture and identify opportunities for data acquisition through collaboration with stakeholders and business clients.
  • Translate business needs into technical requirements and leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.
  • Design and build an ingestion pipeline using REST API.
Requirements
  • A minimum of 4 years of experience in a GCP data engineering role.
  • At least 1 year of hands-on experience in GCP tools highlighted including Python, SQL, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.
This is a critical role that requires a strong understanding of data engineering principles and Google Cloud Platform tools. If you have experience in developing and implementing large-scale data pipelines, we encourage you to apply.

  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 24,00,000 - ₹ 40,00,000

    Job Title: Data Engineering SpecialistWe are seeking a seasoned data engineering specialist to lead our organization's data warehousing, big data, and data analytics initiatives.Total years of experience: 9+ Years required for this position.The ideal candidate should have extensive skills and success in the implementation of technology projects within a...


  • Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer SpecialistWe are seeking a highly skilled individual to design, develop, and optimize data pipelines and integration solutions in a cloud-based environment.


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking an experienced Data Engineer with hands-on expertise in Python and Pyspark to join our team. As a key member, you will be responsible for implementing a data-driven solution for a large retailer.Required Skills & Qualifications:5+ years of experience as a Data EngineerExpertise in Python,...

  • Data Engineering Lead

    2 weeks ago


    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Data Engineering LeadJob Description: We are seeking a talented data engineering lead to develop and implement cutting-edge data pipelines using Python.Key Responsibilities:1. Collaborate with cross-functional teams to design and deploy data-driven solutions that drive business growth.2. Ensure high-quality data processing and analytics services...


  • Hubli, Karnataka, India beBeeProgram Full time ₹ 15,00,000 - ₹ 21,00,000

    Job TitleWe are seeking a seasoned Technical Program Manager to oversee and deliver complex data engineering projects. This individual will lead cross-functional teams, ensuring seamless collaboration and alignment with business objectives.The ideal candidate will possess a deep understanding of data pipelines ETL/ELT and analytics workflows. They will work...


  • Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Cloud Data Engineering Specialist">We are seeking an experienced Cloud Data Engineering Specialist to design, build, and optimize scalable data pipelines and architectures on Google Cloud Platform (GCP).Key Responsibilities:Design and implement highly scalable, reliable, and secure data pipelines on GCP using GCS, BigQuery, and Airflow.Develop robust ETL/ELT...


  • Hubli, Karnataka, India beBeeAutomation Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Automation ProfessionalWe are seeking a highly skilled and experienced data automation specialist to deliver high-quality solutions.As a data automation expert, you will be responsible for designing and implementing automation frameworks to test large-scale enterprise applications. Your expertise in data engineering, data warehouse testing, and quality...


  • Hubli, Karnataka, India beBeeDataSpecialist Full time ₹ 10,00,000 - ₹ 14,00,000

    Senior Data SpecialistWe are seeking a highly skilled data professional to lead the design, development, and maintenance of large-scale data processing systems.Collaborate with cross-functional teams to identify business requirements and implement data solutions that meet those needs.Ensure data quality, integrity, and security by implementing robust data...


  • Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Lead Data Engineering ExpertWe are seeking a seasoned Data Engineer(Lead) to join our team and spearhead the design, development, and optimization of complex data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.This role requires 6+ years of experience in data engineering or cloud computing data development. The ideal candidate will...


  • Hubli, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 1,20,000

    Job Title:Key Responsibilities of a Senior Data SpecialistOverview:Design and implement data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue.As a senior data specialist, you will be responsible for developing and maintaining large-scale data systems that support business analytics and reporting requirements.Requirements:7+...