Lead Data Engineering Expert

3 days ago

Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000
Job Title: Lead Data Engineering Expert

We are seeking a seasoned Data Engineer(Lead) to join our team and spearhead the design, development, and optimization of complex data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.

  • This role requires 6+ years of experience in data engineering or cloud computing data development. The ideal candidate will have expertise in designing, building, and maintaining scalable ingestion and transformation workflows across cloud platforms.
  • Benchmark and maintain high-quality data lake and data warehouse solutions using AWS S3, Azure Data Lake, and AWS Glue.
  • The selected candidate will collaborate with data scientists, analysts, and application developers to support advanced analytics, reporting, and machine learning workflows.
  • Duties include job orchestration, monitoring, error handling for reliable pipeline execution, maintenance, and support of Data Pipeline operations.
  • Candidates must be able to monitor data load and perform data validation and quality checks.
  • A successful candidate will collaborate with customers to identify and optimize ingestion pipelines.
  • L2/L3 support for data-related issues is also required.
  • Analyze Glue job failures, restart, and resolve dependency failures in Glue workflows.
  • Tune job configurations and analyze impact on the overall system.

Requirements:

  • 6+ years of experience in data engineering or cloud computing data development.
  • Expertise in designing, building, and maintaining scalable ingestion and transformation workflows.
  • Familiarity with AWS Glue, Azure Data Factory, and Apache Spark.
  • Collaborative mindset to work with cross-functional teams.
  • Ability to monitor data load and perform data validation and quality checks.
  • Strong analytical and problem-solving skills.
  • Excellent communication and technical writing skills.

Benefits:

  • Competitive salary and benefits package.
  • Opportunities for career growth and professional development.
  • Collaborative and dynamic work environment.

  • Data Engineering Lead

    3 days ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Data Engineering LeadJob Description: We are seeking a talented data engineering lead to develop and implement cutting-edge data pipelines using Python.Key Responsibilities:1. Collaborate with cross-functional teams to design and deploy data-driven solutions that drive business growth.2. Ensure high-quality data processing and analytics services...

  • Data Engineering

    6 days ago

    Hubli, Karnataka, India beBeeInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Snowflake Developer & Infrastructure Integration ExpertWe're seeking a seasoned Snowflake Developer and Infrastructure Expert to lead full lifecycle implementations, from secure platform setup and cloud integration to high-performance data pipeline development.This role combines data engineering, infrastructure, and DevOps expertise to drive...

  • Ai Security Engineer

    24 hours ago

    Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...

  • Data Engineering Expert

    3 days ago

    Hubli, Karnataka, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Software Engineering SpecialistWe are looking for a skilled Software Engineering Specialist to join our team. This role involves developing and optimizing data engineering pipelines using various technologies.This position requires experience with Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will be responsible for designing scalable data...

  • Cloud Data Expert

    4 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Cloud Data Expert, you will be working on various projects and opportunities involving large-scale data processing systems.The role requires designing, building, and maintaining efficient data pipelines using Azure Data Factory, Azure Database, PySpark, and SQL. You will work closely with cross-functional teams to understand business needs and develop...

  • Azure Data and AI Expert

    5 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Azure Data ArchitectAs a subject matter expert in Azure data and AI, you will drive the technical depth and accuracy of our learning experiences. You will work closely with content creators to shape advanced, certification-aligned learning materials.This role requires deep hands-on experience in data engineering, machine learning engineering, and AI...

  • Data Science and Engineering Expert

    4 days ago

    Hubli, Karnataka, India beBeedataengineer Full time ₹ 12,00,000 - ₹ 14,40,000

    Data Engineer OpportunityWe are seeking a skilled Data Engineer to join our team on a contract basis.

  • Front End Engineering Expert

    5 days ago

    Hubli, Karnataka, India beBeefrontend Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Front End Engineering Expert">We're looking for an experienced professional to lead the development of cutting-edge web applications that power AI-driven workflows.Develop new features and UI components using React, Next.js, and Vite.Implement robust and scalable solutions utilizing ecosystem tools like React Query, Redux, Zustand, and state/data...

  • Cloud Data Governance Expert

    3 days ago

    Hubli, Karnataka, India beBeeDataGovernance Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data Governance ExpertWe are seeking a highly skilled Cloud Data Architect with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP).Key Responsibilities:Data Solution Design: Design and architect end-to-end data solutions on GCP, aligning with business and technical requirements.Data...

  • Data Engineer

    5 days ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    **Marketing Platform Specialist - Data Engineering Role**We seek a meticulous and inquisitive data engineer to craft high-resolution datasets in Snowflake that fuel analytics and machine learning across the business.As a key member of our team, you will focus on building real-time monitoring datasets to detect anomalies, pacing issues, and creative decay....