Data Ingestion Specialist

2 days ago


Bengaluru, Karnataka, India beBeeDataExpert Full time ₹ 80,00,000 - ₹ 1,50,00,000
Job Description

  • Data Pipeline Management and Validation
    • Build and manage ingestion workflows using Spark, Hive, Trino, and Kafka.
    • Validate data ingestion, debug pipeline outputs, and support delta loads.
    • Create and schedule Airflow DAGs for recurring ingestion processes.
  • Automation and Scripting Expertise
    • Utilize Python and Bash (or PowerShell) to automate ingestion validations.
    • Implement monitoring scripts for ingestion health and trigger alerts.
  • Environment Readiness Preparation


  • Bengaluru, Karnataka, India beBeeIngestion Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Title:Databricks Ingestion SpecialistWe are seeking an experienced Databricks ingestion specialist with expertise in CI/CD and Kubernetes to design, develop, and optimize data ingestion pipelines.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Join Our Data Engineering TeamWe are seeking a skilled Associate Software Engineer II to join our data engineering team. As a key member of our team, you will play a crucial role in developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions.This is an exciting opportunity to work with cutting-edge technology and...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. This role will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Data Ingestion: Develop and implement data ingestion pipelines using Azure Databricks (ADB) and Azure Data Factory...


  • Bengaluru, Karnataka, India beBeeBackend Full time ₹ 80,00,000 - ₹ 1,40,00,000

    Backend EngineerWe are seeking a skilled Backend Engineer to join our team.The ideal candidate will have experience in writing clean, maintainable code and be able to explain technical concepts to both technical and non-technical stakeholders.This is an exciting opportunity for a talented engineer to take on new challenges and contribute to the growth of our...


  • Bengaluru, Karnataka, India beBeeDataQuality Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Quality Assurance SpecialistOverview We are seeking an experienced Data Quality Assurance Specialist to join our team. In this role, you will be responsible for developing and executing test strategies focused on data pipelines, including ingestion, transformation, storage, and retrieval.Key Responsibilities: 1. Develop and execute test plans...


  • Bengaluru, Karnataka, India beBeePentaho Full time ₹ 9,00,000 - ₹ 12,00,000

    Pentaho Data Integration SpecialistAs a key member of our team, you will be responsible for designing, developing, and implementing end-to-end Business Intelligence (BI) solutions using Pentaho Data Integration.Key Responsibilities:Data Ingestion and Processing: Develop expertise in ETL processes and data transformation using Pentaho Data Integration...


  • Bengaluru, Karnataka, India beBeeDataGovernance Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Data Governance Specialist to join our team. As a Data Governance Specialist, you will be responsible for managing and maintaining metadata across our organization.Key responsibilities include:Metadata ingestion: Collecting and storing metadata from various sources into Collibra Data Intelligence PlatformData lineage...


  • Bengaluru, Karnataka, India beBeeDataTransformation Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title: Data Transformation SpecialistDescription:We are seeking a skilled Data Transformation Specialist to join our team. In this role, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.You will have the opportunity to work on complex data transformations, ingestion, and processing logic,...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:AWS Data Engineering SpecialistJob Description:We are seeking a highly skilled AWS Data Engineer to design, build and optimize large-scale data pipelines and analytics platforms. The ideal candidate will have strong hands-on expertise in AWS Glue, Athena, Redshift, PySpark, and SQL, with a solid understanding of data engineering and data...


  • Bengaluru, Karnataka, India beBeeDataInfrastructure Full time ₹ 16,00,000 - ₹ 20,00,000

    Job Title: Data Infrastructure SpecialistAs a seasoned data infrastructure specialist, you will play a pivotal role in developing and implementing robust ETL/ELT processes that ingests, transform and integrate data from multiple sources into our enterprise data platform.Key Responsibilities:Design and build scalable and secure data pipelines utilizing AWS...