Data Ingestion Specialist

1 week ago

Pune, Maharashtra, India beBeeDataIngestion Full time US$ 1,20,000 - US$ 1,80,000
Job Title

A Data Ingestion Specialist is required to integrate multiple data sources into Databricks.

  • Key Responsibilities:
  • Design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Requirements
  • Essential Skills & Qualifications:
  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins or Azure DevOps.
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark and data lake architectures.
  • Proficiency in programming languages like Python, Scala or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure or GCP.
  • Strong problem-solving and analytical skills.
  • Desirable Qualifications:
  • Experience with Infrastructure as Code (Terraform, Helm etc.).
  • Background in streaming data ingestion (Kafka, Kinesis etc.).
  • Knowledge of data governance and security best practices.

  • Data Ingestion Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Transform Your Career with Data Ingestion ExpertiseAs a seasoned professional, you have the opportunity to advance your career by leveraging your technical skills in designing, testing, and implementing data ingestion pipelines. Our organization seeks an individual with hands-on experience in tools such as GCP Data Fusion, CDAP, or similar technologies.Key...

  • Expert in Real-Time Data Ingestion

    4 weeks ago

    Pune, Maharashtra, India beBeeDataIngestion Full time

    Real-Time Data Ingestion Expert ">We are looking for a highly skilled and adaptable professional to join our team as a Real-Time Data Ingestion Expert. This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. ">The ideal candidate will have a strong...

  • Real-Time Data Ingestion Platform Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Overview**We are seeking a highly skilled Staff Software Engineer to contribute to the development of our real-time data ingestion platform.This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. The ideal candidate will have a strong understanding...

  • Software Development Specialist Advisor

    1 week ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 336185NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Software Development Specialist Advisor to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Job...

  • Data Architect Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Data Architect SpecialistAs a skilled Data Architect Specialist, you will be responsible for designing and implementing scalable data pipelines to support business growth.The ideal candidate will have experience in ETL/ELT data pipeline design, SQL scripting, and Python programming. Familiarity with cloud services such as AWS Lambda, DMS, Glue, Snowflake,...

  • Data Pipeline Engineer

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Specialist - Data Pipeline EngineerAs a Big Data Specialist - Data Pipeline Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to efficiently curate and ingest data.Our ideal candidate will have strong SQL skills, experience with Fabric, and proficiency in programming languages such as Python (PySpark)....

  • Expert Data Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Your Potential as a Data ExpertJob DescriptionAs a Consultant Specialist ETL Engineer, you will develop and support new feeds ingestion, understand existing frameworks, and implement changes in Data Ingestion/Juniper within stipulated timelines.Develop and support new feeds ingestion/understand existing framework and do the development as per business...

  • Urgent Search Gcp, Api, Data Ingestion Patterns,solution Analyst

    2 weeks ago

    Pune, Maharashtra, India HSBC Full time

    Job descriptionSome careers shine brighter than othersIf youre looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you furtherHSBC is one of the largest...

  • Data Insights Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 7,00,000 - ₹ 11,00,000

    Data Insights SpecialistWe are seeking a detail-oriented Data Insights Specialist to support our cloud-based data solutions. The successful candidate will be responsible for data ingestion, transformation, and analysis, ensuring data quality and providing ongoing support for our solutions across multiple markets.The role involves managing the maintenance of...

  • Data Engineer

    5 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...