Data Ingestion Specialist

2 weeks ago

India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title:

Data Ingestion Specialist

This role involves the design, development, and optimization of data ingestion pipelines for integrating multiple sources into a cloud-based data platform.

  • The ideal candidate will have expertise in continuous integration/continuous deployment (CI/CD) tools and container orchestration using Kubernetes.
  • Strong knowledge of big data technologies such as Databricks, Spark, and data lake architectures is also required.
  • Proficiency in programming languages like Python, Scala, or SQL for data processing is essential.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP is also desirable.
Key Responsibilities:
  • Design and develop data ingestion pipelines for integrating various data sources into the cloud-based data platform.
  • Implement and maintain CI/CD pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with data engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools such as GitHub Actions, Jenkins, or Azure DevOps.
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
  • Preferred qualifications include experience with infrastructure as code tools like Terraform or Helm, background in streaming data ingestion, and knowledge of data governance and security best practices.

  • Data Ingestion Specialist

    1 week ago

    India beBeeDataIngestion Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Ingestion SpecialistDescription:The role of a Data Ingestion Specialist is to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks. This involves working closely with the Data Engineering team to ensure seamless data flow and efficient ingestion workflows.Responsibilities:Design and implement...

  • Senior Data Ingestion Specialist

    2 weeks ago

    India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our organization.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...

  • Cloud Data Ingestion Specialist

    2 weeks ago

    India beBeeDataIngestion Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Cloud Data Ingestion SpecialistOverview:We are seeking an experienced data ingestion specialist to join our team. This role requires a strong understanding of cloud-based data ingestion processes, focusing on integrating various data sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for integrating...

  • Ingestion Engineer

    4 days ago

    India Saxon Global Full time

    Hi Hope you are doing good today!!! Kindly go through the JD and let me know your interest you can reach me at Title: Ingestion Engineer Opportunity Available for Immediate Joining Location - Anywhere from India TIMINGS - 10.00 AM IST to 7.00 PM IST Need good comm skills – they will be coordinating with Americans on daily bases We are...

  • Ingestion Engineer

    4 days ago

    India Saxon Global Full time

    Hi Hope you are doing good today!!!Kindly go through the JD and let me know your interest you can reach me at SAI.K@SAXONGLOBAL.COMTitle: Ingestion Engineer Opportunity Available for Immediate Joining Location - Anywhere from India TIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are...

  • Data Ingestion Specialist with Expertise in CI/CD and Kubernetes

    2 weeks ago

    India beBeeIngestion Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title:Azure Databricks Engineer with Injection ExperienceLocation: Remote (India)Duration: 6 Months, Extendable to 1 Year+Time: 10 AM - 7 PM ISTKey Responsibilities:Design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain Continuous Integration/Continuous Deployment pipelines for data...

  • Urgent Search! Ingestion Engineer

    3 days ago

    India Saxon Global Full time

    Hi Hope you are doing good today!!! Kindly go through the JD and let me know your interest you can reach me at SAI.K@SAXONGLOBAL.COM Title: Ingestion Engineer Opportunity Available for Immediate Joining Location - Anywhere from India TIMINGS - 10.00 AM IST to 7.00 PM IST Need good comm skills – they will be coordinating with Americans on daily...

  • Senior Product Data Ingestion Specialist

    1 week ago

    India beBeeCrawler Full time ₹ 15,00,000 - ₹ 28,00,000

    High-Performance Web Crawling Engineer">We are looking for an experienced engineer to build a high-throughput product data ingestion pipeline across hundreds of domains. The successful candidate will own the crawling/extraction layer end-to-end, designing and implementing an HTTP-first crawler with a Playwright fallback for JavaScript-heavy pages.">The role...

  • Only 24h Left: Ingestion Engineer

    2 weeks ago

    India Saxon Global Full time

    HiHope you are doing good todayKindly go through the JD and let me know your interest you can reach me at SAI.K@SAXONGLOBAL.COMTitle: Ingestion Engineer Opportunity Available for Immediate JoiningLocation - Anywhere from IndiaTIMINGS - 10.00 AM IST to 7.00 PM ISTNeed good comm skills – they will be coordinating with Americans on daily basesWe are seeking...

  • Collibra Specialist

    3 days ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Collibra Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: . Produce data mapping...