Data Ingestion Engineer

1 day ago

Jaipur, Rajasthan, India beBeeEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

We are seeking an experienced professional to lead the development of data ingestion pipelines into Databricks.

This role requires a strong understanding of data integration processes, focusing on integrating various data sources into Databricks. We are looking for someone with hands-on experience in designing and implementing efficient data workflows.

The ideal candidate will have expertise in developing data pipelines, automating tasks, and managing infrastructure to support scalable data ingestion workflows.

Key Responsibilities:

  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with cross-functional teams to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (e.g., GitHub Actions, Jenkins, Azure DevOps).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.

Preferred Qualifications:

  • Experience with Infrastructure as Code (IaC) tools like Terraform or Helm.
  • Background in streaming data ingestion using technologies like Kafka or Kinesis.
  • Knowledge of data governance and security best practices.

  • Data Engineer

    4 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data EngineerJob Location – JaipurJob Type – PermanentExperience Required YearsAs a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure. You will work closely with our data scientists, analysts, and other stakeholders to ensure data is accurate, timely, and accessible....

  • Data Platform Engineer

    2 weeks ago

    Jaipur, Rajasthan, India CloudNuro Full time

    Location: Bengaluru or Pune preferred, hybrid work model We are on the cusp of a major transformation in our data capabilities, and we are looking for a hands-on Data Platform Engineer to help lead the way. Working alongside a Staff Data Architect and Engineer, you will play a key role in designing and setting up the next generation of our lakehouse and...

  • Data Governance Expert

    5 days ago

    Jaipur, Rajasthan, India beBeeDataGovernance Full time US$ 1,50,000 - US$ 2,10,000

    Platform ArchitectWe are seeking a skilled and proactive Platform Architect to lead the implementation and operational excellence of a scalable, multitenant modern data platform.The ideal candidate will have experience working with Snowflake and AWS cloud services, as well as a solid understanding of data governance principles.Key Responsibilities:Lead the...

  • Data Engineer

    5 days ago

    Jaipur, Rajasthan, India Celebal Technologies Full time

    Job Role – Data Engineer Job Location – Jaipur Job Type – Permanent Experience Required- (2-4) Years As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure. You will work closely with our data scientists, analysts, and other stakeholders to ensure data is accurate, timely,...

  • Data Architecture Specialist

    2 days ago

    Jaipur, Rajasthan, India beBeeCloud Full time ₹ 18,00,000 - ₹ 25,20,000

    About usWe are a company that believes data and analytics drive future success.Job OverviewWe are building a world-class analytics practice and seeking a skilled Cloud Data Engineer to manage our cloud data platform, making it scalable, reliable, and cost-efficient.Responsibilities:Analyze existing data warehouse implementations for migration and...

  • High-Performance Data Specialist

    21 hours ago

    Jaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a skilled data engineer to join our team at a leading organization. The ideal candidate will have a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP.The role involves designing, developing, and optimizing data ingestion, transformation, and governance frameworks,...

  • Freelance Senior Databricks Data Engineer

    2 weeks ago

    Jaipur, Rajasthan, India ThreatXIntel Full time

    Company Description ThreatXIntel is a startup cyber security company that specializes in protecting businesses and organizations from cyber threats. Our team offers services in cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized and affordable solutions to meet the specific needs of our clients,...

  • Cloud Data Engineering Expertise

    3 days ago

    Jaipur, Rajasthan, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineers with Azure expertise shape the future of pharmaceutical supply chains by leveraging cutting-edge technology to transform data into actionable insights.We seek a seasoned professional with 5+ years of experience in designing, building, and maintaining scalable data pipelines using Azure Data Factory, Synapse Analytics, and Data Lake...

  • Data Governance Expert

    21 minutes ago

    Jaipur, Rajasthan, India beBeeDataGovernance Full time ₹ 15,00,000 - ₹ 17,50,000

    Data Governance SpecialistWe are seeking an experienced Data Governance Specialist to develop, optimize and maintain automated data pipelines that support our organization’s data governance and analytics initiatives. This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing,...

  • Software Engineer with Geographic Data Processing Expertise

    1 day ago

    Jaipur, Rajasthan, India beBeeExpertise Full time US$ 2,00,000 - US$ 2,50,000

    Job Title: Software Engineer - Geo Data Expertise">Job Description:We are seeking an experienced software engineer with expertise in geographic data processing to join our team. The ideal candidate will have a strong background in developing and deploying geo-data intensive applications using Python-based backend development.The selected candidate will be...