Databricks Data Ingestion Specialist

1 week ago


Thiruvananthapuram, Kerala, India beBeeDataIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Databricks Data Ingestion Specialist

We are seeking a skilled data ingestion specialist to join our team. As an expert in designing and developing efficient data pipelines, you will play a key role in integrating multiple sources into Databricks.

This is an exciting opportunity for individuals who are passionate about working with big data, cloud platforms, and cutting-edge technologies such as Kubernetes, CI/CD tools, and container orchestration.

  • Design and develop efficient data ingestion pipelines to integrate multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.

To succeed in this role, you will need to have hands-on experience with data pipelines, automation, and infrastructure management, as well as a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.

In this role, you will be responsible for designing and implementing data ingestion solutions that meet business requirements. You will work closely with cross-functional teams to ensure seamless integration of data from various sources into Databricks.

Your expertise in data ingestion will enable us to make data-driven decisions and drive business growth. If you are passionate about working with big data and are looking for a challenging role, we encourage you to apply.

Required Skills and Qualifications
  • Hands-on experience with data pipelines, automation, and infrastructure management.
  • Strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.
  • Experience with Kubernetes, CI/CD tools, and container orchestration.
  • Ability to design and implement efficient data ingestion pipelines.
Benefits

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development.

Others

If you are a motivated and experienced data ingestion specialist, we encourage you to apply for this exciting opportunity.



  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    As a senior data integration specialist, you will be responsible for designing and developing data pipelines to integrate multiple sources into Databricks. This role requires a strong understanding of data ingestion processes focusing on scalability and efficiency.


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a highly skilled Data Architect to design and implement scalable, high-performance data solutions using Databricks.The ideal candidate will have hands-on experience in Databricks production environments and a deep understanding of modern data architecture.As a key member of our team, you will work closely with cross-functional...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our advanced analytics team.The successful candidate will be responsible for managing the existing cloud data platform, making it more scalable, reliable, and cost-efficient.This is an excellent opportunity for individuals who are passionate about leveraging big...

  • Cloud Data Engineer

    5 days ago


    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ProfessionalAbout the RoleWe are seeking a highly skilled data engineering professional to design, develop, and optimize data pipelines and integration solutions in the cloud.Main Responsibilities:Design and develop advanced ETL pipelines for batch data ingestion and egress using Azure services.Create scalable data solutions...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking an experienced professional to work on data engineering projects involving Azure Data Factory, Databricks, and PySpark.Key Responsibilities:Mastery in data integration, transformation, and processing using AWS/Azure/SAP and ELT (Extract, Load, Transform)Proficiency in data modeling, data ingestion, and manipulationHands-on...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Engineer Job DescriptionJob Summary:The Senior Data Engineer will design, build, and maintain large-scale data systems to support business growth. This role requires a strong understanding of data modeling, SQL, ETL, and data warehousing.Key Responsibilities:Develop and implement data lakes using Azure Data Factory, Spark, and Azure...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Insights SpecialistWe are seeking a skilled Data Analyst to join our team. As a senior member, you will be responsible for gathering, analyzing, and interpreting large datasets to deliver actionable business insights.Key Responsibilities:Gathering and analyzing large datasets to deliver actionable business insights.Writing efficient SQL and...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer Test SpecialistJob Summary:•We are seeking a highly skilled Data Engineer Test Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.Responsibilities:•Develop and execute comprehensive test plans to ensure...


  • Thiruvananthapuram, Kerala, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Web Scraping EngineerWe are seeking a highly skilled web scraping engineer to build a high-throughput product data ingestion pipeline across hundreds of domains.The ideal candidate will have 4+ years of Python experience, including 2+ years building production web crawlers at scale. Design an HTTP-first crawler with Playwright fallback only...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000

    About the RoleWe are seeking an experienced Cloud Infrastructure Specialist to join our team. As a key member of our cloud services department, you will be responsible for designing and implementing robust data pipelines and scalable data lakes.Key Responsibilities:Design, develop, and maintain scalable ETL pipelines using cloud-native tools such as AWS DMS,...