
Data Ingestion Expert Wanted
1 week ago
We are seeking an experienced Azure Databricks Engineer with expertise in data ingestion to join our team. The ideal candidate will have hands-on experience with designing, developing, and optimizing data pipelines for integrating multiple sources into Databricks.
This role requires a strong understanding of data ingestion processes, focusing on automating workflows and ensuring scalable data management.
The successful candidate will also have experience with Kubernetes, container orchestration, and cloud platforms such as AWS, Azure, or GCP. Proficiency in Python, Scala, or SQL for data processing is also required.
In addition, we are looking for someone with strong problem-solving and analytical skills, who can troubleshoot and optimize ingestion pipelines for performance and scalability.
- Design and develop highly efficient data ingestion pipelines.
- Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines for data workflows.
- Deploy and manage containerized applications using Kubernetes.
- Ensure data integrity, security, and compliance throughout the ingestion process.
-
Data Ingestion Specialist
3 days ago
Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Data Ingestion SpecialistWe are seeking a skilled Data Ingestion Specialist to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires expertise in CI/CD and Kubernetes, with a strong understanding of data ingestion processes and integration with cloud platforms.The ideal candidate...
-
Chief Data Engineer
5 days ago
Bellary, Karnataka, India beBeeDataDriven Full time ₹ 10,00,000 - ₹ 15,00,000Senior AWS Glue Developer PositionA forward-thinking Senior AWS Glue Developer is required to lead our data ingestion and transformation efforts.We are looking for a skilled professional to design and build metadata-driven integration systems that support rapid onboarding of new services.In this role, you will work with our team to develop a data-centric...
-
Senior Data Integration Engineer
6 days ago
Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Ingestion SpecialistWe are seeking an experienced Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for...
-
Chief Data Architect
4 days ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining data pipelines for ingestion, transformation, and storage of large-scale data. Your expertise in Big Data technologies and experience with ETL processes will enable us to process structured and unstructured data efficiently.In this role, you will work closely with data...
-
Data Pipeline Architect
1 week ago
Bellary, Karnataka, India beBeeDataPipeline Full time ₹ 8,00,000 - ₹ 15,00,000Job Title: Data Pipeline ArchitectKey Responsibilities:We're seeking an experienced Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.The successful candidate will implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...
-
Expert eBPF Engineer Wanted
6 days ago
Bellary, Karnataka, India beBeesystem Full time ₹ 80,00,000 - ₹ 1,20,00,000Expert eBPF Engineer WantedWe seek a skilled engineer to build, maintain and troubleshoot complex systems.Main Responsibilities:Manage system performance for optimal availability.Maintain operating systems for stability and security.Analyze application performance for improvement opportunities.Required Qualifications:Bachelor's degree in Computer Science or...
-
Data Governance and Metadata Expert
5 days ago
Bellary, Karnataka, India beBeeMetadata Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Metadata Specialist JobWe are seeking an experienced Metadata Specialist to join our team. The ideal candidate will have expertise in metadata management and data governance principles.Develop a solid understanding of metadata ingestion and data lineage stitching using Collibra Data Intelligence Platform.Configure and customize workflows for efficient...
-
Chief Data Infrastructure Specialist
1 day ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,50,00,000Key Objectives:Develop and Implement Data Infrastructure: Design, develop, and maintain scalable data pipelines using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN.Collaborate with Data Experts: Collaborate with data scientists, analysts, and other stakeholders to understand data...
-
Principal Data Engineering Manager
1 hour ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 23,00,000Job SummaryWe are seeking an experienced data engineering leader to develop a scalable data ingestion framework, ensuring high data quality and validation.The ideal candidate will have 7+ years of experience in AWS, Python, and PySpark, with a strong background in designing and developing end-to-end data ingestion frameworks.
-
AWS Data Engineer – Oil
4 days ago
Bellary, Karnataka, India DigiHelic Solutions Pvt. Ltd. Full timeJob Title: AWS Data Engineer – Oil & Gas DomainLocation: Offshore/ REMOTEExperience: 5+ years Experienced AWS Data Engineer with Oil & Gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering and knowledge of Oil & Gas upstream,...