
Data Ingestion Specialist
1 day ago
In this role, you will be responsible for designing and developing scalable data ingestion pipelines that integrate multiple sources into Databricks. Your expertise in CI/CD and Kubernetes will enable efficient and streamlined workflows.
Key Responsibilities:- Develop and maintain data ingestion pipelines using various tools and technologies
- Implement and manage CI/CD pipelines for data workflows
- Deploy and manage containerized applications using Kubernetes
- Ensure data integrity, security, and compliance throughout the ingestion process
- Collaborate with Data Engineers to optimize data ingestion strategies
- Troubleshoot and optimize ingestion pipelines for performance and scalability
- Proven experience in data ingestion and pipeline development
- Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps)
- Strong knowledge of Kubernetes and container orchestration
- Experience with Databricks, Spark, and data lake architectures
- Proficiency in Python, Scala, or SQL for data processing
- Familiarity with cloud platforms such as AWS, Azure, or GCP
-
Data Ingestion Specialist
4 days ago
Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Data Ingestion SpecialistWe are seeking a skilled Data Ingestion Specialist to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires expertise in CI/CD and Kubernetes, with a strong understanding of data ingestion processes and integration with cloud platforms.The ideal candidate...
-
Data Ingestion Expert Wanted
1 week ago
Bellary, Karnataka, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Expert Databricks Engineer NeededWe are seeking an experienced Azure Databricks Engineer with expertise in data ingestion to join our team. The ideal candidate will have hands-on experience with designing, developing, and optimizing data pipelines for integrating multiple sources into Databricks.This role requires a strong understanding of data ingestion...
-
Senior Data Integration Engineer
7 days ago
Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Ingestion SpecialistWe are seeking an experienced Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for...
-
Big Data Specialist
7 days ago
Bellary, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Big Data SpecialistThis is a key role for a seasoned professional to lead big data projects from start to finish. With 6-12 years of experience, you will be responsible for spearheading big data initiatives and driving business outcomes.Key Responsibilities:Develop innovative big data solutions using PySpark, Hive, Spark, HBase, and DQ tools.Lead agile scrum...
-
Cloud Data Solutions Specialist
3 days ago
Bellary, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Job Title: Cloud Data Solutions SpecialistA position in Bangalore, Karnataka, India as a full-time employee is available.Key Responsibilities:Develop real-time analytics using BigQuery and SQL Database writing queries.Design and implement data processing pipelines using Dataflow and Apache Airflow.Manage data storage using BigQuery and Cloud Storage.Ingest...
-
Data Governance and Metadata Expert
7 days ago
Bellary, Karnataka, India beBeeMetadata Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Metadata Specialist JobWe are seeking an experienced Metadata Specialist to join our team. The ideal candidate will have expertise in metadata management and data governance principles.Develop a solid understanding of metadata ingestion and data lineage stitching using Collibra Data Intelligence Platform.Configure and customize workflows for efficient...
-
Data Pipeline Architect
2 weeks ago
Bellary, Karnataka, India beBeeDataPipeline Full time ₹ 8,00,000 - ₹ 15,00,000Job Title: Data Pipeline ArchitectKey Responsibilities:We're seeking an experienced Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.The successful candidate will implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...
-
ETL Data Validation Specialist
6 days ago
Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: ETL TesterMain Responsibilities:Create and execute comprehensive test plans to validate data integrity across multiple levels in Databricks.Demonstrate expertise in verifying data transformations, ingestion, and processing logic.Show proficiency in crafting intricate SQL queries.The ideal candidate will possess a strong understanding of ETL...
-
Cloud Data Architect
14 hours ago
Bellary, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Cloud Data SpecialistWe are seeking a highly skilled cloud data specialist to design, develop and optimize data pipelines in the cloud. This role involves designing and developing advanced ETL pipelines for data ingestion and egress, as well as building scalable data solutions using Azure services such as Data Factory, Databricks and Spark.Key...
-
Cybersecurity Data Specialist
16 hours ago
Bellary, Karnataka, India beBeeCybersecurity Full time ₹ 25,00,000 - ₹ 30,50,000About This RoleWe are seeking a seasoned cybersecurity professional to join our team as a Cybersecurity Solutions Implementer. In this critical position, you will be responsible for developing custom parsers to extract and normalize data from diverse sources, including logs, network traffic, and endpoint data.As a key member of our security operations team,...