
Data Ingestion Specialist
3 days ago
We are seeking a skilled Data Ingestion Specialist to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
This role requires expertise in CI/CD and Kubernetes, with a strong understanding of data ingestion processes and integration with cloud platforms.
The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.
Key Responsibilities:- Design and implement data ingestion pipelines using Databricks and Spark.
- Develop and maintain CI/CD pipelines for data workflows using GitHub Actions or similar tools.
- Deploy and manage containerized applications using Kubernetes and Docker.
- Evaluate and ensure data integrity, security, and compliance throughout the ingestion process.
- Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
- Proven experience in data ingestion and pipeline development.
- Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps).
- Strong knowledge of Kubernetes and container orchestration.
- Experience with Databricks, Spark, and data lake architectures.
- Proficiency in Python, Scala, or SQL for data processing.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
-
Data Ingestion Expert Wanted
7 days ago
Bellary, Karnataka, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Expert Databricks Engineer NeededWe are seeking an experienced Azure Databricks Engineer with expertise in data ingestion to join our team. The ideal candidate will have hands-on experience with designing, developing, and optimizing data pipelines for integrating multiple sources into Databricks.This role requires a strong understanding of data ingestion...
-
Senior Data Integration Engineer
6 days ago
Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Ingestion SpecialistWe are seeking an experienced Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for...
-
Big Data Specialist
5 days ago
Bellary, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Big Data SpecialistThis is a key role for a seasoned professional to lead big data projects from start to finish. With 6-12 years of experience, you will be responsible for spearheading big data initiatives and driving business outcomes.Key Responsibilities:Develop innovative big data solutions using PySpark, Hive, Spark, HBase, and DQ tools.Lead agile scrum...
-
Cloud Data Solutions Specialist
1 day ago
Bellary, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Job Title: Cloud Data Solutions SpecialistA position in Bangalore, Karnataka, India as a full-time employee is available.Key Responsibilities:Develop real-time analytics using BigQuery and SQL Database writing queries.Design and implement data processing pipelines using Dataflow and Apache Airflow.Manage data storage using BigQuery and Cloud Storage.Ingest...
-
Data Governance and Metadata Expert
5 days ago
Bellary, Karnataka, India beBeeMetadata Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Metadata Specialist JobWe are seeking an experienced Metadata Specialist to join our team. The ideal candidate will have expertise in metadata management and data governance principles.Develop a solid understanding of metadata ingestion and data lineage stitching using Collibra Data Intelligence Platform.Configure and customize workflows for efficient...
-
Data Pipeline Architect
1 week ago
Bellary, Karnataka, India beBeeDataPipeline Full time ₹ 8,00,000 - ₹ 15,00,000Job Title: Data Pipeline ArchitectKey Responsibilities:We're seeking an experienced Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.The successful candidate will implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...
-
ETL Data Validation Specialist
5 days ago
Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: ETL TesterMain Responsibilities:Create and execute comprehensive test plans to validate data integrity across multiple levels in Databricks.Demonstrate expertise in verifying data transformations, ingestion, and processing logic.Show proficiency in crafting intricate SQL queries.The ideal candidate will possess a strong understanding of ETL...
-
Senior Data Analysis Specialist
7 days ago
Bellary, Karnataka, India beBeeSplunk Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About the RoleWe are seeking a seasoned Splunk Developer to lead our organization's data analysis initiatives.Key ResponsibilitiesDesign, develop, and implement interactive dashboards, alerts, and reports in Splunk.Enhance and refine existing queries, data ingestion processes, and indexing strategies.Collaborate with cross-functional teams to define...
-
Innovative Data Architect
5 days ago
Bellary, Karnataka, India beBeeSoftwareEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000Job SummaryWe are seeking a Senior Software Engineer/Technical Specialist to join our team. The ideal candidate will have a strong background in Azure Data Engineering, with experience in designing and implementing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.This role involves developing and optimizing data...
-
Data Pipeline Specialist
6 days ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Engineering Role OverviewWe are seeking a skilled Data Engineer to join our organization.As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines to ingest data from various sources into a data warehouse.Design and develop optimized data pipelines to extract data from databases and flat...