Databricks Ingestion Specialist
2 days ago
Job Title:
Databricks Ingestion SpecialistWe are seeking an experienced Databricks ingestion specialist with expertise in CI/CD and Kubernetes to design, develop, and optimize data ingestion pipelines.
The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.
Key Responsibilities:
- Design and develop data ingestion pipelines for integrating multiple sources into Databricks.
- Implement and maintain CI/CD pipelines for data workflows.
- Deploy and manage containerized applications using Kubernetes.
- Ensure data integrity, security, and compliance throughout the ingestion process.
- Collaborate with Data Engineers to streamline data ingestion strategies.
- Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
- Proven experience in data ingestion and pipeline development.
- Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
- Strong knowledge of Kubernetes and container orchestration.
- Experience with Databricks, Spark, and data lake architectures.
- Proficiency in Python, Scala, or SQL for data processing.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
Preferred Qualifications:
- Experience with Infrastructure as Code (Terraform, Helm, etc.).
- Background in streaming data ingestion (Kafka, Kinesis, etc.).
- Knowledge of data governance and security best practices.
-
Director of Engineering
1 week ago
Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year(P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...
-
Databricks Data Engineer
3 days ago
Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJD:Proficient in Databricks Data Engg. Knowledge in ETL concepts. Proficient in writing SQL queries, performance tuning. Knowledge in python script writing. Good Communication skill. Required Qualifications:1. Bachelor's degree in Computer Science, Information Technology, or a related field.2. 4 to 7 years of experience as a Data Engineer with a focus on...
-
DataBricks Consultant Hiring
4 days ago
Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 15,00,000 - ₹ 20,00,000 per yearBachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience). At least 2+ years of consulting or client service delivery experience on Azure At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server...
-
Databricks Consultant
2 weeks ago
Bengaluru, Karnataka, India GyanSys Inc. Full timeAbout GyanSys Inc. GyanSys Inc. is a leading global systems integrator headquartered in the U.S., specializing in SAP, Salesforce, Microsoft, and ServiceNow solutions. With over 2,000 consultants worldwide and 300+ enterprise clients, GyanSys is at the forefront of delivering digital transformation and business process automation across industries. Our...
-
Data Engineer-Databricks
4 weeks ago
Bengaluru, Karnataka, India Oracle Full timeLocation- Mumbai, Pune, Bangalore and ChennaiSenior Data Engineer Databricks (Azure/AWS)Role Overview:We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the ...
-
Data Engineer-Databricks
3 weeks ago
Bengaluru, Karnataka, India Oracle Full timeLocation- Mumbai, Pune, Bangalore and ChennaiSenior Data Engineer Databricks (Azure/AWS)Role Overview:We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...
-
Data Engineer-databricks
15 hours ago
Bengaluru, Karnataka, India Oracle Full timeLocation- Mumbai, Pune, Bangalore and Chennai Senior Data Engineer Databricks (Azure/AWS)Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms.The role will focus on implementing batch and streaming pipelines, applying the...
-
Data Engineer-Databricks
2 weeks ago
Bengaluru, Karnataka, India Oracle Full timeLocation- Mumbai, Pune, Bangalore and Chennai Senior Data Engineer Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the...
-
Databricks Lead Urgent
4 days ago
Bengaluru, Karnataka, India NTT Data Full timeJob DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Lead to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Wyndham Group of Hotels is...
-
Databricks Data Specialist
5 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Unlock Your Potential as a Databricks Consultant!GyanSys Inc. is a leading global systems integrator, specializing in SAP, Salesforce, Microsoft, and ServiceNow solutions.Our team works closely with data scientists, analysts, and business users to gather and translate requirements.As a Databricks Consultant, you'll have the opportunity to work on...
