
Azure Databricks Developer for Data Ingestion
7 days ago
Job Title
Azure Databricks Developer Needed for Data Ingestion Expertise
About the Role:
We are seeking a skilled Azure Databricks engineer to lead data ingestion efforts, design, develop, and optimize pipelines for integrating multiple sources into Databricks. The ideal candidate will have expertise in CI/CD and Kubernetes.
Key Responsibilities:
- Data Ingestion Pipeline Design: Design and develop efficient data ingestion pipelines for integrating multiple sources into Databricks.
- CICD Implementation: Implement and maintain Continuous Integration/Continuous Deployment (CICD) pipelines for data workflows.
- Kubernetes Management: Deploy and manage containerized applications using Kubernetes.
- Data Integrity Assurance: Ensure data integrity, security, and compliance throughout the ingestion process.
- Team Collaboration: Collaborate with data engineers and other stakeholders to streamline data ingestion strategies.
- Pipeline Optimization: Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
- Data Ingestion Experience: Proven experience in data ingestion and pipeline development.
- CICD Tools Expertise: Hands-on experience with CICD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
- Kubernetes Knowledge: Strong knowledge of Kubernetes and container orchestration.
- Databricks Expertise: Experience with Databricks, Spark, and data lake architectures.
- Programming Skills: Proficiency in Python, Scala, or SQL for data processing.
- Cloud Platforms Familiarity: Familiarity with cloud platforms such as AWS, Azure, or GCP.
- Problem-Solving Skills: Strong problem-solving and analytical skills.
-
Data Ingestion Specialist
3 days ago
Anand, Gujarat, India beBeeDataIngestion Full time US$ 1,00,000 - US$ 1,25,000Job Title: Data Ingestion SpecialistDescription: We are seeking an experienced professional to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion...
-
Azure Data Engineer Position
6 days ago
Anand, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000Job OverviewData engineers play a pivotal role in designing, building, and maintaining automated data pipelines that support organizational data governance and analytics initiatives. This position involves creating production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention...
-
Azure Data Engineer Position
5 days ago
Anand, Gujarat, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000Azure Data Engineer RoleHello and welcome to our job description. We are currently hiring for an experienced Azure Data Engineer.This role is perfect for professionals with a strong background in data engineering and cloud services. As an Azure Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to curate and...
-
Lead azure data engineer
3 days ago
Anand, Gujarat, India RandomTrees Full timeImmediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologiesIf you're passionate about building robust applications and thrive in a dynamic environment,...
-
Master Azure Data Architect
7 days ago
Anand, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000Lead Data EngineerWe're seeking a skilled Lead Data Engineer to join our team. This role involves designing, developing, and optimizing data pipelines using Azure and Databricks.Key Responsibilities:Design, develop, and optimize data pipelines using Azure and Databricks.Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment...
-
Principal Data Architect
1 week ago
Anand, Gujarat, India beBeeDataEngineer Full timeJob Summary">We are seeking a highly skilled Data Engineer with 4+ years of experience in designing, building, and optimizing ETL pipelines using Azure Cloud technologies. The ideal candidate will have hands-on experience working with Databricks, managing large-scale data processing workflows, and implementing data transformation workflows for...
-
Azure Data AI Technical Lead
7 days ago
Anand, Gujarat, India beBeeDataScientist Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Job DescriptionWe are seeking a technical lead to drive the development of our training content on Azure's modern data and AI stack. As a Subject Matter Expert (SME) in this field, you will lead the definition and review of presentations, labs, and real-world scenarios.The successful candidate will have deep hands-on experience in data and AI technologies...
-
Data Pipeline Specialist
5 days ago
Anand, Gujarat, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Software EngineerJob Description:Develop and optimize data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.Design scalable data architectures following best practices.Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.Key Responsibilities:Develop and maintain data lake solutions...
-
Big Data Developer
7 days ago
Anand, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000Job Title: Azure Data EngineerLocation: RemoteNotice Period: Immediate Joiners OnlyExperience: 4–6 YearsWe are seeking a seasoned data professional to join our team as an Azure Data Engineer.This role involves building, maintaining and supporting data & analytics solutions using Azure Data Engineering technologies with a strong focus on performance,...
-
Chief Data Architect
18 hours ago
Anand, Gujarat, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000Job DescriptionThis is a critical role in designing, developing, and maintaining data pipelines and infrastructure. As a key member of our team, you will work closely with data scientists, analysts, and other stakeholders to ensure timely and accurate data delivery.Key Responsibilities:Data Pipeline Development: Design, develop, and implement efficient data...