
Databricks Expert for High-Performance Data Processing
1 day ago
Job Description:
We are seeking a seasoned Data Ingestion Specialist to join our team. The ideal candidate will have a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.
- Design and develop robust data ingestion pipelines for integrating multiple sources into Databricks.
- Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
- Deploy and manage containerized applications using Kubernetes.
- E nsure data integrity, security, and compliance throughout the ingestion process.
- Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
Key Requirements:
- Proven experience in data ingestion and pipeline development.
- Familiarity with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
- Strong knowledge of Kubernetes and container orchestration.
- Experience with Databricks, Spark, and data lake architectures.
- Proficiency in Python, Scala, or SQL for data processing.
Preferred Qualifications:
- Experience with Infrastructure as Code (Terraform, Helm, etc.).
- Background in streaming data ingestion (Kafka, Kinesis, etc.).
-
Senior Data Architect
1 day ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 22,50,000Seeking a visionary leader to spearhead the development of scalable data pipelines and analytics platforms on Microsoft Azure and Databricks.The ideal candidate will have in-depth expertise in Big Data platforms, drive the design and delivery of end-to-end data solutions, collaborate with cross-functional teams, and promote best practices in data...
-
Big Data Solutions Architect
1 day ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,01,00,000Job Title: Databricks EngineerWe are seeking a highly skilled Databricks Engineer to join our team. As a Databricks Engineer, you will be responsible for designing, developing, and maintaining data pipelines and ETL processes on Databricks.This is a challenging role that requires strong technical skills, excellent problem-solving abilities, and effective...
-
Data Pipeline Architect
47 minutes ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000We are seeking a skilled and detail-oriented Data Engineer to design, build, and manage scalable data pipelines and enterprise data solutions.This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.The ideal candidate will have expertise in Azure, SQL...
-
Senior Cloud Architect
47 minutes ago
Thiruvananthapuram, Kerala, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Overview:We are seeking a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks and AWS to join our dynamic data engineering team.The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code. Experience with DAB (Data Access Broker) is highly preferred.Key...
-
High Availability Database Expert
1 day ago
Thiruvananthapuram, Kerala, India beBeeDatabase Full time US$ 1,24,500 - US$ 1,78,000About the RoleWe seek an expert in high availability and scalable data architectures to own performance, security, and maintenance of databases.This individual will play a key role in designing resilient data pipelines, ensuring optimal query execution and supporting development teams.Key Responsibilities:Design and implement scalable database...
-
Chief Data Infrastructure Specialist
1 day ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 24,50,000Data Architect Role Overview:As a Data Architect, you will be responsible for designing and implementing scalable data platforms and AI solutions that drive real business impact.Key Responsibilities:Design and implement efficient Databricks solutions to meet client requirements.Develop data pipelines, architect data lakes, and implement data warehousing...
-
Senior Data Architecture Specialist
1 day ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Are you a seasoned professional in data engineering looking for a challenging role? We are seeking an experienced Lead Data Engineer with expertise in Azure and Databricks to join our dynamic team.The ideal candidate will have a deep understanding of modern data architectures, including Lakehouse and governance. They will also possess strong hands-on skills...
-
Data Science Developer
1 day ago
Thiruvananthapuram, Kerala, India beBeeMachineLearning Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data Science Developer">Description:We are seeking a skilled Data Science Developer to join our team of experts. As a key member of the team, you will be responsible for designing, developing, and deploying machine learning models and algorithms to solve complex business challenges.Key Responsibilities:Design and implement machine learning models...
-
Large Scale Data Engineer
2 hours ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Description:We are seeking a skilled Data Engineering Specialist to join our team. As a key member, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure technologies.You will design and develop scalable data pipelines, collaborate with cross-functional teams, and stay up-to-date with the latest...
-
Data Engineer
2 weeks ago
Thiruvananthapuram, Kerala, India Firstsource Full timeKey Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...