
Senior Data Pipeline Specialist
3 days ago
Job Role Summary:
We are seeking an accomplished Data Pipeline Developer to join our team and spearhead the creation of efficient data ingestion pipelines for integrating multiple sources into Databricks. This pivotal role requires expertise in designing, developing, and optimizing data ingestion processes that prioritize scalability and efficiency.
Key Responsibilities:
- Design and develop robust data ingestion pipelines for integrating multiple sources into Databricks.
- Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
- Deploy and manage containerized applications using Kubernetes.
- Evaluate data integrity, security, and compliance throughout the ingestion process.
- Collaborate with Data Engineers to refine data ingestion strategies.
- Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
- Proven experience in data ingestion and pipeline development.
- Familiarity with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps, etc.
- In-depth knowledge of Kubernetes and container orchestration.
- Proficiency in Python, Scala, or SQL for data processing.
- Familiarity with cloud platforms such as AWS, Azure, or GCP.
-
Senior Data Pipeline Specialist
4 days ago
Cochin, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000Job SummaryWe are seeking an experienced Data Ingestion Engineer with a strong background in data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.This role requires designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks, implementing and...
-
Senior Data Pipeline Specialist
2 hours ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000Job Summary:We are seeking an experienced Python data engineer to join our organization. As a key member of our data initiatives, you will be responsible for designing and maintaining scalable, reliable data pipelines using Python and orchestration tools.Main Responsibilities:Create robust and scalable data pipelines using Python.Utilize orchestration and...
-
Data Pipeline Engineer
2 days ago
Cochin, Kerala, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 20,00,000Job OverviewWe are seeking a skilled Technical Specialist to assume the role of designing, implementing, and managing data pipelines using Azure Data Factory. The ideal candidate will have 5-7 years of experience in data warehousing and Azure Synapse Analytics.This is a critical position that involves collaborating closely with clients to understand their...
-
Data Pipeline Lead
4 days ago
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Lead Data ArchitectOur team is seeking an accomplished data architect to lead the design and implementation of large-scale data pipelines. As a senior member, you will play a pivotal role in shaping our company's data strategy.Key Responsibilities:Design and implement ETL pipelines using FiveTran, DBT Cloud, and custom frameworksDevelop client-specific data...
-
Senior Data Pipeline Specialist
6 days ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Data Engineer Job Summary">At the heart of our business, we need a skilled Data Engineer to build and manage the intricate networks that drive our analytics. With 3+ years of experience in a Data Engineering role, you'll be responsible for creating scalable data pipelines that deliver real-time insights across our global operations.This isn't just about ETL;...
-
Chief Data Pipeline Architect
2 days ago
Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000Unlock a New Era in Data Engineering with Our TeamWe're seeking a highly skilled Senior Data Engineer to lead the development of our data pipeline architecture, collaborating closely with data scientists and analysts to drive innovative solutions.This pivotal role will be responsible for designing, building, and maintaining scalable data pipelines,...
-
ai - Senior Data Engineer - ETL Pipeline
12 hours ago
Cochin, Kerala, India DBiz Full timePosition : Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems.In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions.You will also contribute to optimizing...
-
Cloud Data Pipelines Specialist
20 hours ago
Cochin, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Talend ETL Developer Opportunity">Appit Software Inc, a forward-thinking organization, is seeking an accomplished professional to fill the role of Talend ETL Developer with expertise in cloud data pipelines. The ideal candidate will have 8-10 years of experience and possess excellent communication skills.**Key Responsibilities:**- Design and optimize complex...
-
Senior Data Integration Specialist
6 days ago
Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 22,50,000Job Title: Senior Data Integration SpecialistThe ideal candidate will have a strong background in developing, documenting, testing, and maintaining complex data pipelines using Informatica IDMC.We are seeking a highly skilled and experienced Informatica IDMC ETL Developer (Lead-Level) with expertise in leading large projects and mentoring junior...
-
Cloud Data Pipeline Specialist
2 days ago
Cochin, Kerala, India beBeeDataProcessing Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking a seasoned Data Processing Engineer to join our data engineering team. The ideal candidate will have strong expertise in Scala, Spark, and Python for building and optimizing large-scale data pipelines.Key ResponsibilitiesDesign, develop, and optimize distributed data processing systems.Work extensively with Scala, Spark (PySpark),...