
Senior Data Pipeline Architect
1 day ago
We are seeking a highly skilled data engineer to spearhead our ETL development and data warehousing initiatives. The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines using IBM DataStage, coupled with strong SQL skills (Teradata).
The successful candidate will collaborate with data analysts and business stakeholders to implement integration solutions, perform manual and automated data validation and reconciliation, conduct root cause analysis for data discrepancies and ETL failures, and develop reusable DataStage job components following data modeling best practices.
- Design, Develop, and Maintain ETL Workflows:
- Compose Optimized SQL Queries for Data Extraction, Transformation, and Validation.
- Collaborate with Data Analysts and Business Stakeholders to Implement Integration Solutions.
- Perform Manual and Automated Data Validation and Reconciliation.
- Conduct Root Cause Analysis for Data Discrepancies and ETL Failures.
- Develop Reusable DataStage Job Components and Follow Data Modeling Best Practices.
- Monitor ETL Workflows and Manage Dependencies via Job Sequencers or Airflow.
- Document Workflows, Mappings, and Data Dictionaries.
- Support Cloud Migration and Integration Initiatives.
Required Skills:
IBM DataStage, Teradata, SQL, Oracle
Desirable Skills:
Python, Shell Scripting, Unix/Linux, Apache Airflow, Cloud Platforms, Agile, CI/CD
-
Chief Data Pipeline Architect
1 week ago
Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support...
-
Data Engineer
3 days ago
Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000Job Title:Data Engineer - Pipeline Architect\About the Role:\We are seeking a highly skilled Data Engineer to design, implement and manage data pipelines. Key responsibilities include building CI/CD pipelines using GitHub Actions or equivalent tools, configuring and maintaining branch protection rules and workflows, automating Databricks deployments using...
-
Data Pipeline Architect
2 days ago
Thrissur, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000Unlock the Power of Data EngineeringAs a Senior Data Engineer, you will play a vital role in building and maintaining scalable data pipelines that integrate healthcare data. This is a critical position where you will create high-performance pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated...
-
Data Pipeline Architect
1 day ago
Thrissur, Kerala, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000As a highly skilled ETL specialist, you will be responsible for designing and deploying efficient data pipelines that drive business growth.The ideal candidate will have hands-on experience with ETL development using Informatica and a strong understanding of data warehousing concepts. Additionally, proficiency in Python programming for data processing and...
-
Senior Data Architect Specialist
17 hours ago
Thrissur, Kerala, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 30,00,000Senior Snowflake DeveloperWe are seeking a seasoned professional to lead full lifecycle implementations of secure cloud data platforms, including setup, integration, and high-performance data pipeline development.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps, and want to contribute to...
-
Data Pipeline Specialist
2 days ago
Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Opportunity: Data EngineerWe are seeking a skilled professional to join our team as a Data Engineer.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Integrate data from various sources, ensuring data quality and consistency.Optimize data processing workflows for...
-
Data Architect
1 week ago
Thrissur, Kerala, India beBeeData Full time US$ 2,00,000 - US$ 2,50,000Transforming the Future of Healthy Food AccessJob Description: The Senior Data Engineer is a pivotal role in constructing and optimizing our data pipeline architecture. Collaborating closely with cross-functional teams, they will design, build, and maintain highly scalable data pipelines to support advanced analytics and machine learning. As a...
-
Senior Data Architect
3 days ago
Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Role – Data Engineer With FabricJob Location – JaipurJob Type – PermanentExperience Required: 2-4 YearsWe are seeking a skilled Data Engineer to join our team. As a key member of the team, you will play a critical role in designing, developing, and maintaining our data pipelines and infrastructure.Main Responsibilities:Data Pipeline Development:...
-
Expert Data Pipeline Architect
7 days ago
Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Freelance Data EngineerWe are seeking a Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Job Description:Data Engineering is a key component of our organization's ability to drive business outcomes through data-driven decision making. We are...
-
Chief Data Pipeline Architect
2 weeks ago
Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000Key Data Engineer PositionWe are seeking a highly skilled data professional with 4+ years of experience in designing, building, and optimizing ETL pipelines for large-scale data processing workflows. The ideal candidate will have hands-on experience working with Azure Cloud services including Azure Data Factory, Databricks, and related...