
Data Pipeline Specialist
2 weeks ago
Job Title: Data Pipeline Specialist
We are seeking a skilled Data Pipeline Specialist to design, implement and manage robust data pipelines that ensure seamless integration with modern DevOps tools.
- Develop and optimize data pipelines using Python, SQL, and Spark jobs in Databricks for large-scale data processing.
- Automate deployments using Databricks Asset Bundles (DABs) or similar frameworks.
- Configure and maintain GitHub branch protection rules and workflows.
- Implement unit testing, validation, and quality checks for data workflows.
- Manage multi-environment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
The ideal candidate should have hands-on experience with:
- SQL, Databricks (Spark), and Python/R programming languages.
- Github and CI/CD practices (branch protection, GitHub Actions workflows).
- Unit tests and quality checks in data workflows.
- Databricks Asset Bundles (DABs) or similar automation tools.
- YAML configuration management, debugging, and error resolution.
- Strong problem-solving and debugging skills in data engineering workflows.
About the Role
This is an exciting opportunity to join our team as a Data Pipeline Specialist. As a key member of our engineering team, you will be responsible for designing, implementing and managing data pipelines that meet our business needs.
Requirements
To be successful in this role, you will need to have:
- Hands-on experience with data pipelines, including design, implementation and management.
- Strong understanding of DevOps principles and practices.
- Experience with GitHub and CI/CD tools.
- Ability to work independently and collaboratively as part of a team.
-
Senior Data Pipeline Specialist
2 weeks ago
Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data EngineerAt the heart of our company lies a pressing need for individuals skilled in harnessing data. We seek out talented professionals who can craft and optimize data pipelines, guaranteeing that data remains secure, pristine, and easily accessible for analytical purposes.Key Responsibilities:Create client-facing dashboards utilizing...
-
Big Data Pipeline Developer
7 days ago
Malappuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Data Engineering SpecialistLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid Role OverviewWe are seeking a highly skilled Data Engineering Specialist with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data...
-
Data Pipeline Architect
2 weeks ago
Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,25,000Data Engineer PositionWe are seeking a skilled professional to design and implement scalable data pipelines using modern cloud and big data platforms. Key Responsibilities: Design, develop, and maintain large-scale data processing systems Implement efficient data ingestion, storage, and retrieval solutions Collaborate with cross-functional teams to ensure...
-
Cloud Data Specialist
2 weeks ago
Malappuram, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000Cloud Data SpecialistWe are seeking a skilled Cloud Data specialist to work with our team. As a Cloud Data specialist, you will be responsible for designing and developing scalable data pipelines using cloud-based services.Your key responsibilities will include:Designing and developing robust frameworks for generating PDF reports using Python and...
-
Chief Data Pipeline Architect
2 weeks ago
Malappuram, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Chief Data Pipeline ArchitectAbout the Role:Craft and maintain efficient data pipelines to support business operationsCollaborate with cross-functional teams to identify data needs and deliver solutionsDesign, develop, and optimize large-scale data systems using PySpark and PythonWork closely with data scientists and analysts to ensure...
-
Data Infrastructure Specialist
1 week ago
Malappuram, Kerala, India beBeeInfrastructure Full time ₹ 2,00,00,000 - ₹ 2,50,00,000About the RoleWe are seeking a Data Infrastructure Specialist to join our team and lead the design, development, and operation of scalable data pipelines. This is a critical role where you will create reliable systems to ingest, track, and update clinical events in real-time.This specialist will work closely with AI engineers to align data flows with model...
-
Cloud Data Specialist
1 week ago
Malappuram, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 40,00,000Job Title: Cloud Data Specialist – GCP OverviewWe seek a seasoned Cloud Data Specialist to build and maintain scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, along with a foundational understanding of AI/ML workflows using Vertex...
-
Highly Skilled IoT Data Pipelines Specialist
1 week ago
Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000IoT Data Engineer Position OverviewThis is an exciting opportunity for a skilled professional to design, develop and deploy scalable IoT data pipelines using AWS services.The ideal candidate will have hands-on experience in data transformation and data ingestion, as well as knowledge of GCP BQ, Dataflow, Airflow and Python.Key Responsibilities:Design and...
-
Senior Data Engineer for Scalable Pipelines
2 weeks ago
Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000ETL Developer/Senior Developer RoleWe are seeking a highly skilled ETL developer to join our data engineering team.About the JobThe successful candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.Main ResponsibilitiesDesign, develop, and maintain ETL...
-
Data Insights Specialist
1 week ago
Malappuram, Kerala, India beBeeDataInsights Full time ₹ 35,00,000 - ₹ 50,00,000Data Insights SpecialistWe are seeking an experienced professional to excel in our data infrastructure and deliver insightful analysis.The successful candidate will be responsible for building and maintaining our data foundation, ensuring high-quality clean and well-documented data pipelines and dataflows. Responsibilities include designing and implementing...