
Data Engineering Specialist
14 hours ago
- We are seeking a seasoned Kafka engineer to join our team and lead the development of automated migration pipelines for moving enterprise workloads to open-source or cloud-native clusters.
- The ideal candidate will script and provision migration steps, automate validation, rollback, and monitoring tasks for large-scale data processing systems.
- A key responsibility of this role is building scalable CI/CD processes for Kafka resource provisioning and configuration rollouts, utilizing tools like Jenkins and GitHub Actions.
- Ensuring automated tests cover data integrity, performance, and integration interfaces post-migration is also crucial.
- The selected candidate will integrate with cloud orchestration (AWS MSK, Kubernetes operators), manage infrastructure-as-code using tools like Terraform and CloudFormation.
- CI/CD: Jenkins, GitHub Actions
- IaC: Terraform, CloudFormation
- Apache Kafka administration and migration
- Scripting: Python, Go, Bash
- Kafka Connect custom plugin API, Maven/Gradle
- Containerization: Docker, Kubernetes
- Monitoring/validation: Prometheus, Grafana
- Automation of rollback/validation steps for migrations
- Exposure to cloud services: AWS, GCP, Azure
- Data ops and security automation
-
Data Engineering Specialist
1 day ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Data Engineering SpecialistOverview:We are seeking an experienced data engineering specialist to lead the design, development, and maintenance of large-scale data processing systems.Responsibilities:Work with big data technologies like HIVE, HBase, Impala, and Parquet.Develop strong SQL and RDBMS skills.Experience with version control systems like...
-
Data Engineer Test Specialist
6 days ago
Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000Data Engineer Test SpecialistJob Summary:•We are seeking a highly skilled Data Engineer Test Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.Responsibilities:•Develop and execute comprehensive test plans to ensure...
-
Data Engineering Specialist
1 day ago
Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title">We are seeking an experienced Data Engineering Specialist to lead the development of our data infrastructure. The ideal candidate will have a strong background in designing and implementing scalable data architectures, including ETL processes and data governance.Designing and implementing technical solutions for data pipeline development and...
-
Senior Cloud Data Engineering Specialist
7 days ago
Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878Job Role Overview:As a senior data engineering specialist, you will design and develop scalable solutions using Azure Databricks and PySpark. This role involves collaboration with product owners to analyze requirements and create detailed interface designs.Key Responsibilities:Develop and optimize data pipelines using ADF, SQL, and NoSQL...
-
Senior Data Engineer
3 days ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Key Job Responsibilities">A seasoned data engineer and infrastructure specialist is needed to oversee the full lifecycle of Snowflake implementations, from secure platform setup and cloud integration to high-performance data pipeline development.">Responsibilities Include:">">Leading Snowflake platform setup, environment provisioning, RBAC, and resource...
-
Large Scale Data Engineer
1 week ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Description:We are seeking a skilled Data Engineering Specialist to join our team. As a key member, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure technologies.You will design and develop scalable data pipelines, collaborate with cross-functional teams, and stay up-to-date with the latest...
-
Data Engineering Specialist
5 days ago
Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 15,00,000Data Engineering Expert WantedAt our tech-first company, we utilize clean code and fast iterations to tackle real-world problems. Our product-driven team delivers value through scalable data platforms and applications.We seek an experienced Data Engineer to collaborate with engineers, product, and design for timely insights delivery.Key...
-
Data Engineering Specialist
10 hours ago
Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewWe are seeking an experienced data professional to join our team as a Data Engineer. The successful candidate will be responsible for designing and implementing scalable data pipelines and working on modern cloud & big data platforms.Main Responsibilities:Design, develop, and maintain large-scale data processing systems using Python, SQL,...
-
Data Governance Specialist
7 days ago
Thiruvananthapuram, Kerala, India beBeeGovernance Full time ₹ 12,00,000 - ₹ 25,00,000Job Title: Data Governance SpecialistWe are seeking an experienced Data Governance Specialist to join our team. As a key member of our data management team, you will be responsible for implementing and maintaining our data governance program.Required Skills and Qualifications:Collibra Experience: Hands-on experience with Collibra Data Intelligence Platform...
-
Data Engineering Specialist
8 hours ago
Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000Job Title: Data EngineerWe are seeking a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scraping, and generating actionable insights through dashboards and reports.Key...