Senior Data Pipeline Specialist
21 hours ago
We are seeking an experienced Senior Data Pipeline Specialist to build and maintain production-grade data pipelines at scale using AWS services.
- The ideal candidate has 3–5 years of professional experience in designing and implementing scalable data architectures.
About the Role:
We need someone with hands-on expertise in building large-scale ETL/ELT processes that handle terabytes of structured and unstructured data. The successful candidate will work closely with AI/ML teams to support model training, retrieval-augmented generation (RAG), and analytics pipelines.
Responsibilities:
- Designing, maintaining, and optimizing production-level data pipelines to handle massive datasets efficiently.
- Ensuring the reliability, scalability, and high availability of end-to-end data processing workflows.
- Collaborating with cross-functional teams to deliver high-quality data products that meet business requirements.
Requirements:
- 4–6 years of professional experience in data engineering or a related field.
- Proven track record of designing and deploying large-scale data pipelines using AWS services.
- Strong proficiency in Python, SQL, and cloud-based data platforms.
- Familiarity with big data best practices and data governance principles.
Bonus Skills:
- Experience with Airflow, Spark, or other orchestration/processing frameworks.
- Knowledge of containerization tools like Docker and Kubernetes.
-
Senior Data Pipeline Architect
3 days ago
Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job DescriptionWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital marketing product development.You will collaborate with cross-functional teams including Data Scientists, Product Managers,...
-
Head of Data Pipeline Optimization
3 days ago
Kollam, Kerala, India beBeeSeniorDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000Transform Data Infrastructure Our company is seeking a skilled Senior Data Engineer to lead the optimization and scalability of data delivery pipelines. This critical role will design, build, and maintain highly scalable data pipelines, optimize data delivery, and automate data processes.
-
Data Pipeline Specialist
3 days ago
Kollam, Kerala, India beBeeCloud Remote Work Freelance Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Cloud Computing EngineerWe are seeking a skilled Cloud Computing Engineer to design and implement cloud-based solutions using Azure and Google Cloud platforms.The ideal candidate will have expertise in automating data pipelines to facilitate efficient data flow and processing. They will also develop and manage data pipelines using technologies like PySpark...
-
High-Performance Data Pipeline Specialist
3 days ago
Kollam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000We are seeking an experienced Data Engineer to fill a critical role in our organization. This position will be responsible for designing and implementing efficient data pipelines using leading tools such as FiveTran, DBT Cloud, and custom frameworks.Key Responsibilities:Develop and maintain scalable data pipelines to meet business needsImplement data...
-
Expert Data Architect
5 days ago
Kollam, Kerala, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 21,00,000Senior Technical SpecialistWe are seeking a skilled Senior Technical Specialist with hands-on experience in designing, building, and optimizing scalable data pipelines.This role requires expertise in AWS services: Lambda, Glue, S3, IAM, CloudWatch, as well as proficiency in DBT (Data Build Tool) for data transformations and modular pipelines.The ideal...
-
Senior Data Integration Specialist
1 week ago
Kollam, Kerala, India beBeeDataSpecialist Full time ₹ 30,00,000 - ₹ 50,00,000Job DescriptionWe are seeking an experienced Data Integration Specialist to develop and maintain scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake. This role will involve designing, building, and optimizing ETL processes for loading curated datasets into a cloud-based data warehouse.The ideal candidate will have hands-on experience with...
-
Senior Cloud Data Architect
3 days ago
Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Senior Software Engineer/Technical SpecialistJob DescriptionWe are seeking a skilled software engineer to join our team. As a senior software engineer, you will be responsible for designing and implementing scalable data architectures using Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will work with large datasets, developing...
-
Senior Cloud Data Specialist
4 days ago
Kollam, Kerala, India beBeeDatabricksspecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Overview:We are seeking a seasoned professional to serve as a Senior Databricks Data Engineer on our data engineering team. This is an exciting opportunity for the right candidate to utilize their skills in PySpark, CI/CD pipelines, and Terraform for infrastructure as code to drive success in our organization.Design, develop, and maintain scalable and...
-
Senior Python Developer
3 days ago
Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 21,00,000Job Description:ThreatXIntel is a cyber security company focusing on protecting businesses from cyber threats. Our team offers customized and affordable solutions tailored to meet the specific needs of clients, ensuring access to high-quality cyber security services.We are seeking an experienced Freelance Data Engineer with expertise in Python and AWS...
-
Senior Data Specialist
1 week ago
Kollam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our mission-critical banking project. This is an excellent opportunity to work on cutting-edge data pipelines, streaming platforms, and cloud-based infrastructures.Key Responsibilities:Designing and implementing ETL pipelines for large-scale data ingestion and transformation.Building...