
Senior Data Pipeline Specialist
5 days ago
We are seeking an experienced Freelance Data Engineer to join our team and play a key role in designing, building, and optimizing large-scale data pipelines.
The successful candidate will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.
- Designing, developing, and maintaining ETL/ELT pipelines using PySpark and AWS.
- Performing data profiling, validation, and transformation using Python and SQL.
- Optimizing and monitoring workflows for performance, scalability, and cost efficiency.
- Building automation scripts using Linux and Bash for data pipeline orchestration.
- Collaborating with analytics teams to surface trustworthy KPIs and metrics.
- Troubleshooting and resolving data inconsistencies, configuration issues, and pipeline errors.
- 5+ years of data engineering experience with a strong background in Python and SQL.
- Proven expertise in PySpark, AWS services, and Databricks.
- Proficiency in Linux/Bash scripting for automation and data operations.
- Hands-on experience with ETL/ELT pipelines and large-scale integrations.
- Familiarity with Agile and CI/CD practices.
- Strong problem-solving and communication skills, with experience in client-facing roles.
-
Data Pipeline Specialist
6 days ago
Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking a highly skilled and experienced Data Engineer to drive our data strategy.This role is responsible for designing, developing, and maintaining scalable data pipelines using PySpark.Design and develop complex data pipelines utilizing PySpark and Spark SQL.Collaborate with cross-functional teams to ensure accurate data processing,...
-
Data Pipeline Specialist
1 week ago
Ghaziabad, Uttar Pradesh, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000Talend ETL Developer Job DescriptionWe are seeking a skilled professional to take on the role of Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.**Job Overview:**The successful candidate will be responsible for designing and optimizing complex ETL pipelines, debugging, and deployment using TMC.**Key...
-
Data Pipelines Engineer
2 days ago
Ghaziabad, Uttar Pradesh, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Senior ETL Developer – Data Pipelines EngineerLocation: RemoteJob Type: Full-timeJob DescriptionWe are seeking an experienced ETL Developer to join our data engineering team. The successful candidate will work on designing and developing efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The ideal candidate will collaborate...
-
Senior Data Engineering Specialist
5 days ago
Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 30,00,000Job Title: Senior Data Engineering SpecialistAbout the RoleWe are seeking an experienced data engineering specialist to join our team. As a key member, you will be responsible for designing and developing end-to-end data integration solutions, optimizing workflows, and collaborating with business and technical stakeholders to deliver scalable and...
-
Data Pipeline Architect
6 days ago
Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop, and optimize data ingestion pipelines.About the Role:Design and implement data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...
-
Machine Learning Pipeline Specialist
9 hours ago
Ghaziabad, Uttar Pradesh, India beBeePipeline Full time ₹ 15,00,000 - ₹ 20,00,000Machine Learning Pipeline SpecialistWe are seeking a highly skilled Machine Learning Pipeline Specialist to join our team.Develop and maintain scalable machine learning pipelines and backend services utilizing Python and frameworks like Tornado and FastAPI.Design, implement, and deploy RESTful APIs, including token-based authentication and compression...
-
Senior Data Pipeline Tester
7 hours ago
Ghaziabad, Uttar Pradesh, India beBeeDataQuality Full time US$ 80,000 - US$ 1,00,000Our organization is seeking a skilled QA professional to contribute to the development of large-scale data pipelines.Key ResponsibilitiesEvaluate and test ETL processes for data accuracy, consistency, and throughput in event-driven systems.Validate data flow between Kafka/Redpanda pipelines, including producers, consumers, topics, schema registry, and...
-
Senior Data Pipeline Developer
6 days ago
Ghaziabad, Uttar Pradesh, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job DescriptionDesign and build a shared component library for data pipelines, including ingestion, parsing/normalization, extraction, validation, enrichment, and publishing.Define patterns/templates for Apache Beam pipelines and Databricks jobs, standardizing configuration, packaging, versioning, CI/CD, and documentation.Create interfaces so multiple teams...
-
Ghaziabad, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Integration SpecialistRole Overview:We are seeking a seasoned Senior Data Integration Specialist to lead our data engineering initiatives. As a key member of our team, you will be responsible for architecting and implementing end-to-end data pipelines and integration solutions for varied structured and unstructured data sources and targets.The...
-
Azure Data Pipeline Architect
7 days ago
Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000Azure Data Engineer RoleSeeking a skilled data engineer to design, build and maintain automated data pipelines supporting business intelligence and analytics initiatives.We're looking for an expert who can leverage their knowledge of Azure Databricks, PySpark, SQL and ETL/ELT pipeline design to develop robust data pipelines that ingest, transform and curate...