Senior Data Pipeline Specialist

5 days ago


Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000
Freelance Data Engineer Position

We are seeking an experienced Freelance Data Engineer to join our team and play a key role in designing, building, and optimizing large-scale data pipelines.

The successful candidate will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.

  • Designing, developing, and maintaining ETL/ELT pipelines using PySpark and AWS.
  • Performing data profiling, validation, and transformation using Python and SQL.
  • Optimizing and monitoring workflows for performance, scalability, and cost efficiency.
  • Building automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborating with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshooting and resolving data inconsistencies, configuration issues, and pipeline errors.
Requirements:
  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.


  • Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled and experienced Data Engineer to drive our data strategy.This role is responsible for designing, developing, and maintaining scalable data pipelines using PySpark.Design and develop complex data pipelines utilizing PySpark and Spark SQL.Collaborate with cross-functional teams to ensure accurate data processing,...


  • Ghaziabad, Uttar Pradesh, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000

    Talend ETL Developer Job DescriptionWe are seeking a skilled professional to take on the role of Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.**Job Overview:**The successful candidate will be responsible for designing and optimizing complex ETL pipelines, debugging, and deployment using TMC.**Key...


  • Ghaziabad, Uttar Pradesh, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior ETL Developer – Data Pipelines EngineerLocation: RemoteJob Type: Full-timeJob DescriptionWe are seeking an experienced ETL Developer to join our data engineering team. The successful candidate will work on designing and developing efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The ideal candidate will collaborate...


  • Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Job Title: Senior Data Engineering SpecialistAbout the RoleWe are seeking an experienced data engineering specialist to join our team. As a key member, you will be responsible for designing and developing end-to-end data integration solutions, optimizing workflows, and collaborating with business and technical stakeholders to deliver scalable and...


  • Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop, and optimize data ingestion pipelines.About the Role:Design and implement data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...


  • Ghaziabad, Uttar Pradesh, India beBeePipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Machine Learning Pipeline SpecialistWe are seeking a highly skilled Machine Learning Pipeline Specialist to join our team.Develop and maintain scalable machine learning pipelines and backend services utilizing Python and frameworks like Tornado and FastAPI.Design, implement, and deploy RESTful APIs, including token-based authentication and compression...


  • Ghaziabad, Uttar Pradesh, India beBeeDataQuality Full time US$ 80,000 - US$ 1,00,000

    Our organization is seeking a skilled QA professional to contribute to the development of large-scale data pipelines.Key ResponsibilitiesEvaluate and test ETL processes for data accuracy, consistency, and throughput in event-driven systems.Validate data flow between Kafka/Redpanda pipelines, including producers, consumers, topics, schema registry, and...


  • Ghaziabad, Uttar Pradesh, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionDesign and build a shared component library for data pipelines, including ingestion, parsing/normalization, extraction, validation, enrichment, and publishing.Define patterns/templates for Apache Beam pipelines and Databricks jobs, standardizing configuration, packaging, versioning, CI/CD, and documentation.Create interfaces so multiple teams...


  • Ghaziabad, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Integration SpecialistRole Overview:We are seeking a seasoned Senior Data Integration Specialist to lead our data engineering initiatives. As a key member of our team, you will be responsible for architecting and implementing end-to-end data pipelines and integration solutions for varied structured and unstructured data sources and targets.The...


  • Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Azure Data Engineer RoleSeeking a skilled data engineer to design, build and maintain automated data pipelines supporting business intelligence and analytics initiatives.We're looking for an expert who can leverage their knowledge of Azure Databricks, PySpark, SQL and ETL/ELT pipeline design to develop robust data pipelines that ingest, transform and curate...