Data Pipeline Developer

3 days ago

Ghaziabad, Uttar Pradesh, India beBeeArtificialintelligence Full time ₹ 20,00,000 - ₹ 25,00,000
AI Engineer Role

We are seeking an experienced AI/ML specialist to develop and optimize data pipelines using Python, Pandas, and Scikit-learn.

Main Responsibilities:

  • Develop and optimize data pipelines using Python, Pandas, and Scikit-learn.
  • Support prompt engineering initiatives for LLM-based applications.
  • Conduct model evaluation and testing, ensuring accuracy, reliability, and performance.
  • Work with Vector Databases (e.g., Pinecone, FAISS) for embedding storage and retrieval.

Secondary Responsibilities:

  • Assist in fine-tuning small and domain-specific models for production use.
  • Write automation scripts for data preparation, cleaning, and feature engineering.
  • Collaborate with product and engineering teams to enable API integrations for ML services.

Requirements:

  • Strong programming skills in Python with hands-on experience in Pandas and Scikit-learn.
  • Basic knowledge of prompt engineering for LLMs.
  • Understanding of model evaluation metrics and testing techniques.
  • Exposure to Vector Databases (Pinecone, FAISS, or similar).

Desirable Skills:

  • Experience with fine-tuning smaller ML or LLM models.
  • Familiarity with REST APIs / GraphQL and integrating ML models into production workflows.
  • Knowledge of data preprocessing pipelines and automation scripts.

Soft Skills:

  • Strong problem-solving and analytical mindset.
  • Ability to work in a collaborative environment with cross-functional teams.
  • Curiosity to explore and learn new AI/ML tools and frameworks.

About This Opportunity

This cutting-edge technology company values innovation, teamwork, and continuous learning. It offers a dynamic work environment that fosters growth and collaboration.

  • Data Pipeline Architect

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Pipeline ArchitectWe are seeking an experienced professional to design, develop, and optimize data ingestion pipelines.About the Role:Design and implement data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain CI/CD pipelines for data workflows.Deploy and manage containerized applications using...

  • Data Pipeline Specialist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled and experienced Data Engineer to drive our data strategy.This role is responsible for designing, developing, and maintaining scalable data pipelines using PySpark.Design and develop complex data pipelines utilizing PySpark and Spark SQL.Collaborate with cross-functional teams to ensure accurate data processing,...

  • Data Pipelines Engineer

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior ETL Developer – Data Pipelines EngineerLocation: RemoteJob Type: Full-timeJob DescriptionWe are seeking an experienced ETL Developer to join our data engineering team. The successful candidate will work on designing and developing efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The ideal candidate will collaborate...

  • Senior Data Pipeline Developer

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionDesign and build a shared component library for data pipelines, including ingestion, parsing/normalization, extraction, validation, enrichment, and publishing.Define patterns/templates for Apache Beam pipelines and Databricks jobs, standardizing configuration, packaging, versioning, CI/CD, and documentation.Create interfaces so multiple teams...

  • Data Pipeline Specialist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000

    Talend ETL Developer Job DescriptionWe are seeking a skilled professional to take on the role of Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.**Job Overview:**The successful candidate will be responsible for designing and optimizing complex ETL pipelines, debugging, and deployment using TMC.**Key...

  • Senior Teradata and Data Pipelines Developer

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDatastage Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Teradata with DataStage DeveloperWe are seeking an experienced professional in data pipeline development to join our team. This role involves designing, building, and optimizing data pipelines using IBM DataStage, along with strong SQL skills (Teradata).Key Responsibilities:Design and Develop ETL Jobs: Utilize IBM DataStage to design, build, and...

  • Azure Data Pipeline Architect

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Azure Data Engineer RoleSeeking a skilled data engineer to design, build and maintain automated data pipelines supporting business intelligence and analytics initiatives.We're looking for an expert who can leverage their knowledge of Azure Databricks, PySpark, SQL and ETL/ELT pipeline design to develop robust data pipelines that ingest, transform and curate...

  • Data Pipeline Architect

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeExpertise Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Integration Engineer OpportunityWe are seeking an experienced Integration Engineer to join our team. The ideal candidate will have strong expertise in Azure Data Services, including Synapse, ADF, SQL, and Power BI.Key Responsibilities:Troubleshoot and resolve issues related to Azure Synapse Analytics, Power BI, and SQL Server.Optimize performance and query...

  • Chief Data Pipeline Architect

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDatabricks Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Databricks Engineer Job DescriptionThe primary objective of this role is to design, develop, and maintain scalable, secure, and high-performance data pipelines and ETL processes on Databricks.Key Responsibilities:Develop and implement data workflows that ensure performance, cost-efficiency, and reliability.Collaborate with cross-functional teams to gather...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Freelance Data Engineer PositionWe are seeking an experienced Freelance Data Engineer to join our team and play a key role in designing, building, and optimizing large-scale data pipelines.The successful candidate will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Designing, developing, and...