Data Pipeline Engineer

2 weeks ago

Bengaluru, India Cantordust Solutions LLC Full time

Location: Preferred: Bangalore (On-site);
Alternatives: Mumbai, Kathmandu (On-site)

Type: Contract work, with potential for conversion to full time.

Duration: September - December 2025

Start Date: Immediate


Who We Are

We are recent MIT graduates experienced in digital transformation and AI, with expertise in various sectors including consulting, energy, healthcare, tech and operations. We are looking to build tailored solutions for companies looking to leverage the latest developments in agentic AI, LLMs and optimization tools. To this end, we are contracting high-skilled individuals to help us with project execution. As we develop a pipeline of projects, there is potential for applicants to convert to a full-time role within the company.


Role Summary

We are are looking for 2 Data Engineers as soon as possible to support infrastructure, data pipeline development, and deployment of pricing logic for a data-rich e-commerce platform serving the life sciences sector. Beyond data processing, this role emphasizes usability and interface design for internal tools that enable experimentation, pricing configuration, and real-time monitoring.


Key Responsibilities
  • Build and maintain ETL pipelines for pricing, shipping, and behavioral datasets
  • Collaborate with data scientists and product managers to support model development and experimentation
  • Develop APIs or backend logic to implement dynamic pricing algorithms
  • Create internal dashboards or tools with a focus on usability and performance
  • Ensure data quality, reliability, and documentation across systems
  • Perform feature engineering to feed predictive and optimization algorithms
  • Aggregate and transform high-dimensional datasets at scale to ensure modeling efficiency and robustness
  • Optimize algorithm performance for real-time and large-scale deployment


Requirements
  • Flexibility in working with young, startup-like environments. The role is dynamic, and will require an ability to adapt to various tasks and come up with creative solutions to unforeseen challenges
  • Ability to onboard immediately
  • 3+ years of experience in data engineering or backend development
  • Strong hands-on experience with Databricks and distributed data processing frameworks
  • Strong Python and SQL expertise;
    experience with cloud-based platforms (e.G., AWS, BigQuery, Snowflake)
  • Demonstrated ability to design and develop user-friendly internal tools or interfaces
  • Familiarity with experimentation systems and monitoring infrastructure
  • Experience handling large-scale, high-dimensional datasets efficiently
  • Experience with MLOps is preferred
  • Domain experience in e-commerce is preferred;
    knowledge of the pharmaceutical or scientific supply sector is a strong advantage

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India Bahwan CyberTek Full time

    Role Overview We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on expertise in big data processing, orchestration using AWS Step Functions, and serverless computing with AWS Lambda. Familiarity with DynamoDB and...

  • Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India People Tech Group Inc Full time

    We are Hiring - Data Engineer Bengaluru!Job Title: AWS Data EngineerLocation: BengaluruExperience: 5+YearsNotice : Immediate JoinersJob Summary:We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data...

  • Data Engineer

    3 days ago

    Bengaluru, India Creeno Solutions Pvt ltd Full time

    Job Description : We are looking for a highly skilled Data Engineer with a strong background in designing, building, and maintaining scalable data pipelines and business intelligence solutions. The ideal candidate should have a solid mix of hands-on experience in Azure cloud services, SQL development, data integration, and reporting tools to support...

  • AWS Data Pipeline Engineer

    2 days ago

    Bengaluru, Karnataka, India IDESLABS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled AWS Data Pipeline Engineer with 4 to 12 years of experience to manage data storage solutions on AWS, implement data processing workflows, and collaborate with cross-functional teams. The ideal candidate will have a strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework.Roles and...

  • Engineering Manager, Data Pipeline

    4 days ago

    Bengaluru, Karnataka, India Stripe Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Who we areAbout StripeStripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of...

  • Backend and Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India JRD Systems Full time

    The Role: Backend and Data Pipeline Engineer We are looking for an innovative and mission-driven software/data engineer to make a significant impact by designing and developing AWS cloud native solutions that enables analysts to forecast long and short-term trends in the automotive industry. This role requires cutting edge data and cloud native technical...

  • Senior Data Pipeline Engineer

    4 days ago

    Bengaluru, India Coforge Full time

    AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience in...

  • Backend and Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India JRD Systems Full time

    The Role: Backend and Data Pipeline EngineerWe are looking for an innovative and mission-driven software\data engineer to make a significant impact by designing and developing AWS cloud native solutions that enables analysts to forecast long and short-term trends in the automotive industry. This role requires cutting edge data and cloud native technical...

  • Senior Data Pipeline Engineer

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Senior Data EngineeerRequired Skillset: Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica.Location: KolkataExperience Range: 8+yrs Job DescriptionMust-Have** Strong proficiency in Azure Data Factory, Databricks, Delta...

  • Backend and Data Pipeline Engineer

    2 weeks ago

    Bengaluru, India JRD Systems Full time

    The Role: Backend and Data Pipeline Engineer We are looking for an innovative and mission-driven software\data engineer to make a significant impact by designing and developing AWS cloud native solutions that enables analysts to forecast long and short-term trends in the automotive industry. This role requires cutting edge data and cloud native technical...