Python Data Pipeline

6 days ago

Bengaluru, Karnataka, India Technoculture Research Full time

We're looking for a Python engineer with strong data processing experience to build and maintain our ML training infrastructure. You'll design scalable data pipelines, optimize training workflows, and work directly with large-scale robotics datasets. Experience with PyTorch is highly valuable.

Tech Stack

Core: Python, PyTorch, Ray, Airflow, Pandas

Key Responsibilities

  • Design, build, and maintain scalable data pipelines for ML training workflows
  • Process and transform large-scale robotics datasets for model training
  • Optimize data ingestion, preprocessing, and feature engineering pipelines
  • Collaborate with ML engineers to streamline model training and evaluation
  • Implement distributed computing solutions using Ray for parallel processing
  • Build and maintain Airflow DAGs for orchestrating complex data workflows
  • Write clean, well-tested, production-ready code

About Company: Technoculture Research is re-imagining how the world measures health. We build micro-scale electrochemical laboratories that bring lab-grade accuracy directly into the hands of clinicians, community health workers, and even patients at home. Our platform integrates microfabricated electrodes, novel surface chemistries, and microfluidics to run protein, nucleic-acid, and metabolite assays within minutes. By replacing costly optical detection with electron sensing, we significantly reduce instrument and per-test costs, making precision diagnostics truly accessible. Our mission is to make diagnostics abundant, so every critical health decision is guided by immediate, affordable results.

  • Python Developer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Design, implement, test, and maintain serverside applications, automation, or data pipelines using Python Design, implement, test, and maintain serverside applications, automation, or data pipelines using Python Strong proficiency in Python 3.x and idiomatic Python (async patterns, type hints, context managers). Experience with at least one web framework:...

  • Python Developer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID: 344658NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Python Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Design, implement, test, and maintain...

  • Python Developer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Python Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Design, implement, test, and maintain serverside...

  • Data Analyst

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Keywords: Statistical analysis, Data Visualization, Dashboards, Data pipelines, Data Gathering, Root Cause Analysis Description: A data analyst who can fetch required data from field vehicle data tables and analyze as per the use cases by using various data visualization techniques. Build tools. Build and maintain dashboards Building suitable tools for...

  • Spark / Data Pipeline Engineer

    4 days ago

    Bengaluru, Karnataka, India Flexton Inc. Full time

    Now Hiring: Spark / Data Pipeline Engineer (3–5 Years Experience)Location:Bengaluru, Karnataka, IndiaOpen (Prefer candidates from top universities or enterprise-level companies)We are looking for a talentedSpark / Data Pipeline Engineerto join our team and work on scalable, distributed data applications. If you're passionate about building and optimizing...

  • Data Observability Architect

    3 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Architect and implement a comprehensive data observability framework leveraging Open Metadata, Great Expectations, and Open Lineage. Customize and extend open-source observability tools using Python/TypeScript/Java to meet enterprise-specific needs. Integrate data observability pipelines with existing data platforms, data warehouses, and workflow...

  • FirstHive - Lead DataOps Engineer - ETL/ELT Pipelines

    2 weeks ago

    Bengaluru, Karnataka, India FirstHive | CDP+AI Data Platform Full time ₹ 2,00,00,000 - ₹ 4,00,00,000 per year

    Job Designation :Senior Data Ops Engineer Team LeadJob Location :BengaluruKey ResponsibilitiesLeadership & Team Management :Lead and mentor a team of DataOps engineers in designing and maintaining robust data pipelines.Plan, assign, and review team tasks to ensure timely and quality delivery.Collaborate with data engineers, data scientists, and business...

  • Data Engineer and python developer

    2 days ago

    Bengaluru, Karnataka, India Aetherrise Solutions Full time

    Data Engineer / Python DeveloperDesign, build & maintain data pipelines. Develop Python apps, ETL workflows, APIs. Work with SQL, cloud, big data tools. Ensure data quality, performance & scalability. Collaborate with analytics & product teams. Required Candidate profileBE/BTech or equivalent with 3–8 yrs experience. Strong Python, SQL & ETL. Experience...

  • Python Azure Data Engineer

    2 days ago

    Bengaluru, Karnataka, India DXC Technology Full time

    Job Description:Python Azure Data EngineerJob Location: Hyderabad / Bangalore / Chennai / Kolkata / Noida/ Gurgaon / Pune / Indore / MumbaiThe Data Engineers will support data transformation and pipeline development for the DOCTA (Data Operations, Controls, Transformation & Automation) platform, enabling client's data-driven decision making.Key...

  • Software Developer – Risk Data Pipelines

    6 days ago

    Bengaluru, Karnataka, India Squarepoint Full time

    Team: Risk Data PipelinesPosition OverviewRisk Technologydevelops core services and systems required by Squarepoint's systematic and quantitative trading strategies, such as real-time risk controls, position/inventory/P&L monitoring, internal order routing, and various pre and post-trading services.Risk Data Pipelinesdevelops software on top of the core Risk...