Lead Engineer

10 hours ago

Chennai Guindy, India Prodapt Solutions Full time ₹ 12,00,000 - ₹ 25,00,000 per year

Overview

Join the Prodapt team in supporting a unified, scalable, and secure Jupyter-based environment for data science and machine learning. You will help build, maintain, and optimize the platform that empowers analysts, engineers, and scientists to explore data, develop models, and collaborate at scale.

Responsibilities

  • Develop, maintain, and enhance the Notebook platform built on JupyterLab, supporting both cloud and on-premises deployments.
  • Integrate and optimize connections to diverse data sources (BigQuery, Hive, Teradata, Hadoop, Spark, etc.).
  • Enable and support distributed data processing and analytics using Spark/PySpark and Dataproc.
  • Implement and maintain platform features for code execution, visualization, collaboration, and scheduling (e.g., Airflow integration).
  • Ensure platform security, including SSO, role-based access control, and compliance with governance and data privacy standards.
  • Support and automate ML workflows, including model training, experiment tracking (e.g., MLflow), and deployment.
  • Monitor platform health, troubleshoot issues, and optimize for performance, scalability, and reliability (e.g., GKE, Kubernetes, Openshift).
  • Collaborate with data scientists, engineers, and product teams to deliver robust, user-friendly solutions. Contribute to documentation, onboarding guides, and best practices for users and developers.

Requirements

Required Technical Skills

  • Proficiency in Python, especially for backend development and data engineering.
  • Experience with JupyterLab/Jupyter Notebooks, including kernel and extension development.
  • Familiarity with distributed data processing frameworks (Spark, PySpark, Dataproc).
  • Experience with cloud platforms (GCP preferred), Kubernetes, and containerization (Docker).
  • Strong understanding of data source integration (BigQuery, Hive, Teradata, Hadoop).
  • Experience with CI/CD, DevOps, and monitoring tools for cloud-based platforms.
  • Knowledge of security best practices (SSO, RBAC, credential management).
  • Familiarity with ML/AI workflows, experiment tracking (MLflow), and model deployment.
  • Excellent troubleshooting, debugging, and communication skills.

Preferred Qualifications

  • Experience with platform governance, code classification, and compliance automation.
  • Familiarity with VS Code integration, workflow automation tools (Zonkey, Airflow), and dashboarding (Tableau).
  • Experience supporting multi-tenant, highly available, and scalable notebook environments.
  • Exposure to large-scale financial/ML platforms.

  • Lead Engineer, Software

    5 hours ago

    Guindy, Chennai, India Celestica Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: Remote Position: NoRegion: Asia Country: India State/Province: Chennai City:  Guindy, Chennai  General Overview Functional Area:  Engineering Career Stream:  Design - Software EngineeringSAP Short Name:  LEN-ENG-DSEJob Level:  Level 08IC/MGR:  Individual Contributor Direct/Indirect Indicator:  Indirect Summary Celestica is the...

  • Senior Lead Engineer, Software

    5 hours ago

    Guindy, Chennai, India Celestica Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: Remote Position: NoRegion: Asia Country: India State/Province: Chennai City:  Guindy, Chennai  General Overview Functional Area:  Engineering Career Stream:  Design - Software EngineeringSAP Short Name:  LEN-ENG-DSEIC/MGR:  Individual Contributor Direct/Indirect Indicator:  Indirect Summary Celestica is looking for a dynamic software...

  • Lead Engineer, Software

    1 hour ago

    Guindy, Chennai, India Celestica Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Req ID: Remote Position: NoRegion: Asia Country: India State/Province: Chennai City:  Guindy, Chennai  Summary The Lead Software Engineer, could work on Marvell/Broadcom SDK, and be capable to work in network Operating system, YANG and other North bound Interface to help orchestration.#LI-DA1 Detailed Description Performs tasks such as, but not...

  • 08 - Lead Engineer, Software

    8 hours ago

    Guindy, Chennai, India Celestica Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per year

    Req ID: Remote Position: HybridRegion: Asia Country: India State/Province: Chennai City:  Guindy, Chennai  General Overview Functional Area:  Engineering Career Stream:  Design - Software EngineeringSAP Short Name:  LEN-ENG-DSEJob Level:  Level 08IC/MGR:  Individual Contributor Direct/Indirect Indicator:  Indirect Summary The Lead...

  • Lead Engineer, Software

    5 hours ago

    Guindy, Chennai, India Celestica Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Req ID: Remote Position: NoRegion: Asia Country: India State/Province: Chennai City:  Guindy, Chennai  Summary Celestica is looking for skilled and enthusiastic software engineers to join our team in developing cutting-edge data centers that leverage advanced GPU technologies. In this dynamic role, you will build orchestration software for the entire...

  • Lead - Data Engineer (Graph POD)

    3 weeks ago

    Chennai - Guindy, India Jobted IN C2 Full time

    Overview: Prodapt is lookig for Lead data engineers having 5+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL. Responsibilities: - Understanding the requirements - Performing in-depth analysis on data - Setting up secure data pipelines from ingestion to delivery - Individual contributor Requirements: 5- 10 years of...

  • ▷ Only 24h Left! Lead Engineer

    1 week ago

    Chennai - Guindy, India Jobted IN C2 Full time

    Overview: Prodapt is looking for Lead MLOPS Engineers having experience of 4 to 8 years from chennai or bangalore locations. Responsibilities: • Write clean, high-performance, high-quality, maintainable code • Discovering, analyzing, structuring and mining data • Be a key engineer contributing to the design, development of the new ML and Gen AI based...

  • Senior Technical Lead

    2 weeks ago

    Chennai - Guindy, India Jobted IN C2 Full time

    Overview: Prodapt is lookig for Senior Technical Lead in Data Engineering stream having 11+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL. Responsibilities: - Understanding the requirements - Performing in-depth analysis on data - Setting up secure data pipelines from ingestion to delivery - Individual contributor...

  • Design Engineer

    2 weeks ago

    Nandiambakkam, Chennai, India Lead HR Services Full time ₹ 1,80,000 - ₹ 2,76,000 per year

    Job Title: Design Engineer (Catia V5 & V6 Certified) (Off Roll) Company: Leading Commercial Vehicle Manufacturer Location: Vellivoyalchavadi Qualification: B.E. in Mechanical or Automobile Engineering Experience: 0 to 2 years of experience in the design field, preferably in automobile parts design Catia V5 & V6 certification is...

  • Lead Developer

    3 weeks ago

    Chennai - Guindy, India Jobted IN C2 Full time

    Overview: We are seeking a highly skilled Lead Developer for a mobile app development in React Native technology. The ideal candidate will possess a strong background in mobile app development, particularly with React Native, and demonstrate leadership capabilities to guide a team of developers through the migration process. Responsibilities: Key...