Lead Engineer

7 days ago

Guindy Chennai Tamil Nadu, India Prodapt Solutions Full time ₹ 5,00,000 - ₹ 8,00,000 per year

Overview:

Join the Prodapt team in supporting a unified, scalable, and secure Jupyter-based environment for data science and machine learning. You will help build, maintain, and optimize the platform that empowers analysts, engineers, and scientists to explore data, develop models, and collaborate at scale.

Responsibilities:

  • Develop, maintain, and enhance the Notebook platform built on JupyterLab, supporting both cloud and on-premises deployments.
  • Integrate and optimize connections to diverse data sources (BigQuery, Hive, Teradata, Hadoop, Spark, etc.).
  • Enable and support distributed data processing and analytics using Spark/PySpark and Dataproc.
  • Implement and maintain platform features for code execution, visualization, collaboration, and scheduling (e.g., Airflow integration).
  • Ensure platform security, including SSO, role-based access control, and compliance with governance and data privacy standards.
  • Support and automate ML workflows, including model training, experiment tracking (e.g., MLflow), and deployment.
  • Monitor platform health, troubleshoot issues, and optimize for performance, scalability, and reliability (e.g., GKE, Kubernetes, Openshift).
  • Collaborate with data scientists, engineers, and product teams to deliver robust, user-friendly solutions.
  • Contribute to documentation, onboarding guides, and best practices for users and developers.

Requirements:

Required Technical Skills
  • Proficiency in Python, especially for backend development and data engineering.
  • Experience with JupyterLab/Jupyter Notebooks, including kernel and extension development.
  • Familiarity with distributed data processing frameworks (Spark, PySpark, Dataproc).
  • Experience with cloud platforms (GCP preferred), Kubernetes, and containerization (Docker).
  • Strong understanding of data source integration (BigQuery, Hive, Teradata, Hadoop).
  • Experience with CI/CD, DevOps, and monitoring tools for cloud-based platforms.
  • Knowledge of security best practices (SSO, RBAC, credential management).
  • Familiarity with ML/AI workflows, experiment tracking (MLflow), and model deployment.
  • Excellent troubleshooting, debugging, and communication skills.
Preferred Qualifications
  • Experience with platform governance, code classification, and compliance automation.
  • Familiarity with VS Code integration, workflow automation tools (Zonkey, Airflow), and dashboarding (Tableau).
  • Experience supporting multi-tenant, highly available, and scalable notebook environments.
  • Exposure to large-scale financial/ML platforms.

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Overview:Join the Prodapt team in building a unified, cloud-native environment for authoring, simulating, deploying, and monitoring business and risk rules at scale. You will help design, develop, and optimize robust RuleOps workflows that empower risk analysts, data scientists, and engineers to efficiently manage and operationalize rules with strong support...

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Overview:Join the Prodapt team in building AI/ML Solutions. If you have years of experience & would like to work on a cutting-edge ML platform, enabling efficient analysis, testing, and decision-making at scale.Responsibilities:Design, develop, and maintain simulation services and tools for ML feature, model, and rule evaluation.Build and optimize data...

  • Lead Engineer, Software

    7 days ago

    Guindy, Tamil Nadu, India Celestica Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 126467Remote Position: NoRegion: AsiaCountry: IndiaState/Province: ChennaiCity: Guindy, ChennaiSummaryThe Lead Software Engineer, could work on Marvell/Broadcom SDK, and be capable to work in network Operating system, YANG and other North bound Interface to help orchestration.Detailed DescriptionPerforms tasks such as, but not limited to, the...

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Overview:Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at scale.Responsibilities:Develop, maintain, and enhance...

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Overview:Join the Prodapt team in building a unified, enterprise-grade environment for developing, deploying, and scaling generative AI (GenAI) applications and agentic workflows. You will help design, develop, and optimize robust GenAI solutions that empower teams to leverage LLMs, agent frameworks, and retrieval-augmented generation (RAG) for a wide range...

  • Lead Engineer, Software 1

    1 week ago

    Guindy, Chennai, Tamil Nadu, India Celestica Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 128613Remote Position: NoRegion: AsiaCountry: IndiaState/Province: ChennaiCity: Guindy, ChennaiSummaryCelestica is looking for a dynamic software engineer who is passionate about working closely with the HW/SW interface to enable management of a fleet of devices in tomorrow's data center environments. The person needs be very conversant with board...

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overview:Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning inferencing. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently deploy, serve, and monitor ML models at scale, supporting both real-time and batch inference use...

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Overview:Join the Prodapt team in building the Model Automation Platform—a unified, cloud-native system that streamlines and automates the entire model development lifecycle. You will help design, develop, and optimize a scalable platform that enables rapid onboarding, training, evaluation, and governance of machine learning models across business...

  • 08 - Lead Engineer, Software

    7 days ago

    Guindy, Tamil Nadu, India Celestica Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Req ID: 125272Remote Position: NoRegion: AsiaCountry: IndiaState/Province: ChennaiCity: Guindy, ChennaiSummaryCelestica is looking for skilled and enthusiastic software engineers to join our team in developing cutting-edge data centers that leverage advanced GPU technologies. In this dynamic role, you will build orchestration software for the entire rack,...

  • Lead Engineer

    7 days ago

    Guindy, Chennai, Tamil Nadu, India Prodapt Solutions Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Overview:Join the Prodapt team in building a unified, enterprise-scale solution for model, data, and service management across the AI/ML lifecycle. You will help design, develop, and optimize robust workflows that empower data scientists, engineers, and business teams to efficiently prepare datasets, manage models, and orchestrate services at...