Lead MLOps Engineer

2 weeks ago

Rajkot, Gujarat, India MathCo Full time

As a Lead MLOps Engineer, you will play a pivotal role in building scalable and reliable machine learning infrastructure for enterprise-grade applications. We are looking for a Lead Data Engineer with strong exposure to MLOps practices, ideally someone with a core data engineering background who has worked on large-scale data platforms. This is a hybrid role that blends big data engineering with end-to-end model lifecycle management- from development and deployment to monitoring and retraining. The ideal candidate will bring hands-on experience with Databricks, PySpark, and the orchestration of production-grade ML pipelines, enabling efficient and resilient solutions in dynamic, data-driven environments.

Roles and Responsibilities

  • Design and implement distributed data processing pipelines using PySpark.
  • Collaborate with business architects and stakeholders to design scalable data and ML workflows.
  • Optimize performance of Spark applications through tuning, resource management, and caching strategies.
  • Debug long-running Spark jobs using Spark UI; address OOM errors, data skew, shuffle issues, and job retries.
  • Manage model deployment workflows using tools like MLflow for tracking, versioning, and registry.
  • Build and maintain CI/CD pipelines for both data and ML workflows.
  • Containerize applications using Docker and orchestrate using tools like Kubernetes.
  • Monitor production models, manage retraining workflows, and handle dependency management.
  • Contribute to clean, collaborative Git workflows with practices such as branching, rebasing, and PR reviews.
  • Work across teams to ensure models are production-ready, scalable, and aligned with business goals.
  • Develop and orchestrate big data workflows on Databricks.
  • Work on at least one cloud platform (preferably Azure) for scalable data and ML solutions.

Required Skills and Experience:

  • Proficient in PySpark, with strong experience in Spark performance tuning and optimization.
  • Strong expertise in Databricks for development, orchestration, and job monitoring.
  • Working knowledge of MLflow or similar tools for model lifecycle management.
  • Proficient in Python and SQL.
  • Deep understanding of distributed data systems, job scheduling, and fault tolerance.
  • Experience in working with structured/unstructured data formats like Parquet, Delta, and JSON.
  • Familiarity with feature stores, model monitoring, drift detection, and automated retraining workflows.
  • Strong command over Git and version control in multi-developer environments.
  • Experience with CI/CD tools for data and ML pipelines.
  • Knowledge of containerization (Docker) and orchestration (Kubernetes) is a plus.
  • Experience with at least one major cloud platform (Azure preferred, or AWS/GCP).

  • AI Engineering Lead

    4 weeks ago

    Rajkot, Gujarat, India Software Co ? Full time

    Lead the World's Most Advanced AI-Powered Full-Stack Application Designer & Developer Platform.Software Co is on a mission is to redefine the way software is built. Over the past decade, we've delivered hundreds of enterprise-grade projects, gaining unparalleled experience, insights, and technical depth. Now, we're channelling that expertise into building...

  • Software Engineering Lead

    4 hours ago

    Rajkot, Gujarat, India beBeeEngineering Full time US$ 2,00,000 - US$ 2,50,000

    Job OverviewWe are seeking a seasoned Software Engineering Lead to drive the development and maintenance of our trusted, scalable, and compliant platform.The successful candidate will have 10+ years of experience in software engineering, including at least 2+ years of leadership experience. They will have designed, built, and scaled production applications...

  • Ai Engineer

    1 day ago

    Rajkot, Gujarat, India Universal Software Full time

    About the Role:We are seeking a highly skilled and innovative AI Engineer to join our team. The ideal candidate will design, develop, and deploy AI and machine learning solutions to solve complex business problems. You will work closely with cross-functional teams to integrate AI models into products and services, ensuring scalability, performance, and...

  • Engineering Technical Lead

    1 day ago

    Rajkot, Gujarat, India Leap Wallet. Full time

    Stage: Early Stage | B2CHQ: Remote (Singapore / Vancouver)Team Size: ~26 (across Asia & North America)Investors: Pantera, CoinFund, Arrington, AccelRole DetailsTitle: Engineering Lead / Manager – Stablecoin InitiativeLocation: Remote (India) | Relocation allowed | No visa sponsorshipExperience: 6+ years backend engineeringType: Full-timeAbout LeapLeap is a...

  • Data Science Manager

    1 week ago

    Rajkot, Gujarat, India Blend Full time

    Job Title: Manager – AI & Data Science Location: India (Remote/Hybrid) Reports To: Director – AI & Data Science / Engagement Lead About the Role We are seeking a skilled and proactive Manager – AI & Data Science to lead day-to-day delivery, innovation, and client engagement for our AI-driven marketing measurement and optimization programs...

  • Senior Platform Automation Specialist

    3 days ago

    Rajkot, Gujarat, India beBeeDevopsengineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Role Overview:We are seeking a skilled platform engineer to spearhead automation, system reliability, and robust software delivery pipelines utilizing conventional practices and advanced AI/ML techniques in global enterprises.Main Responsibilities:Develop, deploy, and manage CI/CD pipelines and infrastructure automation, leveraging AI for...

  • Tech Lead

    16 hours ago

    Rajkot, Gujarat, India Actowiz Solutions Full time

    Job Title: Lead Data Scraping Engineer Location: Ahmedabad/WFO Experience Level: Senior (4+ years) Employment Type: Full-time Job Summary: We are seeking a highly skilled and experienced Lead Data Scraping Engineer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading...

  • Leading Cloud-Native Infrastructure Engineer

    1 day ago

    Rajkot, Gujarat, India beBeeInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Infrastructure Engineer">We are seeking a highly skilled engineer to help design, build, and operate large-scale cloud-native infrastructure systems.">">Design and implement scalable Kubernetes clusters.">Develop strategies for cost optimization and infrastructure utilization.">Build internal platform services for use by engineering teams across the...

  • Sr. Lead Site Reliability Engineer – Technical

    3 weeks ago

    Rajkot, Gujarat, India Shell Recharge Solutions Full time

    Shell Recharge Solutions is looking for a Sr.Lead Site Reliability Engineer + People/ Team management to join our team.We would like to find a highly engaged engineer who is obsessed with monitoring, observability, code quality and self-healing infrastructures with Team management You should be able to identify, troubleshoot, and resolve issues quickly and...

  • Cyber Security Engineer

    3 weeks ago

    Rajkot, Gujarat, India eInfochips (An Arrow Company) Full time

    eInfochips (An Arrow Company):eInfochips, an Arrow company (A $27.9 B, NASDAQ listed (ARW); Ranked #154 on the Fortune List), is a leading global provider of product engineering and semiconductor design services. 25+ years of proven track record, with a team of over 2500+ engineers, the team has been instrumental in developing over 500+ products and 40M...