ML Ops Engineer

Job Description

Your Future Evolves Here

Evolent Health has a bold mission to change the health of the nation by changing the way health care is delivered.Our pursuit of this mission is the driving force that brings us to work each day. We believe in embracing new ideas, challenging ourselves and failing forward. We respect and celebrate individual talents and team wins. We have fun while working hard and Evolenteers often make a differencein everything from scrubs to jeans.

Are we growing Absolutely and Globally. In 2021 we grew our teams by almost 50% and continue to grow even more in 2022.Are we recognized as a company you are supported by for your career and growth, and a great place to workDefinitely. Evolent Health International (Pune, India) has been certified as Great Places to Work in 2021. In 2020 and 2021 Evolent in the U.S. was both named Best Company for Women to Advance list by Parity.org and earned a perfect score on the Human Rights Campaign (HRC) Foundation's Corporate Equality Index (CEI). This index is the nation's foremost benchmarking survey and report measuring corporate policies and practices related to LGBTQ+ workplace equality.

We recognize employees that live our values, give back to our communities each year, and are champions for bringing our whole selves to work each day. If you're looking for a place where your work can be personally and professionally rewarding, don't just join a company with a mission. Join a mission with a company behind it.

What You'll Be Doing:

MLOps Engineer

We are seeking a highly capable MLOps Engineer to join our growing AI/ML Team. You will bridge the gap between data science and operations, ensuring that machine learning models are efficiently tested, deployed, monitored, and maintained in production environments. You will work closely with data scientists, software engineers, infrastructure, and development teams to build scalable and reliable ML infrastructure. You will be instrumental in supporting clinical decision-making, operational efficiency, quality outcomes, and patient care.

What You Will Be Doing:

Model Deployment and Infrastructure

- Design, build, and maintain scalable, secure ML pipelines for model training, validation, deployment, and monitoring
- Automate deployment workflows using CI/CD pipelines and infrastructure-as-code tools
- Partner with Infrastructure Teams to manage (Azure) cloud-based ML infrastructure, ensuring compliance with InfoSec and AI policies
- Ensure applications run at peak efficiency

Model Testing, Monitoring, and Validation

- Develop rigorous testing frameworks for ML models, including clinical validation, traditional model performance measures, population segmentation, and edge-case analysis
- Build monitoring systems to detect model drift, overfitting, data anomalies, and performance degradation in real-time
- Continuously analyze model performance metrics and operational logs to identify improvement opportunities
- Translate monitoring insights into actionable recommendations for data scientists to improve model precision, recall, fairness, and efficiency

Model Transparency & Governance

- Maintain detailed audit trails, logs, and metadata for all model versions, training datasets, and configurations to ensure full traceability and support internal audits
- Ensure models meet transparency and explainability standards using tools like SHAP, LIME, or integrated explainability APIs.
- Collaborate with data scientists and clinical teams to ensure models are interpretable, actionable, and aligned with practical applications
- Support corporate Compliance and AI Governance policies
- Advocate for best practices in ML engineering, including reproducibility, version control, and ethical AI
- Develop product guides, model documentation, and model cards for internal and external stakeholders

Required Qualifications:

- Bachelor's Degree in Computer Science, Machine Learning, Data Science, or a related field
- 4+ years of experience in MLOps, DevOps, or ML engineering

- Proficiency in Python and ML frameworks such as Keras, PyTorch, Scikit-Learn, TensorFlow, and XGBoost
- Experience with containerization (Docker), orchestration (Kubernetes), and CI/CD tools
- Familiarity with healthcare datasets and privacy regulations
- Strong analytical skills to interpret model performance data and identify optimization opportunities
- Proven ability to optimize application performance, including improving code efficiency, right-sizing infrastructure usage, and reducing system latency
- Experience implementing rollback strategies, including version control, rollback triggers, and safe deployment practices across lower and upper environments
- 3+ years of experience developing in a cloud environment (AWS, GCS, Azure)
- 3+ years of experience with Github, Github Actions, CI/CD, and source control
- 3+ years working within an Agile environment

Preferred Qualifications:

- Experience with MLOps platforms like MLflow, TFX, or Kubeflow
- Healthcare experience, particularly using administrative and prior authorization data
- Proven experience with developing and deploying ML systems into production environments
- Experience working with Product, Engineering, Infrastructure, and Architecture teams
- Proficiency using Azure cloud-based services and infrastructure such as Azure MLOps
- Experience with feature flagging tools and strategies

#Li-remote

Mandatory Requirements:

Employees must have a high-speed broadband internet connection with a minimum speed of50 Mbpsand the ability to set up a wired connection to their home network to ensure effective remote work. These requirements may be updated as needed by the business.

Evolent Health is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status.

---