Principal Data Science Technologist

Machine Learning Engineer Position Summary

We are seeking a highly skilled Machine Learning Engineer to join our team.

This position conducts the support, maintenance, and monitoring of Machine Learning (ML) models and software components that solve challenging business problems for the organization. You will work in collaboration with various teams to ensure the successful deployment and management of ML models.

• Deploy and manage machine learning models in production environments, ensuring smooth integration with existing systems
• Monitor model performance using established metrics (accuracy, precision, recall, F1 score, etc.) and identify potential issues like performance degradation, drift, or bias
• Respond to and resolve production incidents promptly, minimizing downtime and impact on business operations
• Collaborate with stakeholders (data scientists, software engineers, operations) to diagnose and fix problems
• Develop and implement contingency plans for model failures or unexpected events
• Maintain documentation for deployed models, including deployment logs, monitoring dashboards, and troubleshooting procedures
• Ensure model compatibility with new software versions and infrastructure changes.
• Optimize model resource utilization (memory, CPU) to reduce costs and improve efficiency.
• Archive and manage different model versions for auditability and rollback capabilities.
• Analyze logs, error messages, and other data to diagnose model issues.
• Utilize debugging tools and techniques specific to machine learning (profiling, feature importance analysis, anomaly detection).
• Reproduce and isolate issues in test environments before fixing them in production.
• Document bug fixes and lessons learned to improve future model development and maintenance.
• Analyze monitoring data proactively to identify trends and potential issues before they impact production.
• Stay up-to-date on new monitoring tools and techniques for machine learning systems.
• Report on model performance and health to stakeholders regularly.
• Stay up-to-date on advances in machine learning and best practices for production usage.
• Contribute to documentation and knowledge sharing within the team.

Primary Requirements:

• Demonstrated proficiency in Python, SQL, and cloud platforms such as GCP, AWS, or Azure.
• In-depth experience in DevOps practices for supporting and maintaining applications and products driven by Machine Learning (ML) and Artificial Intelligence (AI).
• Expertise in developing and optimizing ML pipelines.
• Understanding and experience in scaling solutions for ML and AI applications.
• Demonstrate advanced expertise in various ML frameworks such as Python, Scala, or Java for debugging and developing minor enhancements to models.
• Proficiency in deploying and managing models using Kubernetes
• Experience in supporting products with capabilities including Deep Learning, Supervised, and Unsupervised techniques.
• Ability to implement solutions using Python, Scala, or Java.
• Ability to utilize visualization tools for model monitoring and management in production.
• Experience in deploying and managing machine learning models using containerization tools such as Kubernetes, Docker, Fargate, etc.
• Strong documentation and communication skills for technical and non-technical stakeholders.
• Strong investigative and troubleshooting skills with regards to ML Pipelines.

Secondary Requirements:

• Knowledgeable in data visualization tools such as Power BI (PBI), Looker, and Tableau.
• Experience in advanced model monitoring and management techniques.
• Comfortable working with data scientists, data engineers, product owners, and architects
• Strong background in Agile/Kanban development methodologies.
• Proven ability to work within Agile Frameworks for ML and AI projects.