Devops & ML Ops Engineer - EG

At EG, we develop software for our customers so they can focus on their profession.

Our industry-specific software is built by peers from the industry, and backed by the scale of EG for stability, innovation, and security.

We are committed to advancing industries by tackling big challenges such as resource use, efficiency, and sustainability.

We are a thriving global workforce of 3000+ employees, with a 850+ strong team based in Mangaluru, India. We have a people first culture fostering innovation, collaboration and continuous learning
Join us in creating software that works for people, not software that makes people work.

Visit our career page to meet some of your future colleagues, explore our culture, and watch our video "We Make a Difference".

Learn more about EG here.

We are building a new, international team dedicated to developing and maintaining a cutting-edge AI assistance solution for service and support. The
DevOps & ML Ops Engineer
with a minimum of
5 years of experience
will be responsible for designing, implementing, and managing the cloud infrastructure, deploying AI models at scale, and ensuring operational excellence of our AI products based on AWS Large Language Models (LLMs).

As part of the department
A newly set up team will be in the structure of EG IT department, which main goal is to support our clients and employees with their daily activities. As our AI-based product will be integrated with ServiceNow tool, new team will be closely cooperating with ServiceNow team.

Your workday, your tasks and mandatory skill set:

• Designing, implementing, and managing scalable, secure, and reliable cloud infrastructure on AWS for AI model deployment, monitoring, and maintenance.
• Automating deployment pipelines, CI/CD workflows, and model updates to ensure continuous delivery and integration.
• Optimizing resource utilization on AWS, balancing performance and cost-efficiency.
• Monitoring, troubleshooting, and resolving operational issues related to AI models, data pipelines, and infrastructure.
• Implementing logging, alerting, and performance tracking to ensure high availability and reliability of AI services.
• Collaborating closely with Data Scientists and Software Engineers to translate ML models into production-ready solutions.
• Ensuring compliance with security policies and data governance standards within AWS infrastructure.
• Staying updated on advancements in ML Ops, cloud engineering, and AI deployment best practices.

You are the ideal candidate if you:

• Are seeking a passionate individual who is genuinely enthusiastic about developing AI-based solutions, enjoys working with AI, and believes in its strategic value for the organization.
• Understand that data availability is fundamental to AI success and recognizes that meaningful insights and value are only achievable when the right data is in place first.

Experience and subject matter skills:

• Proven experience in ML Ops, cloud engineering, or DevOps roles, preferably with AWS cloud services.
• Strong expertise with AWS infrastructure—services like SageMaker, Bedrock, Lambda, EC2, S3, CloudFormation, and related tools.
• Experience with containerization technologies (Docker, Kubernetes) and orchestration.
• Hands-on skills in scripting (Python, Bash) and automation frameworks.
• Knowledge of CI/CD pipelines, monitoring tools, and infrastructure-as-code practices.
• Understanding of ML lifecycle management, model deployment, and optimization.
• Good problem-solving skills, with a focus on operational stability and scalability.

Preferred:

• Experience working with AI/ML models, especially LLMs, in cloud environments.
• Background in support or chatbot deployment scenarios.
• Familiarity with security and compliance standards in cloud environments.
• Demonstrated leadership in managing cross-cultural, international teams within agile environments.
• Familiarity with cloud security standards and data governance.

Additionally:

• Fluent English (written and spoken)
• Strong analytical and problem-solving skills.
• Ability to work independently and collaboratively within a new team environment.
• Experience working in international, multicultural teams

"
What can you expect from us
?"

• A professional and business-driven environment with lots of exciting projects
• Super talented and committed colleagues who know that they only get better through collaboration and active knowledge sharing.
• Possibility of personal and professional development
• Targeted training courses in our EG Academy
• Best in industry employee benefits