Machine Learning Engineer

3 days ago

Hyderabad, Telangana, India Deccan AI Full time US$ 1,20,000 - US$ 2,00,000 per year

JD: Machine Learning Engineer

Location:
Hyderabad

About Us
:

Deccan AI, founded by IIT Bombay and IIM Ahmedabad alumni, specializes in LLM model development and AI-first scaled operations. Based in SF and Hyderabad, our mission is to create AI for Good, driving innovation with positive societal impact.

About the Role

We are seeking a Machine Learning Engineer focused on Data Quality to ensure our model training data meets the highest standards of reliability, relevance, and safety. This role plays a pivotal part in the ML lifecycle — from automated QA of training data to developing evaluation strategies and leading rater workflows — ensuring that the data shipped aligns closely with client expectations and model performance objectives

.You will be at the intersection of engineering, research, and client success, acting as the final quality gatekeeper for datasets powering LLM fine-tuning, reward modeling, and evaluation

Key Responsibilities

Dataset Quality Automation

  • Automate quality assurance pipelines for SFT transcripts and RLHF preference pair
  • s.Implement schema validation, semantic overlap checks, and embedding-based deduplicatio
  • n.Integrate filters for safety, toxicity, and reward-signal balance in datasets.

Training & Benchmarking

  • Execute proxy fine-tuning (LoRA/QLoRA) on open-source LLMs using QA-approved datasets.
  • Train lightweight reward models and track performance via public/internal benchmarks and calibration metrics.

LLM Evaluaion

  • Orchestrate human and LLM-as-judge evaluations, including generation of critiques and scoring.
  • Design evaluation rubrics focused on consistency, helpfulness, and alignment with reward models.
  • Calculate and interpret statistical measures like binomial confidence intervals for evaluation scores.

Annotation & Rater Management

  • Build a continuous feedback loop with annotation teams, resolve disputes, and maintain high annotation quality.
  • Manage human evaluation workflows to maximize consistency and throug
    hput.

Research & Tooling

  • Prototype new signal-to-noise metrics (e.g., reward model entropy, preference flip
  • rate).Package tooling into reproducible notebooks and integrate into CI pipelines (Airflow/Dagster).

End Value to the Company

You will serve
as the client-end MLE a
dvocate, ensuring that all training and evaluation datasets are aligned with downstream needs. Your work will directly influence model performance, client satisfaction, and data-driven improvements to our ML systems.

Required Skills & Qualifications

  • Strong understanding of LLM training and evaluation pipelines (SFT, RLHF, reward modeling).
  • Experience with model performance diagnostics, identifying root causes in model behavior (e.g., data flaws, prompt issues).
  • Sk
    i
    lled in prompt engi
    n
    eering, dataset schema design, and annotation guideline development.
  • Proficient in Python, with experience using PyTorch, Hugging Face Transformers,FastAPI.
  • Comfortable building evaluation frameworks, including leaderboards and domain-specific test sets.
  • Familiarity with model evaluation metrics, clustering techniques, embedding models, and data drift detection.
  • Strong communication skills, especially in translating technical findings into actionable client insights.
  • Self-starter
    with a consultative
    mindset who can operate across technical and business domains.

Nice -to-Have

  • Experience with embedding similarity, data deduplication, or dataset filtering for toxicity/safety.
  • Prior work in LLM-as-a-Judge systems or human alignment evaluations.
  • Familiarity with CI/CD for data workflows and orchestration tools like Airflow or Dagster.

  • Machine Learning Engineer

    3 days ago

    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Machine Learning Engineer to join our dynamic team. As a Machine Learning Engineer, you will be responsible for the design, development, deployment, and maintenance of machine learning models and systems that drive our [mention specific business area or product, e.g., recommendation engine, fraud...

  • Machine Learning Engineer

    3 days ago

    Hyderabad, Telangana, India Algoleap Technologies Pvt Ltd Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the Role: We are seeking a highly skilled and experienced Machine Learning Engineer to join our dynamic team. As a Machine Learning Engineer, you will be responsible for the design, development, deployment, and maintenance of machine learning models and systems that drive our [mention specific business area or product, e.g., recommendation engine,...

  • Machine Learning Engineer

    3 days ago

    Hyderabad, Telangana, India Prudent Globaltech Solutions Full time US$ 1,20,000 - US$ 2,00,000 per year

    About the Role:We are seeking a highly skilled and experienced Machine Learning Engineer to join our dynamic team. As a Machine Learning Engineer, you will be responsible for the design, development, deployment, and maintenance of machine learning models and systems that drive our [mention specific business area or product, e.g., recommendation engine, fraud...

  • Machine Learning Engineer

    3 days ago

    Hyderabad, Telangana, India Phenom People Full time US$ 1,50,000 - US$ 2,00,000 per year

    Phenom Intro:Our purpose is to help a billion people find the right job Phenom is an AI-Powered talent experience platform that is redefining the HR tech space. We have grown into a global organization with offices in 6 countries and over 1,500 employees. As an HR tech unicorn organization, innovation and creativity is within our DNA. Come help us make...

  • Machine Learning Engineer

    2 days ago

    Hyderabad, Telangana, India Huemn Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job OverviewWe are seeking a highly experienced Machine Learning Engineer - Level 5 to join our dynamic team in Hyderabad. As a senior-level position, this role requires a deep understanding of machine learning principles and the ability to innovate and implement advanced solutions within our tech platforms. The ideal candidate will leverage their expertise...

  • Machine Learning Engineer

    3 days ago

    Hyderabad, Telangana, India ServiceNow Full time

    Machine Learning EngineerExperience : 5-7 YearsAbout the Role : We're looking for a Machine Learning Engineer to build and deploy robust, production-ready machine learning models. You will work on a variety of projects, from developing new algorithms to optimizing existing ones.Responsibilities : - Design, build, and deploy machine learning pipelines.- Work...

  • Machine Learning Engineer

    3 days ago

    Hyderabad, Telangana, India Motivity Labs Inc Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Machine Learning EngineerExp: 5-8 yearsLooking for a driven and innovative Machine Learning Engineer to help us scale and foresee problems that aren't apparent.We're seeking a hands-on individual with a strong passion for data and a proven ability to translate complex data challenges into robust, scalable machine learning solutions. In this role, you'll be a...

  • Machine Learning Engineer

    2 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Skill : Machine Learning Engineer AI/ML EngineerExperience : 3 to 8 YearsLocation : Bangalore/HydrabadPrimary Skill : Python/AwsJob Description:1 Design and implement scalable and efficient data architectures to support generative AI workflows.2 Fine tune and optimize large language models (LLM) for generative AI, conduct performance evaluation and...

  • Machine Learning Engineer

    1 week ago

    Hyderabad, Telangana, India Egen Full time

    We are seeking a highly motivated and experienced ML Engineer/Data Scientist to join our growing ML/GenAI team.You will play a key role in designing, developing and productionalizing ML applications by evaluating models, training and/or fine tuning them. You will play a crucial role in developing Gen AI based solutions for our customers. As a senior member...

  • Machine Learning Engineer

    2 days ago

    Hyderabad, Telangana, India Evoke HR Solutions Full time

    Machine Learning EngineerLocation : Hyderabad, IndiaExperience : 3- 7 yearsJob Description :We are looking for a talented Machine Learning Engineer to build and deploy intelligent systems.You'll work on the entire ML lifecycle, from model training and evaluation to production deployment and monitoring.If you're passionate about turning prototypes into...