Senior Software Engineer

3 weeks ago

Bengaluru, Karnataka, India Turing Full time
Job Description

Project Overview

We are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project involves identifying and curating verifiable coding tasks from public GitHub repositories, supported by a human-in-the-loop review process.

As a contractor on this project, you will review code written by AI to solve real software tasks. Your feedback will help improve how future AI models learn to write and understand code.

Key Responsibilities

- Review and compare 34 model-generated code responses for each task using a structured ranking framework
- Assess code changes (diffs) for correctness, quality, readability, and performance
- Provide clear, concise explanations for your ranking decisions
- Maintain consistency and fairness across all evaluations
- Identify and document edge cases or unusual model behaviour
- Collaborate with the team to improve evaluation processes and identify improvement areas

Required Qualifications

Professional Experience

- Several years of experience as a software engineer (experience working as a data scientist will not be considered)
- Minimum 2 years of experience as a full-stack engineer at a leading tech product company (e.g., Google, Shopify, Microsoft, Snowflake, Meta, PayPal, etc.)

Note: Experience from contractual or part-time roles will not be considered. Only full-time employment qualifies.

Technical Skills

- Strong understanding of software design, debugging, and engineering best practices
- Familiarity with code review processes and version control systems
- Ability to analyze and compare real-world code changes
- Excellent written communication skills for clearly explaining technical evaluations

Preferred Qualifications

- Degree from a top-ranked university is preferred but not required
- Experience working with LLM-generated code or AI evaluation projects
- Background in developer tools or systems automation
- Exposure to AI research or developer agents

Engagement Details

Type: Contract (no medical benefits or paid leave)

Commitment: 1020 hours/week, with flexible work hours (partial overlap with Pacific Time)

Duration: 1 month (starting next week, with potential for extension)

Compensation: $50$150/hour, based on experience, geography, and skill level

About Turing:

Turing is one of the worlds fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. Youll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

If you have strong software engineering expertise and are interested in helping shape the next generation of AI-assisted development tools, we encourage you to apply.

  • Senior Software Engineer

    7 days ago

    Bengaluru, Karnataka, India SLK Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Senior Software Engineer AI IntegrationRole OverviewThe Senior Software Engineer AI Integration at one of SLK Fintech client who acts as the critical link between AI and real-world implementation. This professional is responsible for designing, connecting, and delivering robust, end-to-end pipelines that integrate AI models and agentic workflows into...

  • Software Engineer Senior

    1 day ago

    Bengaluru, Karnataka, India Progress Software Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Job Title: Software Engineer Senior (.Net, C#) Progress Location: Bangalore Contract type: Full time Job Description We are Progress (Nasdaq: PRGS) - a trusted provider of software that enables our customers to develop, deploy, and manage responsible, AI-powered applications and experiences with agility and ease. Were proud to have a diverse, global...

  • Software Quality Senior Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Boomi Software Full time

    Job DescriptionJoin us as aSoftware Quality Senior Engineeron our Software Engineering (Data Integration) team in Bengaluru to do the best work of your career and make a profound impact.Location - BangaloreWhat you ll achieveAs aSoftware Quality Senior Engineer, you will be responsible for testing sophisticated systems and software based on the customer s...

  • Senior Software Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Spigot Software Full time

    This role of Senior Software Engineer is our client. The group is responsible for the development of the technology platforms supporting key products including Connected Risk, World Check, and products in the Risk Managed Services space.Responsible for the analysis, definition, design, construction, testing, installation, modification, and maintenance of...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Aiprus Software Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Senior Software Engineer – Java, PySpark, Reactive ProgrammingLocation:Bengaluru, IndiaExperience:5+ YearsJob DescriptionWe are seeking an experiencedSenior Software Engineerwith strong expertise inJava, Apache PySpark, Python, and Reactive Programming. The ideal candidate will be responsible for designing, developing, and implementing...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Guidewire Software Full time

    Job DescriptionJob DescriptionRoles and Responsibilities- Operate as a start-up within a highly influential InsurTech company- Drive engineering best practices such as TDD and GitOps- Lead the team in architecture and design discussions, and represent the team in cross company architecture decisions- Partner with product management and engineering leadership...

  • Senior Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Guidewire Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    SummaryAs a Software Engineer at Guidewire, you're part of a distributed team helping change the face of insurance by creating technology that shapes the future of the property and casualty industry. With over 3000+ team members working on a large-scale platform, your role is crucial in giving insurers the cutting-edge tools they need to take care of their...

  • Senior Software Engineer

    6 days ago

    Bengaluru, Karnataka, India Guidewire Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    SummaryAs a Software Engineer at Guidewire, you're part of a distributed team helping change the face of insurance by creating technology that shapes the future of the property and casualty industry. With over 3000+ team members working on a large-scale platform, your role is crucial in giving insurers the cutting-edge tools they need to take care of their...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Guidewire Software Full time

    Job DescriptionJob DescriptionSummary- As a Software Engineer at Guidewire, youre part of a distributed team helping change the face of insurance by creating technology that shapes the future of the property and casualty industry. With over 3000+ team members working on a large scale platform, your role is crucial in giving insurers the cutting edge tools...

  • Senior Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Guidewire Software Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    SummaryGuidewire is searching for a unique individual who is ambitious, curious, and hungry for a rare chance to transform a 500-year-old industry from the inside out. Through our data listening capabilities, we collect more data (and more important data) than any other company in our market. We seek ways to make sense of it, showcase it, and transform it...