Data Scientist

We are CirrusLabs . Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a dependable partner organization that delivers on commitments. We strive to maintain integrity with our employees and customers. Every action we take is driven by value. The core of who we are is through our well-knit teams and employees. You are the core of a values driven organization.You have an entrepreneurial spirit. You enjoy working as a part of well-knit teams. You value the team over the individual. You welcome diversity at work and within the greater community. You aren't afraid to take risks. You appreciate a growth path with your leadership team that journeys how you can grow inside and outside of the organization. You thrive upon continuing education programs that your company sponsors to strengthen your skills and for you to become a thought leader ahead of the industry curve.You are excited about creating change because your skills can help the greater good of every customer, industry and community. We are hiring a talented Junior Data Scientist & Agentic AI Developer to join our team. If you're excited to be part of a winning team, CirrusLabs ( http://www.cirruslabs.io ) is a great place to grow your career.Experience - 3 to 5 yearsLocation - BengaluruPosition OverviewWe are seeking a capable Data Scientist and Agentic AI Developer to independently design, develop, and evaluate intelligent AI agents. This role requires hands-on delivery of production-ready agentic systems with robust evaluation frameworks and measurable quality outcomes.Experience Required3-5 years of professional experience in data science, machine learning, and AI development with demonstrated project deliveryKey ResponsibilitiesAI Agent Development & DeliveryIndependently design and develop production-grade agentic AI systems using Large Language ModelsBuild and deploy multi-step reasoning workflows with tool orchestrationImplement and optimize RAG (Retrieval-Augmented Generation) pipelines end-to-endIntegrate external tools, APIs, and databases into functional agent systemsDeliver scalable, reliable AI agents that meet performance benchmarksOwn the complete development lifecycle from design to deploymentEvaluation Framework ImplementationBuild comprehensive evaluation systems using LLM-as-a-judge methodologiesDevelop and deploy automated scoring pipelines for all quality metrics (correctness, helpfulness, coherence, relevance, simplicity, collaborativity)Implement RAGAs framework for factual accuracy and hallucination detectionCreate custom evaluator code for overall response quality assessmentDeliver actionable evaluation reports with clear improvement recommendationsSet up monitoring dashboards for real-time performance trackingPerformance & Efficiency OptimizationMonitor and optimize latency, throughput, and cost-per-interaction metricsImplement token usage optimization strategies to reduce operational costsTrack and improve task completion rates and success metricsAnalyze tool interaction efficiency and optimize workflowsDeliver measurable improvements in agent response times and resource utilizationData Science & Analytics DeliveryConduct statistical analysis on agent performance data and user interactionsBuild and maintain automated reporting dashboards for stakeholdersDesign and execute A/B tests to validate improvementsAnalyze error patterns and implement corrective measuresDeliver data-driven insights that drive product decisionsSafety, Ethics & Compliance ImplementationImplement bias detection systems and ensure fairness in outputsBuild harmful content filtering and safety guardrailsDevelop and deploy compliance monitoring for EU AI Act, GDPR, HIPAA, DPDP standardsCreate radar chart visualizations for compliance metricsDocument and maintain transparency, explainability, and human oversight measuresDeliver audit-ready compliance reportsRequired Skills & QualificationsTechnical Expertise (Must Have)Programming : Strong Python skills with production code experience; advanced SQLLLM Development : Proven experience building applications with GPT, Claude, or similar modelsFrameworks : Hands-on experience with LangChain, LangSmith, Phoenix, or equivalent agent frameworksEvaluation Tools : Experience implementing RAGAs or similar evaluation frameworksMLOps : Experience deploying ML models to production and monitoring performanceAPIs & Integration : Strong experience with REST APIs, webhooks, and system integrationVector Databases : Working knowledge of Pinecone, Weaviate, Chroma, or similarProven Delivery ExperienceTrack record of shipping AI/ML products or features to productionExperience building end-to-end evaluation pipelines independentlyDemonstrated ability to optimize model performance and reduce costsPortfolio of completed projects with measurable business impactExperience working with observability and monitoring toolsDomain ExpertiseDeep understanding of prompt engineering and LLM behavior optimizationKnowledge of agentic architectures, tool calling, and multi-step reasoningExperience with conversational AI systems and dialogue managementUnderstanding of information retrieval and RAG system designFamiliarity with AI safety principles and alignment techniquesAnalytical & Problem-Solving SkillsStrong debugging and troubleshooting capabilitiesAbility to analyze complex systems and identify root causesData-driven decision making with statistical rigorPerformance optimization mindsetProactive problem identification and resolutionProfessional SkillsSelf-driven with minimal supervision requiredStrong ownership mentality and accountability for deliverablesClear communication of technical concepts to non-technical stakeholdersAbility to work under deadlines and manage multiple prioritiesResults-oriented with focus on business impactRequired Tools & TechnologiesMust Have Experience WithFrameworks : LangChain or LangGraph (production experience)Monitoring : LangSmith, Phoenix, or similar observability platformsLLM APIs : OpenAI, Anthropic, or Azure OpenAIDatabases : PostgreSQL/MySQL + vector databasesCloud : AWS, Azure, or GCP deployment experienceDevOps : Docker, CI/CD pipelines, Git workflowsShould Be Comfortable WithPython libraries: pandas, numpy, scikit-learn, matplotlibEvaluation frameworks: RAGAs, custom scoring systemsData visualization: Plotly, Streamlit, or TableauAPI development: FastAPI or FlaskTesting frameworks: pytest, unit testing, integration testingWork Environment & ExpectationsIndependence LevelWork autonomously on assigned features and improvementsMake technical decisions within project scopeCollaborate with product and engineering teamsEscalate blockers proactively but resolve most issues independentlyAccountabilityMeet sprint commitments and delivery timelinesOwn quality of your deliverables end-to-endParticipate in on-call rotation for production supportMaintain high code quality and documentation standardsCollaborationWork with product managers to understand requirementsPartner with senior engineers on architecture decisionsShare knowledge through documentation and team sessionsParticipate in code reviews and provide constructive feedbackPreferred QualificationsBachelor's or Master's in Computer Science, Data Science, or related fieldExperience with RLHF (Reinforcement Learning from Human Feedback)Experience with multi-modal AI systemsPrevious work in regulated industries (healthcare, finance,Logistics)