Data Engineer II

2 days ago


Bengaluru, India ADM Full time

Job Title: Data Engineer II Job Summary: We are seeking a highly skilled and motivated Data Engineer II - AI/ML to join our innovative team, with a focus on OpenAI technologies, Azure AI services, and cutting-edge LLM and RAG architectures. The ideal candidate will possess deep technical expertise in large language models, hands-on experience with Azure's AI ecosystem, and a strong background in Python-based machine learning, CI/CD pipelines, and version control workflows. This role is pivotal in designing, developing, and deploying intelligent AI solutions that drive value through automation, natural language processing (NLP), and advanced retrieval mechanisms. Key Responsibilities: Design and implement AI-powered applications using OpenAI APIs (GPT, Whisper, Codex). Build and deploy scalable AI/ML solutions using Azure OpenAI, Azure Storage, Azure Container Apps, Azure Functions, and Azure Cognitive Services. Architect and implement LLM-based pipelines, including fine-tuning, prompt engineering, and RAG (Retrieval-Augmented Generation) using vector databases (e.g., Azure AI Search, Pinecone, FAISS). Build intelligent document processing systems with embeddings, semantic search, and LLM chaining (LangChain, Semantic Kernel). Develop and maintain robust APIs and AI services using Python, FastAPI, or Flask. Implement CI/CD pipelines for model deployment and service delivery using Azure DevOps, GitHub Actions, or similar tools. Utilize Git and version control systems to manage source code, workflows, and model versioning. Collaborate with cross-functional teams to deliver AI solutions in a production environment. Monitor, evaluate, and optimize AI systems for performance, accuracy, and cost-efficiency. Required Skills & Qualifications: 4 years of relevant experience Strong proficiency with OpenAI models and APIs. Deep hands-on experience with the Azure AI ecosystem: Azure OpenAI, Azure Storage, Container Apps, App Services, Azure Cognitive Search, etc. Solid understanding and hands-on implementation of LLMs , including: bapPrompt tuning and prompt chaining RAG with embeddings and vector databases Fine-tuning LLMs on domain-specific data Proficient in Python and ML/NLP libraries: transformers, langchain, sentence-transformers, pandas, etc. Experience building and maintaining CI/CD pipelines using Azure DevOps or GitHub Actions. Comfortable with version control using Git, GitHub, or Azure Repos. Strong foundation in machine learning/ deep learning/ natural language processing. Experience with vector databases (e.g., Pinecone, Weaviate, Qdrant, Azure AI Search). Exposure to MLOps practices and production-level deployment. Excellent problem-solving and analytical skills. Outstanding communication and collaboration abilities. Nice to Have: Experience with multi-modal AI, Generative AI, or RLHF Familiarity with Databricks, MLflow, or Azure Synapse Understanding of Responsible AI, AI governance, and data privacy Knowledge of containerization using Docker and orchestration with Kubernetes


  • Data Engineer II

    1 week ago


    Bengaluru, India Dotdash Meredith Full time

    Job Description As a Data Engineer II, you will be responsible for designing, implementing, and maintaining data infrastructure that supports data science activities, including machine learning (ML) projects. You will work closely with data scientists, other data engineers, and cloud infrastructure teams in both Bengaluru and the US to ensure the...

  • Data Engineer II

    2 weeks ago


    Bengaluru, Karnataka, India eClinical Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    OVERVIEWThe Data Engineer II will work closely with clients and provide technical consulting services, configuration of the elluminate platform, development for specific projects that include trial configuration, quality control, process improvements, system validation, custom analytics development, clinical software implementations and integrations....

  • Sde Ii

    2 weeks ago


    Bengaluru, Karnataka, India Hevo Data Full time

    **Bangalore, India** **Engineering - Backend /** **Full Time /** **On-Site** **About Hevo**: - Ever wondered, what’s common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to...

  • Data Engineer II

    1 week ago


    Bengaluru, India Zeta Services Inc. Full time

    About Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015.Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core...

  • Data Engineer II

    1 week ago


    Bengaluru, India Zeta Services Inc. Full time

    About Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015.Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core...

  • Engineer II

    3 weeks ago


    Bengaluru, India lululemon Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Engineer II

    3 weeks ago


    Bengaluru, India lululemon Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Engineer II

    2 weeks ago


    Bengaluru, India lululemon Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Engineer II

    4 weeks ago


    Bengaluru, India lululemon Full time

    About lululemon: lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Engineer II

    4 weeks ago


    Bengaluru, India lululemon Full time

    About lululemon: lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...