Databricks Expert/AI Engineer

2 days ago

Bengaluru, India IT Firm Full time

Databricks Expert / AI Engineer

Job Description :


We are looking for a highly skilled and passionate Databricks Expert / AI Engineer to join our fast-paced, innovation-driven startup. The ideal candidate should have hands-on experience with LLM models like LLAMA, Vector Database integration, PostgreSQL, and end-to-end application development using modern AI toolsets. Youll play a crucial role in building intelligent, data-driven applications that are production-ready and scalable.


Key Responsibilities :


- Work closely with data scientists and product teams to build and scale AI applications using Databricks.

- Fine-tune and deploy LLM models (LLAMA or similar) to solve real-world problems.

- Integrate and manage Vector Databases (e.g., FAISS, Pinecone, Weaviate) for efficient semantic search and retrieval tasks.

- Develop robust Python scripts and backend services to support AI workflows and data pipelines.

- Optimize and manage PostgreSQL databases for model data storage and feature engineering.

- Contribute to designing microservices and APIs for integrating AI capabilities into applications.

- Handle the entire ML lifecyclefrom experimentation to deployment using Databricks ML, MLflow, or SageMaker.

- Deliver MVPs and product enhancements quickly, adapting to changes in a fast-moving startup environment.

- Collaborate in an Agile development cycle and contribute to a DevOps-friendly stack.


Key Requirements :


- 5+ years of experience in data engineering, machine learning, or AI application development.

- Strong expertise in Databricks platform, Spark, and distributed data processing.

- Hands-on experience with LLMs (preferably LLAMA) and LangChain or similar frameworks.

- Proficiency in Vector Databases and retrieval-augmented generation (RAG) pipelines.

- Strong command of Python with experience in building scalable backend logic and automation scripts.

- Familiarity with PostgreSQL, data modeling, and query optimization.

- Knowledge of CI/CD, containerization (Docker/Kubernetes), and cloud platforms (AWS/Azure/GCP).

- Experience working in a startup or agile environment, with the ability to deliver rapid Qualifications :


- Exposure to MLOps tools and practices.

- Experience with transformer-based models, Hugging Face libraries, or similar NLP stacks.

- Knowledge of streaming data pipelines (Kafka, Spark Streaming) is a plus.

- Prior experience in building AI-powered applications or tools in production.


(ref:hirist.tech)

  • Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    FEQ426R138 As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Architect : Digital Natives (Data & Ai)

    1 day ago

    Bengaluru, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Architect : Digital Natives (Data & Ai)

    1 week ago

    Bengaluru, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    P-1408The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks' customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for...

  • Senior Backline Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    P-1386At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Sr Software Engineer, Machine Learning

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    P-1407The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks' customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for...

  • Scale Solutions Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    CSQ326R201MissionAt Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilising the Data Intelligence platform. As a Scale Solution Engineer, you will play a critical role in advising Customers in their onboarding journey. You will directly work with customers to help them onboard and deploy Databricks in...

  • Director of Engineering

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...