Data Engine Architect

4 days ago

Solapur, Maharashtra, India beBeeSearch Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Job Title: Search Architect

We are seeking a highly skilled Search Architect to design and implement scalable search solutions.

  • Design and implement search solutions using OpenSearch/Elasticsearch, including custom analyzers, tokenizers, and scoring algorithms.
  • Create and maintain index templates, mappings, and lifecycle policies to ensure data integrity, performance, and scalability.
  • Build and optimize custom query builders and search pipelines tailored to complex business requirements.
  • Leverage Large Language Models (LLMs) and Artificial Intelligence (AI) for data enrichment and improved search relevance.
  • Develop and maintain robust, scalable APIs for search using Python (FastAPI).
  • Lead efforts in integration, regression, and performance testing to ensure reliability and accuracy of search features.
  • Automate deployment and management of search infrastructure, including index templates and search pipelines.
About the Role:

This is an opportunity to architect the backbone of our data engine from the ground up. You will work on designing and implementing scalable search solutions, leveraging cutting-edge technologies such as LLMs and AI.

  • You will be responsible for designing and implementing custom analyzers, tokenizers, and scoring algorithms to improve search relevance.
  • You will create and maintain index templates, mappings, and lifecycle policies to ensure data integrity, performance, and scalability.
  • You will build and optimize custom query builders and search pipelines tailored to complex business requirements.
  • You will leverage LLMs and AI for data enrichment and improved search relevance.
  • You will develop and maintain robust, scalable APIs for search using Python (FastAPI).
  • You will lead efforts in integration, regression, and performance testing to ensure reliability and accuracy of search features.
  • You will automate deployment and management of search infrastructure, including index templates and search pipelines.
Requirements:

To be successful in this role, you will need to have:

  • 5+ years experience with Elasticsearch or OpenSearch in production environments.
  • Experience with AI/LLM-based search experiences such as RAG, learning to rank, and query understanding.
  • Expert level expertise in Python, with experience building APIs (preferably FastAPI).
  • Deep understanding of search concepts: analyzers, tokenizers, relevance tuning, custom scoring, and query DSL.
  • Experience with index template management, lifecycle policies, and large-scale data modeling.
  • Proficiency in designing and optimizing search pipelines and custom query builders.
  • Must have practical hands-on experience developing software using AI-assisted tools and workflows.
  • Strong testing background: integration, regression, and performance testing.
  • DevOps skills: automation, CI/CD, and cloud infrastructure (AWS preferred).
  • Excellent communication and collaboration skills.
  • Experience with S3, AWS Lambda, and cloud-native architectures.
About Your Tribe:

You will be part of a small senior team, working remotely in India with flexibility to set core hours that suit your life.

  • Collaborative, innovative, and supportive team culture.

  • Data Architect and Engineer

    20 hours ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Architect and EngineerDevelop robust data pipelines for processing channel activity data from multiple sources.We are seeking an experienced professional to build and maintain scalable data solutions, focusing on digital channels and integrating multiple sources of data.Design, build, and maintain robust data architectures for high availability,...

  • Big Data Architect

    1 day ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,50,000

    Job Title: Big Data ArchitectA leading organization is seeking a skilled Databricks Engineer to join their team in a remote work setup.We are looking for an experienced data engineer with a strong background in big data architecture to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks...

  • Chief Data Architect

    1 week ago

    Solapur, Maharashtra, India beBeeSoftware Full time US$ 1,80,000 - US$ 2,40,000

    Job Description:We are seeking a highly skilled software engineer to join our team and contribute to the development of big data systems using technologies like Apache Spark and Hive.The ideal candidate will have 8+ years of experience in software engineering, with expertise in architecting complex systems, mentoring junior engineers, and fostering...

  • Chief Data Architect

    3 days ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Chief Data ArchitectAbout the Role:We are seeking an experienced data leader to oversee our data warehouse strategy. As a key member of our engineering team, you will be responsible for designing and implementing workflow management systems, architecting and developing data warehouses, and working closely with clients to gather...

  • GCP Data Architect

    16 hours ago

    Solapur, Maharashtra, India HCLTech Full time

    Role: GCP Data ArchitectTotal years of experience: 12+ YearsLocation: Noida, Bangalore, Chennai, Pune, HyderabadRelevant experience for engagement: 10 YearsRelevant skillset:Maintain architecture principles, guidelines and standardsData WarehousingProgramming Language: Python/JavaBig DataData AnalyticsGCP ServicesRelevant technology domains:Experience in...

  • Senior Data Architect

    1 day ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 19,26,000 - ₹ 28,98,000

    Data Architecture ExpertiseOur ideal candidate will have a deep understanding of data architecture and be able to design, construct, and optimize large-scale data processing systems. These systems enable advanced analytics and business intelligence by collecting, processing, and storing structured and unstructured data. In this role, you will work closely...

  • Data Governance Architect Position

    1 day ago

    Solapur, Maharashtra, India beBeeDataGovernance Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionA Data Governance Architect is a combination of hands-on contribution, customer engagement, and technical team management including assisting in getting new business. Overall, you'll design, architect, deploy, and maintain big data-based data governance solutions.This involves technical management across the full life cycle of...

  • Cloud Data Architect Specialist

    19 hours ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Architect SpecialistAbout the RoleWe're seeking a seasoned cloud data architect to develop and implement scalable data solutions. The ideal candidate will have expertise in designing and building cloud-based data architectures, as well as experience with workflow orchestration tools.Key Responsibilities:Design and implement cloud-based data...

  • Cloud Data Solutions Architect

    14 hours ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 7,20,000 - ₹ 10,20,000

    Job DescriptionWe are seeking a seasoned Cloud Data Solutions Architect to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and implementing scalable and secure data solutions using Microsoft Fabric.Required Skills and QualificationsTechnical Expertise: Proven experience in Microsoft Fabric, Power BI, and...

  • Senior Data Architect Lead

    7 days ago

    Solapur, Maharashtra, India beBeeCloud Full time ₹ 40,00,000 - ₹ 50,00,000

    Engineering Manager - Data ArchitectJob Summary:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance,...