Data Engine Architect

2 weeks ago

Gandhinagar, Gujarat, India beBeeSearch Full time ₹ 16,96,171 - ₹ 25,11,710

As a search infrastructure architect, you will design and implement cutting-edge search solutions for our B2B sales intelligence platform.

Key Responsibilities:
  • Search Solution Design:
    • Develop advanced search features using OpenSearch/Elasticsearch, including custom analyzers, tokenizers, and scoring algorithms.
  • Index and Template Management:
    • Create and maintain index templates, mappings, and lifecycle policies to ensure data integrity, performance, and scalability.
  • Query Pipeline Development:
    • Build and optimize custom query builders and search pipelines tailored to complex business requirements.
  • AI/ML/LLM Powered Search:
    • Leverage LLMs and AI for data enrichment and improved search relevance.
  • API Development:
    • Develop and maintain robust, scalable APIs for search using Python (FastAPI).
  • Testing and Quality Assurance:
    • Lead efforts in integration, regression, and performance testing to ensure reliability and accuracy of search features.
  • DevOps and Automation:
    • Automate deployment and management of search infrastructure, including index templates and search pipelines.
  • Collaboration:
    • Work closely with data engineers and product teams to deliver high-quality search experiences.

Requirements:
  • 5+ years experience with Elasticsearch or OpenSearch in production environments.
  • Experience with AI/LLM-based search experiences such as RAG, learning to rank, and query understanding.
  • Expert level expertise in Python, with experience building APIs (preferably FastAPI).
  • Deep understanding of search concepts: analyzers, tokenizers, relevance tuning, custom scoring, and query DSL.
  • Experience with index template management, lifecycle policies, and large-scale data modeling.
  • Proficiency in designing and optimizing search pipelines and custom query builders.
  • Must have practical hands-on experience developing software using AI-assisted tools and workflows such as Cursor, Co-pilot, and Windsurf.
  • Strong testing background: integration, regression, and performance testing.
  • DevOps skills: automation, CI/CD, and cloud infrastructure (AWS preferred).
  • Excellent communication and collaboration skills.
  • Experience with S3, AWS Lambda, and cloud-native architectures.

This is an exciting opportunity to work on a green-field project, architecting the backbone of our data engine from scratch. You will enjoy remote-first flexibility, working anywhere in India with core hours that suit your life. Our team is small and senior, with less bureaucracy, quicker decisions, and visible results. We are a collaborative, innovative, and supportive team culture. Ready to build pipelines that power the world's smartest B2B sales intelligence platform? Let's discuss further.

  • Data Architect Lead

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 19,99,999

    **Chief Data Architect Position Available**Overview:We are seeking a highly skilled Chief Data Architect to lead the development of scalable, high-performance data platforms and advanced analytics capabilities across our enterprise.This role will be responsible for building a robust data practice, establishing engineering and modeling standards, and...

  • Scalable Data Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Big Data Engineer Position OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation.As a key member of the team, you will be responsible for designing and developing big data...

  • Data Model Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataModeling Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleData Model Architect - 3-5 years of experience in data architecture and engineering.Key Responsibilities:Design and implement complex data models for large-scale systems.Develop efficient ETL processes using cloud-based platforms like Snowflake.Work with massive datasets to create optimized SQL queries and database management systems.Manage data...

  • Transformative Data Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerCraft robust data pipelines to inform business decisions, utilizing skills in ETL tools, SQL, data modeling, and cloud platforms. Work collaboratively with architects, analysts, and stakeholders to deliver impactful solutions.Develop and refine intricate ETL pipelines for processing high data volumes.Evaluate data precision, coherence,...

  • Chief Financial Data Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Lead Data Architect in Finance TechnologyThe Lead Data Architect within the Finance & Accounting domain plays a pivotal role in shaping next-generation financial data architecture.This role is focused on leveraging Snowflake, dbt, and modern data engineering practices to build scalable, trusted, and cost-optimized financial data solutions.Architect & Lead...

  • Chief Data Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,10,000

    Job Summary:We're seeking a highly skilled Senior Data Engineer to spearhead the development of our data infrastructure.Main Responsibilities:Data Pipeline Design:Design and optimize data pipelines using ETL/ELT workflows, cloud-based platforms, and big data ecosystems.Data Platform Architecture:Architect scalable data platforms using AWS services such as...

  • Chief Data Architect

    1 week ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectAbout this role:We are seeking an experienced data architect to help our clients build scalable data platforms and AI solutions.Key Responsibilities:Design and implement secure, efficient, and highly available data architecture.Develop data pipelines, design data lakes, and implement data warehousing solutions using cloud-based...

  • Senior Data Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Data Architect PositionWe are seeking a highly skilled and experienced Data Architect to spearhead our data engineering efforts. As a Data Architect, you will be responsible for designing, developing, and maintaining large-scale data systems.The ideal candidate will have a strong background in data architecture, with experience in handling big data...

  • Cloud Data Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Seeking a skilled Cloud Data Engineer to design, develop and maintain complex data architectures using Databricks and related technologies. The ideal candidate will have experience in building scalable data products and working with big data platforms.Job DescriptionAs a Cloud Data Engineer, you will be responsible for analyzing and understanding existing...

  • Cloud Data Solutions Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 30,00,000 - ₹ 40,00,000

    Job TitleA highly skilled AWS Data Engineer is required to design and implement scalable cloud-based data solutions.About the RoleWe are seeking an experienced professional with a strong background in cloud data engineering, able to work on complex projects and collaborate with cross-functional teams.The ideal candidate will have 5-7 years of experience in...