Expert Data Architect

12 hours ago

Gulbarga, Karnataka, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000
Senior Backend Data & Integration Engineer

We are seeking a highly skilled software engineer to join our team as a senior backend data and integration expert.

This is a challenging role that involves building robust data pipelines, connecting external systems and interfaces, and ensuring seamless integration with various technologies.

  • Key Responsibilities:
  • Design and develop efficient crawling/fetch pipelines using an API-first approach with playwright/requests where permitted.
  • Parsing and normalizing job postings and CVs, eliminating duplicates and applying delta logic (seen hash, repost heuristics).
  • Implementing embeddings and similarity search (controlling Azure OpenAI, vector persistence in pgvector).
  • Integrating HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP services.
  • Processing large datasets using batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues.
  • Monitoring data quality (freshness, duplicate rate, coverage, cost per 1,000 items) and collaborating with front-end engineers for exports (CSV/Excel, presigned URLs) and admin configuration.
  • Must Have Requirements:
  • 4+ years of experience in backend/data engineering.
  • Proficiency in Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium) and solid TypeScript for smaller services/SDKs.
  • Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics expertise.
  • Messaging: Service Bus/Queues, idempotence & exactly-once semantics, practical approach.
  • Databases: PostgreSQL, pgvector, query design and performance tuning knowledge.
  • Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry).
  • Nice-to-have:
  • NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract).
  • Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies.
  • Collaborative working method: API-first, clean code, trunk-based development, mandatory code reviews.
  • Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence.

  • Data Architect

    12 hours ago

    Gulbarga, Karnataka, India beBeeCognitive Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Architect We are seeking a highly skilled Data Architect to design and implement cognitive search solutions using Azure Cognitive Search and related AI services. The ideal candidate will combine expertise in data engineering with a passion for delivering intuitive user experiences and business value. Key Responsibilities:

  • Chief Data Systems Architect

    2 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,00,000

    **Job Title:** Senior Data Engineer**Job Overview**The role of a Senior Data Engineer involves leading the design, implementation, and optimization of large-scale data pipelines and systems. Key Responsibilities:Design & Optimize Data Pipelines: Create efficient ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets, and Snowflake.Cloud & Big Data...

  • Cybersecurity Data Protection Expert

    12 hours ago

    Gulbarga, Karnataka, India beBeeCybersecurity Full time ₹ 19,70,000 - ₹ 25,45,000

    Job Opportunity: Cybersecurity Data Protection ExpertJob Description:We are seeking a seasoned cybersecurity expert to join our organization as a Cybersecurity Data Protection Specialist. In this role, you will play a crucial part in safeguarding our sensitive information.Responsibilities include designing and implementing robust security architecture...

  • Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectWe are seeking a skilled Data Architect to design and implement large-scale data systems.Job Description:The successful candidate will be responsible for developing and maintaining complex data solutions. Experience with Databricks, SQL, PySpark, and Python is essential for success in this role.Our ideal candidate will have hands-on...

  • Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Architect">The Data Architect will design, build and maintain large-scale data systems to support real-time and batch data processing. This includes designing scalable data pipelines and infrastructure.">Key Responsibilities:Data Pipeline Design and DevelopmentCloud Infrastructure ManagementBig Data ProcessingDatabase...

  • Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataArchitect Full time ₹ 18,00,000 - ₹ 22,50,000

    Job Title:">">Data Architect">">Description:">We are seeking an experienced Data Architect to design and implement robust, scalable data pipelines and architectures that enable our organization to make data-driven decisions.">The ideal candidate will have a strong understanding of data modeling, data warehousing, and data governance principles and be able to...

  • Data Architect

    1 week ago

    Gulbarga, Karnataka, India beBeeDataArchitect Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Data ArchitectA strategic role that involves designing, implementing and maintaining the overall data architecture.The successful candidate will have experience in Apache Trino: Strong hands-on experience with Trino (PrestoSQL) in production environments, including proficiency in SQL performance tuning and query optimization.Distributed Computing...

  • Data Solutions Architect

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataArchitecture Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectWe are seeking a seasoned data architect to help us design and implement scalable, secure, and efficient data solutions. The ideal candidate will have 5+ years of experience working with Databricks, including platform architecture, data engineering, and data analytics.This includes developing data pipelines, architecting data lakes,...

  • F&B Data Architect

    2 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Transformation ExpertOur company is at the forefront of unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product has achieved remarkable success over the past decade, empowering thousands of businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Expert Cloud Data Architect Wanted

    12 hours ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Cloud Data Architect PositionWe are seeking a skilled Cloud Data Architect to lead our data architecture and modeling efforts, focusing on Snowflake and Matillion platforms. The ideal candidate will have experience in designing and implementing end-to-end data architectures, defining data modeling standards, and collaborating with cross-functional teams.Key...