Data Engineering Specialist

21 hours ago

Bengaluru, Karnataka, India beBeeBackend Full time ₹ 16,00,000 - ₹ 24,50,000
Job Title: Senior Backend Data & Integration Engineer

As a key member of our team, you will be responsible for designing and implementing data pipelines that connect external systems and interfaces.

  • We are looking for an experienced backend/data engineer to join our team. Your primary responsibility will be to develop and maintain large-scale data pipelines that integrate with various external systems and interfaces.

Key Responsibilities:

  • Design and implement crawling/fetch pipelines (API-first; playwright/requests only where permitted)
  • Parsing/normalization of job postings & CVs, deduplication/delta logic (seen hash, repost heuristics)
  • Embeddings/similarity search (controlling Azure OpenAI, vector persistence in pgvector)
  • Integrations: HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP
  • Batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues
  • Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items)
  • Collaboration with FE for exports (CSV/Excel, presigned URLs) and admin configuration

Must Have Requirements:

  • 4+ years of backend/data engineering experience
  • Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium), solid TypeScript for smaller services/SDKs
  • Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics
  • Messaging: Service Bus/Queues, idempotence & exactly-once semantics, pragmatic approach
  • Databases: PostgreSQL, pgvector, query design & performance tuning
  • Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry)

Nice-to-have:

  • NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract)
  • Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies (legally compliant)
  • Working method: API-first, clean code, trunk-based development, mandatory code reviews
  • Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineering Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team and contribute to the development of real-time data processing solutions.

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Ascendion Engineering Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesData Products Enhancement: Collaborate with cross-functional teams to agentify current Data Products, enabling intelligent and adaptive data flows that support evolving business needs.Agentification of ETL Pipelines: Transformation of existing ETL and data ingestion pipelines by embedding agentic architectures. This involves...

  • Data Engineering Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Data Engineering SpecialistAs a seasoned data engineer, you will play a pivotal role in designing, developing, and maintaining high-performance data pipelines and ETL processes on Databricks. You will lead the architecture and implementation of scalable, secure, and efficient data solutions.

  • Data Engineering Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistThe ideal candidate will have a strong background in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark) with a solid understanding of data patterns, Python, and SQL.Data Pipeline Design: Develop efficient and scalable data pipelines to handle large datasets, ensuring seamless...

  • Digital Engineering Networking Engineer Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 336414 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore Karn taka IN-KA India IN At...

  • Data Senior Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Digital Engineering Networking Engineer Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN).At NTT...

  • Data Engineering Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistAs a data engineering specialist, you will be responsible for designing and developing end-to-end data pipelines and analytical solutions within the Palantir platform.You will design and implement robust data integration strategies from various sources, develop and optimize complex data models to ensure data quality,...

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...