Data Integration Specialist

5 days ago

Thoothukudi, Tamil Nadu, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Senior Backend Engineer

We are seeking a seasoned senior backend data and integration engineer to lead the development of high-performance crawling pipelines, utilizing API-first design with Playwright/requests where permitted.

The ideal candidate will have a proven track record of parsing and normalizing job postings and CVs, implementing deduplication/delta logic, and leveraging embeddings/similarity search to enhance our talent acquisition capabilities.

Key responsibilities include:

  • Designing and implementing crawling/fetch pipelines using API-first architecture.
  • Parsing/normalization of job postings & CVs, including deduplication/delta logic.
  • Embeddings/similarity search for talent matching and enhancement.
  • Integrating HR4YOU, SerpAPI, BA job board, email/SMTP services.
  • Batch/stream processing using Azure Functions/container jobs.
  • Telemetry for data quality metrics.
  • Collaboration with frontend teams for exports and admin configuration.

Requirements include:

  • 4+ years of backend/data engineering experience.
  • Proficiency in Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium).
  • Experience with Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics.
  • Strong understanding of messaging systems: Service Bus/Queues, idempotence & exactly-once semantics.
  • Database expertise: PostgreSQL, pgvector, query design & performance tuning.
  • ETL/ELT patterns, testability (pytest), observability (OpenTelemetry).

  • Data Integrity Specialist

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeDataQuality Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Job Title:** Data Integrity SpecialistThe data integrity specialist is responsible for leading a team that ensures the accuracy of map data.Collaborate with teams to implement best practices in mapping operations, analyze complex data to identify trends and areas for improvement, and provide regular updates on team performance.Develop and implement...

  • ETL Data Integration Specialist

    6 days ago

    Thoothukudi, Tamil Nadu, India beBeeetl Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled ETL Data Integration Specialist to join our team. In this role, you will be responsible for leading the development and implementation of data integration processes and solutions.Your primary focus will be on designing, developing, testing, and maintaining large-scale data integration systems, as well as ensuring data...

  • Data Integration Specialist

    6 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataStage Full time ₹ 12,00,000 - ₹ 20,00,000

    ETL Datastage DeveloperAt our organization, we are seeking a skilled ETL data integration specialist to fill a critical role.Key Responsibilities:Analysis of complex ETL workflows and scripting tasks to optimize efficiencyCreation of new data integration pipelines using IBM Datastage and Unix-based technologiesCollaboration with cross-functional teams to...

  • Data Integration Specialist

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeInformatica Full time ₹ 9,00,000 - ₹ 14,00,000

    We are seeking a Data Integration Specialist to join our team. This role involves developing, enhancing and maintaining ETL processes using Informatica PowerCenter / IICS.The ideal candidate will have 3-7 years of experience in data integration and should be proficient in designing, developing and tuning ETL processes. Experience with SAP, Salesforce and...

  • Data Integration Expert

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Integration SpecialistWe are seeking a skilled and experienced Senior Data Integration Specialist to join our team. The ideal candidate will have expertise in designing, developing, and implementing data integration solutions using Informatica BDM/DEI.This role is perfect for individuals who enjoy working with complex data architectures and are...

  • Senior Data Integration Specialist

    1 week ago

    Thoothukudi, Tamil Nadu, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a Data Integration Specialist to join our team. In this role, you will be responsible for designing and implementing ETL solutions using Oracle Data Integrator (ODI) 12c.Key Responsibilities:Develop interfaces, packages, and load plans in ODI 12c to meet project requirementsContribute to the estimation and planning of ETL activities to ensure...

  • Full Stack Data Integration Specialist

    6 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    ETL EngineerThis is a full-time role for an ETL Specialist.The ETL Specialist will be responsible for designing, deploying, and managing data pipelines to integrate information from various sources.Daily tasks include using ETL tools, performing data modeling, ensuring data accuracy, and providing analytical insights.The ETL Specialist will also collaborate...

  • Cloud Data Integration Specialist

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking an experienced Freelance Azure Data Factory specialist to support our data integration and ETL needs. The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and destinations.Main...

  • Data Integration Expert

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Oracle Data Integrator Specialist "Job Summary:" Seeking an experienced Oracle Data Integrator consultant with a strong track record of end-to-end ODI implementations. The ideal candidate will have hands-on experience with ODI, SQL/PLSQL, and data warehousing concepts.">">">Key Responsibilities include designing and developing ELT processes using ODI,...

  • Chief Data Integration Specialist

    6 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataReplication Full time ₹ 21,60,000 - ₹ 26,00,000

    Job Title: Data Replication Specialist We are seeking a skilled professional to manage, maintain and develop data replication solutions using Qlik Replicate.The ideal candidate will have hands-on experience in both administering the Qlik Replicate platform and designing efficient data replication tasks across various source and target systems.This role is...