Data Integration Specialist

1 week ago

Cochin, Kerala, India Talent Basket Full time ₹ 15,00,000 - ₹ 28,00,000 per year

Designation: Senior Backend Data & Integration Engineer (Python/TypeScript, Azure, Integrations)

Experience: 4 -8 Years

Location: Cochin(Onsite)

Job Summary

Build data pipelines (crawling/parsing, deduplication/delta, embeddings) and connect external systems and interfaces.

Key Responsibilities:


• Development of crawling/fetch pipelines (API-first; playwright/requests only where permitted)


• Parsing/normalization of job postings & CVs, deduplication/delta logic (seen hash, repost heuristics)


• Embeddings/similarity search (controlling Azure OpenAI, vector persistence in pgvector)


• Integrations: HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP


• Batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues


• Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items)


• Collaboration with FE for exports (CSV/Excel, presigned URLs) and admin configuration

Must Have Requirements:


• 4+ years of backend/data engineering experience


• Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium), solid TypeScript for smaller services/SDKs


• Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics


• Messaging: Service Bus/Queues, idempotence & exactly-once semantics, pragmatic approach


• Databases: PostgreSQL, pgvector, query design & performance tuning


• Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry)

Nice-to-have:


• NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract)


• Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies (legally compliant)


• Working method: API-first, clean code, trunk-based development, mandatory code reviews


• Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence

  • Data Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeIntegration Full time US$ 7,50,000 - US$ 15,00,000

    Job Opportunity: Data Integration SpecialistWe're seeking a skilled professional to help our clients harness the power of data for digital transformation and long-term sustainability.Our team has extensive experience in operational technology (OT) and IT, spanning over a century and 60 years respectively.As a Data Integration Specialist, you'll be...

  • Data Integration Specialist

    1 week ago

    Cochin, Kerala, India beBeeETLDeveloper Full time ₹ 20,00,000 - ₹ 30,00,000

    About the RoleWe are seeking a skilled Data Integration Specialist to join our team. The ideal candidate will be responsible for designing, developing, and maintaining data integration processes, as well as data warehouse design and modeling, to support our business intelligence initiatives.This role requires proficiency in T-SQL, Azure Data Factory (ADF),...

  • Data Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeReltio Full time ₹ 80,00,000 - ₹ 1,50,00,000

    We are seeking an expert Data Integration Specialist to join our team. The ideal candidate will have hands-on experience implementing, customizing, and supporting Reltio Master Data Management (MDM) solutions.About the RoleThis is a key position that requires a strong understanding of data quality, governance, and scalability for business-critical master...

  • Senior Data Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled data integration specialist to design, develop and maintain complex data flows and architectures. The ideal candidate will be responsible for utilizing their technical expertise in T-SQL, Azure Data Factory (ADF) and SSIS to support our business intelligence initiatives.Key Responsibilities:Design and develop ETL...

  • Senior Data Integration Specialist

    1 week ago

    Cochin, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: SQL, Snowflake SpecialistWe are seeking an experienced professional with 5-7 years of expertise in Matillion ELT and Snowflake to design, develop, and maintain scalable data integration solutions.Responsibilities include working extensively with Matillion ELT to create, implement, and optimize data pipelines utilizing Snowflake for data...

  • Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeIntegration Full time ₹ 1,25,00,000 - ₹ 1,75,00,000

    Our team is seeking a skilled Integration Specialist to help drive digital transformation and enhance operational efficiency.The successful candidate will have experience with integration platforms, protocols such as REST, SOAP, AS2, SFTP, FTP, and data formats like XML, JSON, EDIFACT, X12, CSV.Key Responsibilities:Design and implement integration solutions...

  • Senior Data Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeDataIntegration Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: ODI ConsultantThis is an exciting opportunity to join a dynamic team as an ODI Consultant.Main Responsibilities:Data Integration Specialist: Design interfaces, packages, and load plans in ODI 12c. Ensure correctness and completeness of data loading, including full and incremental loads.ETL Expert: Contribute to the estimation and planning of ETL...

  • Enterprise Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Enterprise Integration SpecialistKey Responsibilities:Design and implement end-to-end integration scenariosDevelop and configure integration flows for SAP and third-party systemsPerform data mapping, transformation, and content modification using XML, JSON, and XSLTCollaborate with cross-functional teams to gather requirementsEnsure secure and scalable...

  • Enterprise Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeEnterpriseIntegration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Enterprise Integration SpecialistWe are seeking a skilled professional to join our team as an Enterprise Integration Specialist.This role involves designing, developing, and deploying integration solutions using IBM App Connect Enterprise (ACE)/IBM Integration Bus (IIB).Main Responsibilities:Create seamless data exchange by developing message...

  • Oracle Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeOracle Full time ₹ 17,50,400 - ₹ 25,12,000

    Job Opportunity: Oracle Integration SpecialistWe are seeking a skilled Oracle integration professional with experience in building integrations through REST and SOAP web services, as well as the use of FBDI and HDL.Key Responsibilities:Develop bulk data transfers using FBDI and Hub Database Link (HDL) technologyImplement cloud ERP projects across multiple...