Data Integration Engineer

1 week ago

Kochi, India Velodata Global Pvt Ltd Full time

About the jobDesignation : Data & Integration Engineer (Python/TypeScript, Azure, Integrations)Experience : 4 -8 YearsLocation : CochinJob Summary :Build data pipelines (crawling/parsing, deduplication/delta, embeddings) and connect external systems and interfaces.Key Responsibilities :- Development of crawling/fetch pipelines (API-first; playwright/requests only where permitted)- Parsing/normalization of job postings & CVs, deduplication/delta logic (seen hash, repost heuristics)- Embeddings/similarity search (controlling Azure OpenAI, vector persistence in pgvector)- Integrations: HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP- Batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues- Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items)- Collaboration with FE for exports (CSV/Excel, presigned URLs) and admin configurationMust Have Requirements :- 4+ years of backend/data engineering experience- Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium), solid TypeScript for smaller services/SDKs- Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics- Messaging: Service Bus/Queues, idempotence & exactly-once semantics, pragmatic approach- Databases: PostgreSQL, pgvector, query design & performance tuning- Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry)Nice-to-have :- NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract)- Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies (legally compliant)- Working method: API-first, clean code, trunk-based development, mandatory code reviews- Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence- On-call/support: rotating, "you build it, you run it" (ref:hirist.tech)

  • Senior Data Integration Engineer

    2 weeks ago

    Kochi, India Indsafri Full time

    Job Title - Senior Data Integration EngineerExperience - 6+YearsJob SummaryWe are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intelligence ecosystem. In this critical role, you will be the subject matter expert responsible for designing and implementing...

  • Senior Data Engineer

    2 weeks ago

    Kochi, India Velodata Global Pvt Ltd Full time

    About the job :Role : Lead/ Senior Data Engineer - AWS, Python, PysparkMandatory Skills : AWS, Python, PysparkNotice Period : Immediate to 15 daysExperience Range : 7+ YearsLocation : Kerala (Local candidates only Kochi/Trivandrum)Job Overview : We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework...

  • Lead data engineer

    4 weeks ago

    Kochi, India Velodata Global Pvt Ltd Full time

    Total Experience - 10+ Years Work Location - Trivandrum, Kochi& Remote Note** - Candidates are required to attend the final round of the interview in person . The selected candidate must work from the office during the first month. Job Overview We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion...

  • Senior Data Engineer

    4 weeks ago

    Kochi, India Invokhr Full time

    LOOKING FOR IMMEDIATE JOINERS OR 15 DAYS NOTICE PERIODS AND THIS IS WORK FROM HOME OPPORTUNITY Position: Senior Data Engineer / Data Engineer Desired Experience: 3-8 years Salary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and...

  • Senior Data Engineer

    4 weeks ago

    Kochi, India Invokhr Full time

    LOOKING FOR IMMEDIATE JOINERS OR 15 DAYS NOTICE PERIODS AND THIS IS WORK FROM HOME OPPORTUNITY Position: Senior Data Engineer / Data Engineer Desired Experience: 3-8 years Salary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and...

  • Lead Data Engineer

    4 weeks ago

    Kochi, India Velodata Global Pvt Ltd Full time

    Total Experience - 10+ Years Work Location - Trivandrum, Kochi& Remote Note** - Candidates are required to attend the final round of the interview in person . The selected candidate must work from the office during the first month. Job Overview We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework...

  • Data Engineer

    2 days ago

    Kochi, India B2N Management Consulting Pvt. Ltd. Full time

    Overview : We are seeking a highly skilled and hands-on Data Lake Implementation Specialist with expertise in building data lake solutions on Oracle Autonomous Database. The ideal candidate will have deep technical knowledge of Oracle Cloud Infrastructure (OCI) Data Integration, Oracle Data Integrator (ODI), Oracle Data Transform, ETL job scheduling, and API...

  • Senior Data Engineer

    4 weeks ago

    Kochi, India Invokhr Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience: 3-8 years Salary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position,...

  • Senior Data Engineer

    4 weeks ago

    Kochi, India Invokhr Full time

    Position: Senior Data Engineer / Data Engineer Desired Experience: 3-8 years Salary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position,...

  • Lead Data Engineer

    2 weeks ago

    Kochi, India Velodata Global Pvt Ltd Full time

    Job Title : Lead Data Engineer - AWSLocation : Kochi / : 6- 8 YearsNotice Period : Immediate to 15 DaysJob Overview :We are looking for a highly skilled Lead Data Engineer (AWS) to architect, build, and manage scalable data pipelines with a strong emphasis on data quality, governance, and secure API integrations. The role requires deep expertise in AWS cloud...