Senior Data Integration Specialist

14 hours ago

Kurnool, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 12,07,200 - ₹ 21,45,900
Senior Data Integration Specialist

Job Description:

We are seeking a highly skilled Senior Data Integration Specialist to join our team.

The ideal candidate will have experience in designing and implementing data pipelines, integrating external systems and interfaces, and working with large datasets.

  • Development of crawling/fetch pipelines (API-first; playwright/requests only where permitted)
  • Parsing/normalization of job postings & CVs, deduplication/delta logic (seen hash, repost heuristics)
  • Embeddings/similarity search (controlling Azure OpenAI, vector persistence in pgvector)
  • Integrations: HR4YOU (API/webhooks/CSV import), SerpAPI, BA job board, email/SMTP
  • Batch/stream processing (Azure Functions/container jobs), retry/backoff, dead-letter queues
  • Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items)
Required Skills and Qualifications:
  • 4+ years of backend/data engineering experience
  • Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium), solid TypeScript for smaller services/SDKs
  • Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics
  • Messaging: Service Bus/Queues, idempotence & exactly-once semantics, pragmatic approach
  • Databases: PostgreSQL, pgvector, query design & performance tuning
  • Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry)

Nice-to-have skills include:

  • NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract)
  • Experience with license/ToS-compliant data retrieval, captcha/anti-bot strategies (legally compliant)
  • Working method: API-first, clean code, trunk-based development, mandatory code reviews
  • Tools/stack: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence
Benefits:

This role offers the opportunity to work with cutting-edge technologies, collaborate with a talented team, and contribute to the development of innovative solutions.

  • Senior Integration Development Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Integration Development SpecialistWe are seeking a highly skilled Senior Integration Development Specialist to join our team.The successful candidate will be responsible for designing and developing interfaces for importing data from feeder systems, working with offshore team resources to identify tasks for application software...

  • Data Integration Specialist

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data Integration Specialist About this roleWe are seeking a highly skilled professional to join our team as a Data Integration Specialist. The ideal candidate will be responsible for designing, developing, and maintaining data integration processes, as well as data warehouse design and modeling, to support our business intelligence initiatives....

  • Senior Data Integration Developer

    12 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000

    Data Integration Specialist Job OpportunityOur team is seeking a highly skilled Data Integration Specialist to join our crew.The successful candidate will be responsible for designing, developing, and maintaining scalable data integration solutions using Matillion ELT and Snowflake.Key responsibilities include:Working extensively with Matillion ELT to...

  • Senior Data Integration Developer

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Integration SpecialistWe are seeking a skilled Data Integration Specialist to develop and maintain ETL processes, reports, and database solutions. The ideal candidate will have deep technical expertise in SSIS, SSRS, and SQL Server.Design, develop, and deploy SSIS packages for complex data workflows.Create and optimize reports with interactive...

  • Data Integration Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Integration SpecialistWe are seeking an experienced professional to join our data integration team. The ideal candidate will have a strong background in ETL development, support, and data quality control.Key Responsibilities:Design, develop, and maintain complex ETL processes using Informatica PowerCenter / IICS.Collaborate with...

  • Senior Data Integration Specialist Position

    3 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,10,000

    As a Data Integration Specialist, you will be responsible for testing and validating large-scale data pipelines to ensure accuracy, consistency, and throughput in event-driven systems.Key ResponsibilitiesTest data integration processes and perform reconciliation across systems.Validate messaging systems (producers, consumers, topics, schema registry,...

  • Data Integrity Specialist

    3 days ago

    Kurnool, Andhra Pradesh, India beBeeQuality Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Quality and Reliability SpecialistJob Summary:We seek a meticulous professional to guarantee the integrity of software products. The ideal candidate will be responsible for manual and automated testing techniques, focusing on functional, database, ETL, and API validations across SIT and UAT phases.The successful candidate will have a strong...

  • Data Integration Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity:We are seeking an experienced ETL Professional to join our organization.About the Position:As a skilled ETL Specialist, you will be responsible for designing, developing, and implementing data mappings/transformation solutions.You will collaborate closely with cross-functional teams to deliver high-quality projects.Experience in using Oracle...

  • Senior Data Transformation Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeDataTransformation Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Transformation Specialist">As a seasoned Senior Data Transformation Specialist, you will play a pivotal role in leading the design, implementation, and maintenance of ETL processes. This includes working closely with cross-functional teams to identify data transformation requirements, develop and execute efficient data pipelines, and...

  • Lead Data Integration Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Role: Data Integration SpecialistLocation: Pan IndiaKey Responsibilities:Design data interfaces, packages, and load plans in ODI 12c.Ensure the correctness and completeness of data loading - full load, incremental load.Contribute to the estimation and planning of ETL activities for project plans.Collaborate with the team to write complex queries and...