Data Engineer

3 days ago


Belgaum, Karnataka, India beBeeBackend Full time ₹ 14,50,000 - ₹ 20,15,000

Senior Backend Data and Integration Engineer

We are seeking an experienced professional to design and develop data pipelines for crawling, parsing, deduplication, and delta logic.

  • Crawling/Fetch Pipelines: Utilize API-first approach with playwright/requests where permitted.
  • Parsing/Normalization: Deduplicate job postings and CVs using delta logic.

Key Responsibilities:

  • Data Engineering: Embeddings/similarity search using Azure OpenAI and vector persistence in pgvector.
  • Integration: Integrate with HR4YOU, SerpAPI, BA job board, email/SMTP.
  • Batch/Stream Processing: Use Azure Functions/container jobs for telemetry.

Requirements:

  • Proficiency: 4+ years of backend/data engineering experience.
  • Languages: Proficient in Python (FastAPI, pydantic, httpx/requests) and solid TypeScript for smaller services/SDKs.
  • Azure Expertise: Familiarity with Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics.
  • Databases: Knowledge of PostgreSQL, pgvector, query design & performance tuning.
  • Messaging: Experience with Service Bus/Queues, idempotence & exactly-once semantics.
  • Clean Code: ETL/ELT patterns, testability (pytest), observability (OpenTelemetry).

Nice-to-Have:

  • NLP/IE: Experience with spaCy/regex/rapidfuzz and document parsing with pdfminer/textract.
  • Compliance: Understanding of license/ToS-compliant data retrieval and captcha/anti-bot strategies.
  • Working Method: API-first, clean code, trunk-based development, and mandatory code reviews.

  • Data Engineer

    7 days ago


    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,60,00,000

    About Data Engineering:One of the world's largest employers has opportunities for dynamic professionals to drive innovation and growth globally.Job Summary:We are seeking a skilled Data Engineer to play a key role in building scalable and efficient data solutions to support brand marketing and menu functions. You will collaborate with cross-functional teams...


  • Belgaum, Karnataka, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 20,00,000

    Job DescriptionWe are seeking a seasoned Data Engineering Specialist to join our team. As a key member of our data engineering group, you will play a pivotal role in designing, building, and maintaining our data pipeline architecture.Our ideal candidate is an experienced professional with a passion for data engineering, a strong track record of delivering...


  • Belgaum, Karnataka, India beBeeAirflowExpert Full time ₹ 15,00,000 - ₹ 19,00,000

    Senior Data Engineer - Airflow ExpertWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of robust data pipelines using Airflow.The ideal candidate will have in-depth knowledge of Python, with experience in data engineering and cloud-based data warehousing solutions.Key responsibilities include:Designing and developing...


  • Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering LeaderJob Description:As a key member of our data engineering team, you will be responsible for designing, deploying, and maintaining our organization's data platforms. You will work closely with clients to understand their data-related needs and provide recommendations to deliver solutions that meet their requirements and...

  • Data Engineer

    2 weeks ago


    Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data SpecialistWe are seeking a highly skilled professional with 4+ years of experience in data engineering to lead the design, development, and maintenance of scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark. This role requires strong programming skills in Python and Scala, as well as hands-on...


  • Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Data Engineering PositionAs a key player in our organization, you will design, build, and maintain scalable data pipelines and infrastructure that support real-time and batch data processing.This opportunity is ideal for those who enjoy working with big data technologies, solving complex data problems, and building systems that scale.Develop robust data...


  • Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer RoleWe're looking for an experienced Data Engineer to play a pivotal role in building and optimizing data pipelines. This challenging yet rewarding position offers the chance to work closely with talented teams, solve real-world data challenges, and make a direct impact on business decisions.


  • Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering SpecialistJob Summary:We are seeking an experienced data engineering specialist to join our team. The ideal candidate will have a strong background in data engineering and experience with Google Cloud Platform.The successful candidate will be responsible for developing, constructing, testing and maintaining large-scale data acquisition...

  • Data engineer

    2 weeks ago


    Belgaum, Karnataka, India RiDiK Full time

    We're looking for a Data Engineer to support our team in India. This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you're someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we'd love to hear from you.Job...


  • Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in cloud-native data engineering, with expertise in designing and implementing scalable data pipelines.Design and implement robust, secure, and efficient data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and...