Senior Data Engineering Position Available

1 week ago

Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

Job Summary

We are seeking a skilled Data Engineer to join our team. The successful candidate will design, develop, and implement data pipelines using Azure Functions and Container Apps.

About the Role

This is an exciting opportunity for experienced professionals looking to take on new challenges and contribute to a high-performing team. You will work closely with cross-functional teams to deliver innovative solutions that drive business growth.

  • Main Responsibilities:
  • • Built data pipelines using Azure Functions and Container Apps.
  • • Developed crawling/fetch pipelines using API-first development methodologies.
  • • Parsed and normalized job postings and CVs using various tools and techniques.
  • • Implemented deduplication/delta logic to ensure data quality.
  • • Embedded similarity search functionality using Azure OpenAI and pgvector.
  • • Integrated HR4YOU, SerpAPI, BA job board, email/SMTP services.
  • • Designed batch/stream processing workflows using Azure Functions/container jobs.
  • • Managed telemetry for data quality metrics such as freshness, duplicate rate, coverage, and cost per 1,000 items.

Requirements

To be considered for this role, you must have:

  • Fundamental Requirements:
  • • At least 4 years of experience in backend/data engineering roles.
  • • Proficiency in Python programming language (FastAPI, pydantic, httpx/requests, Playwright/Selenium).
  • • Solid understanding of TypeScript for smaller services/SDKs.
  • • Azure expertise: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics.
  • • Messaging knowledge: Service Bus/Queues, idempotence & exactly-once semantics.
  • • Databases skills: PostgreSQL, pgvector, query design & performance tuning.
  • • Clean ETL/ELT patterns, testability (pytest), observability (OpenTelemetry).

Nice-to-Haves

The following skills would be advantageous:

  • Advantageous Skills:
  • • NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract).
  • • Licenses/ToS-compliant data retrieval, captcha/anti-bot strategies.
  • • Collaboration methodology: API-first, clean code, trunk-based development, mandatory code reviews.
  • • Tools/stack familiarity: GitHub, GitHub Actions/Azure DevOps, Docker, pnpm/Turborepo (Monorepo), Jira/Linear, Notion/Confluence.

Contact Information

  • Senior data engineer – gcp

    4 weeks ago

    Anand, Gujarat, India Xebia Full time

    ???? We're Hiring: Senior Data Engineer – GCP | Big Data | Databricks???? Locations: Chennai | Bangalore | Hyderabad | Gurugram | Jaipur | Pune | Bhopal???? Shift Timing: 2:00 PM – 10:00 PM IST???? Experience: 8+ Years???? Immediate Joiners Only (0–15 Days Notice)Are you an expert Data Engineer ready to build large-scale data platforms on Google Cloud...

  • Senior Data Engineer

    2 weeks ago

    Anand, Gujarat, India beBeeData Full time ₹ 13,68,000 - ₹ 20,16,000

    Job Overview:\We are seeking a Senior ETL Developer to design, develop and deploy scalable data pipelines and ETL processes.\Responsibilities:\\Collaborate with stakeholders to understand data requirements and translate them into technical solutions.\Design, develop and deploy scalable data pipelines and ETL processes using Databricks.\Optimize Spark jobs...

  • Cloud Data Engineer Position

    2 weeks ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Cloud Data Engineer Position">This role involves designing, developing and maintaining large-scale data pipelines using cloud-based platforms. As a Cloud Data Engineer, you will be responsible for working closely with cross-functional teams to gather requirements, develop technical solutions and deploy new features.">The ideal candidate will have a strong...

  • Data Engineer Position

    7 days ago

    Anand, Gujarat, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer Position This role is focused on the development of data pipelines, pricing models and backend systems. We are seeking a skilled professional with expertise in Go or Rust to join our team. This engineer will play a key role in decoding smart contract events and implementing logic from decentralized exchanges (DEXs). The ideal candidate should...

  • Key Senior Data Engineering Position

    2 weeks ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer">The ideal candidate will be responsible for designing, deploying and maintaining the organization's data platforms. This includes reviewing existing data collection systems, analyzing them, making recommendations on improvement or maintenance.They will also supervise junior teams to ensure they carry out their duties in line with...

  • Senior Data Architect

    1 week ago

    Anand, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About This RoleThis is a senior data engineering position within our organization, where you will play a key role in shaping the architecture of our data infrastructure.

  • Senior Data Engineering Specialist

    7 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Role:The Senior Business Intelligence (BI) & Data Engineer is responsible for designing, developing, and delivering business intelligence and data solutions that drive informed decision-making across the organization.Leveraging modern Microsoft Azure technologies, such as Power BI, Synapse, and ADF, this role transforms raw data into meaningful...

  • Senior Data Engineering Position

    7 days ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    About the RoleGreetings from our organization, a pioneering force in data-driven innovation.As a seasoned Data Engineer, you will lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies based on previous research on trends in public cloud...

  • Senior Data Engineering Expert

    2 weeks ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,30,00,000

    Job Opportunity: Senior Data EngineerAbout the PositionWe seek an accomplished data professional to spearhead our data team.Main ResponsibilitiesDesign and implement scalable, modular ELT pipelines using dbt on Snowflake.Create layered data models (e.g., staging, intermediate, mart layers / medallion architecture) aligned with dbt best practices.Lead...

  • Senior Data Engineer

    2 weeks ago

    Anand, Gujarat, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 19,00,000

    Senior data engineer is responsible for designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have experience with Airflow, Python, and Snowflake, as well as strong problem-solving skills and the ability to work in a fast-paced environment.Our team is based in Pune, Bengaluru, and Chennai, and we offer a...