
Data Engineer
3 days ago
Senior Backend Data and Integration Engineer
We are seeking an experienced professional to design and develop data pipelines for crawling, parsing, deduplication, and delta logic.
- Crawling/Fetch Pipelines: Utilize API-first approach with playwright/requests where permitted.
- Parsing/Normalization: Deduplicate job postings and CVs using delta logic.
Key Responsibilities:
- Data Engineering: Embeddings/similarity search using Azure OpenAI and vector persistence in pgvector.
- Integration: Integrate with HR4YOU, SerpAPI, BA job board, email/SMTP.
- Batch/Stream Processing: Use Azure Functions/container jobs for telemetry.
Requirements:
- Proficiency: 4+ years of backend/data engineering experience.
- Languages: Proficient in Python (FastAPI, pydantic, httpx/requests) and solid TypeScript for smaller services/SDKs.
- Azure Expertise: Familiarity with Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics.
- Databases: Knowledge of PostgreSQL, pgvector, query design & performance tuning.
- Messaging: Experience with Service Bus/Queues, idempotence & exactly-once semantics.
- Clean Code: ETL/ELT patterns, testability (pytest), observability (OpenTelemetry).
Nice-to-Have:
- NLP/IE: Experience with spaCy/regex/rapidfuzz and document parsing with pdfminer/textract.
- Compliance: Understanding of license/ToS-compliant data retrieval and captcha/anti-bot strategies.
- Working Method: API-first, clean code, trunk-based development, and mandatory code reviews.
-
Data Engineer
7 days ago
Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,60,00,000About Data Engineering:One of the world's largest employers has opportunities for dynamic professionals to drive innovation and growth globally.Job Summary:We are seeking a skilled Data Engineer to play a key role in building scalable and efficient data solutions to support brand marketing and menu functions. You will collaborate with cross-functional teams...
-
Data Engineering Specialist
2 weeks ago
Belgaum, Karnataka, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 20,00,000Job DescriptionWe are seeking a seasoned Data Engineering Specialist to join our team. As a key member of our data engineering group, you will play a pivotal role in designing, building, and maintaining our data pipeline architecture.Our ideal candidate is an experienced professional with a passion for data engineering, a strong track record of delivering...
-
Senior Data Engineer
7 days ago
Belgaum, Karnataka, India beBeeAirflowExpert Full time ₹ 15,00,000 - ₹ 19,00,000Senior Data Engineer - Airflow ExpertWe are seeking a highly skilled Senior Data Engineer to lead the design and implementation of robust data pipelines using Airflow.The ideal candidate will have in-depth knowledge of Python, with experience in data engineering and cloud-based data warehousing solutions.Key responsibilities include:Designing and developing...
-
Data Engineering Leader
5 days ago
Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data Engineering LeaderJob Description:As a key member of our data engineering team, you will be responsible for designing, deploying, and maintaining our organization's data platforms. You will work closely with clients to understand their data-related needs and provide recommendations to deliver solutions that meet their requirements and...
-
Data Engineer
2 weeks ago
Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Cloud Data SpecialistWe are seeking a highly skilled professional with 4+ years of experience in data engineering to lead the design, development, and maintenance of scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark. This role requires strong programming skills in Python and Scala, as well as hands-on...
-
Data Engineer Position
2 weeks ago
Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Data Engineering PositionAs a key player in our organization, you will design, build, and maintain scalable data pipelines and infrastructure that support real-time and batch data processing.This opportunity is ideal for those who enjoy working with big data technologies, solving complex data problems, and building systems that scale.Develop robust data...
-
Data Engineering Specialist
5 days ago
Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Data Engineer RoleWe're looking for an experienced Data Engineer to play a pivotal role in building and optimizing data pipelines. This challenging yet rewarding position offers the chance to work closely with talented teams, solve real-world data challenges, and make a direct impact on business decisions.
-
Data Engineering Specialist
7 days ago
Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Engineering SpecialistJob Summary:We are seeking an experienced data engineering specialist to join our team. The ideal candidate will have a strong background in data engineering and experience with Google Cloud Platform.The successful candidate will be responsible for developing, constructing, testing and maintaining large-scale data acquisition...
-
Data engineer
2 weeks ago
Belgaum, Karnataka, India RiDiK Full timeWe're looking for a Data Engineer to support our team in India. This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you're someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we'd love to hear from you.Job...
-
Data Engineering Specialist
1 day ago
Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking an experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in cloud-native data engineering, with expertise in designing and implementing scalable data pipelines.Design and implement robust, secure, and efficient data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and...