
Expert Data Pipeline Developer
3 days ago
Job Opportunity:
Senior Backend EngineerWe are seeking a skilled professional to design and develop data pipelines, crawl/fetch data from external systems, and connect interfaces.
- Pipelines development using API-first approach with playwright/requests
- Data parsing/normalization, deduplication/delta logic, and embeddings/similarity search
- Integrations with HR4YOU, SerpAPI, BA job board, email/SMTP, and batch/stream processing
Requirements:
Must-Have Qualifications- 4+ years of backend/data engineering experience
- Python (FastAPI, pydantic, httpx/requests, Playwright/Selenium) and TypeScript for smaller services/SDKs
- Azure: Functions/Container Apps or AKS jobs, Storage/Blob, Key Vault, Monitor/Log Analytics
- Messaging: Service Bus/Queues, idempotence & exactly-once semantics
- Databases: PostgreSQL, pgvector, query design & performance tuning
- NLP/IE experience (spaCy/regex/rapidfuzz), document parsing (pdfminer/textract)
- Experience with license/ToS-compliant data retrieval and captcha/anti-bot strategies
We operate on an API-first, clean code, trunk-based development model with mandatory code reviews.
-
Senior Data Pipeline Developer
4 days ago
Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Opportunity: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks.Responsibilities:Collaborate with stakeholders to understand data requirements and develop technical solutions that meet their needs.Design,...
-
Data Science Pipeline Developer
5 days ago
Ellore, Andhra Pradesh, India beBeeMachineLearning Full time ₹ 8,00,000 - ₹ 15,00,000Job Summary:We are seeking a skilled MLOps Engineer with 7+ years of experience to join our team.Key Responsibilities:Pipeline Development: Develop and maintain scalable ML pipelines and backend services.Application Deployment: Build, deploy, and manage applications using Python and frameworks like Tornado and FastAPI.Data Storage: Work with RDBMS models in...
-
Data Pipeline Architect
4 days ago
Ellore, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000Job Title: Data Pipeline ArchitectAs a key member of our data team, you will be responsible for designing and implementing scalable data pipelines to ensure seamless data flow and accessibility.Create interactive dashboards using Bold BI, Power BI, or Superset to provide actionable insights to stakeholders.Develop data pipelines and automation scripts using...
-
Data Pipeline Architect
7 days ago
Ellore, Andhra Pradesh, India beBeeDataFlowConsultant Full time ₹ 15,00,000 - ₹ 25,50,000Data Flow ConsultantAs a Data Flow Consultant, you will design and develop scalable data pipelines using Oracle Data Flow or Apache Spark (PySpark) with expertise in data patterns, Python, and SQL.The ideal candidate will have 3-12 years of experience in building and managing Data Lakes, Data Warehouses, and Data Pipelines for seamless integration and...
-
Senior Data Pipeline Developer
3 days ago
Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job SummaryWe are seeking an experienced Data Engineer to design, develop, and manage scalable data pipelines and transformation frameworks.Key Responsibilities:Design and build large-scale ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks (Spark), and Azure Synapse Analytics.Develop and optimize PySpark/Spark SQL jobs for batch and...
-
Data Pipeline Architect
2 weeks ago
Ellore, Andhra Pradesh, India beBeeExpertise Full time ₹ 15,00,000 - ₹ 25,00,000Cloud Data SpecialistDesign and implement scalable data pipelines using Azure services such as Data Factory, Databricks, and Data Lake to deliver high-quality business insights and visualization solutions.The ideal candidate will have a strong expertise in building end-to-end data pipelines and delivering efficient data solutions on Azure.Key...
-
Data Pipeline Specialist
5 days ago
Ellore, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,40,000Job Overview:As a seasoned Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines that fuel our analytics and reporting capabilities.Key Responsibilities:Develop robust, high-quality data pipelines that support business needs.Integrate diverse data sources into data lakes and warehouses.Collaborate with...
-
Optimizing Data Pipelines
5 days ago
Ellore, Andhra Pradesh, India beBeeData Full time ₹ 12,60,000 - ₹ 20,16,000Job Role: Senior Data EngineerThe role of a Senior Data Engineer is to design and implement data pipeline architecture that is optimal.Key Responsibilities:Create and maintain data pipeline architecture that is efficient and scalable.Design and implement events/streaming based architecture/design.Identify and implement internal process improvements.Build the...
-
Data Pipeline Specialist
4 days ago
Ellore, Andhra Pradesh, India beBeeAbInitioDeveloper Full time ₹ 18,00,000 - ₹ 25,00,000Job Opportunity: Ab Initio DeveloperAbout the RoleWe are seeking a skilled Ab Initio Developer to join our team. As an Ab Initio Developer, you will be responsible for designing and implementing data pipelines using Ab Initio.Main Responsibilities:Design and implement efficient data pipelines using Ab Initio, ensuring seamless integration with existing...
-
Data Engineer for Advanced Data Pipelines
2 weeks ago
Ellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Ingestion SpecialistWe are seeking a skilled engineer to fill the role of Data Ingestion Specialist.Key Responsibilities:Design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.Deploy and...