
Data Ingestion Specialist
1 week ago
We are building a scalable data ingestion pipeline across hundreds of domains. You will be responsible for designing and implementing the crawling and extraction layer end-to-end: HTTP-first crawling with a Playwright fallback, per-domain learned selectors, and reliable PDF handling.
About the RoleThis role involves crawling (discovering & fetching pages via sitemaps/robots) and scraping (extracting structured specs, images, and PDFs into our schema).
Your Responsibilities- Design an HTTP-first crawler with Playwright fallback for JavaScript-heavy pages.
- Implement sitemap diffing and conditional GETs for incremental runs.
- Build a lightweight, efficient, and scalable solution for extracting data from various sources.
Main Skills:
Crawling and Scraping, Web Development, Data Extraction, Sitemap Management
Benefits:
- Opportunity to work on a high-throughput product data ingestion pipeline
- Collaborative and dynamic work environment
- Continuous learning and skill development opportunities
Ongoing Tasks:
The successful candidate will be expected to:
- Continuously improve the crawling and extraction process
- Develop and maintain a robust and scalable architecture
- Collaborate with cross-functional teams to achieve business objectives
-
Cloud Data Engineering Specialist
1 week ago
Vadodara, Gujarat, India beBeeProficiency Full time ₹ 15,00,000 - ₹ 25,00,000Cloud Data Engineering SpecialistAbout Our Vision:We aim to be a leader in digital transformation, driving clients' success through advanced engineering expertise and innovative solutions.Our Mission:Empowering clients to achieve their goals and unlock new growth opportunities by providing cutting-edge cloud services.Mandatory Skills:ELT Expertise,...
-
Data Engineer
1 week ago
Vadodara, Gujarat, India LTIMindtree Full timeWe are hiring for AWS Data EngineerExperience - 5 to 7 YearsLocation : Chennai Notice period - immediate to 30 daysJob SummarySeeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4 years of experience in GCP BQ Dataflow Airflow and Python Should have hands...
-
Data Integration Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataIntegration Full time ₹ 18,00,000 - ₹ 24,00,000Job DescriptionWe are seeking a highly skilled Data Integration Specialist to lead the development and implementation of data pipelines across various systems.The ideal candidate will have a strong background in designing, deploying, and managing data integration processes using Informatica and other tools.Main Responsibilities:Designing and developing...
-
Senior Data Transformation Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000Data Engineering OpportunityWe are seeking an experienced data engineer to design and implement scalable, high-performance data transformation pipelines using Snowflake and dbt.Key Responsibilities:Data Pipeline Design: Design and implement scalable ELT pipelines using dbt on Snowflake, following industry-accepted best practices.Data Ingestion: Build...
-
Chief Data Architect
2 weeks ago
Vadodara, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000Job DescriptionA data engineering specialist is a critical role responsible for designing and implementing data solutions using Azure technologies.This position requires expertise in building end-to-end analytics, managing data architectures, and utilizing various tools such as Apache Spark, Delta Lake tables, and Data Factory.Primary Skills:Proficiency in...
-
Cloud Data Specialist
1 week ago
Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000About UsWe're a business transformation leader, leveraging technology to drive innovation across various industries.Our mission is to harness the power of technology for a more inclusive and sustainable future.We provide consulting, technology, professional, and outsourcing services that cater to diverse business needs.Key Responsibilities:Data Pipeline...
-
Chief Data Infrastructure Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data ArchitectAn expert in designing and implementing end-to-end data architectures, leveraging Snowflake and Matillion for data ingestion, transformation, and storage.Main Responsibilities:Develop data models and architecture best practices (dimensional, normalized, star/snowflake schemas)Evaluate and adopt tools in the modern data stack,...
-
Scalable Data Solutions Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 27,00,000Informatica Data EngineerWe are seeking an experienced Informatica data engineer to drive the development of scalable ETL pipelines using Azure Data Factory and related services.The ideal candidate will have strong hands-on experience in Informatica and cloud-based analytics, with expert-level knowledge of Azure Data Factory, Azure Synapse Analytics, Azure...
-
Data Pipeline Architect
5 days ago
Vadodara, Gujarat, India beBeePipeline Full time ₹ 8,00,000 - ₹ 13,00,000Job Title: Data Pipeline ArchitectAre you an experienced data professional looking to take your career to the next level? We are seeking a skilled Data Pipeline Architect to join our team.Key Responsibilities:Design, develop, and optimize complex data pipelines for integrating multiple sources into Databricks.Implement and maintain continuous...
-
Chief Data Infrastructure Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data ArchitectWe are seeking an accomplished Senior Data Engineer to join our team. The ideal candidate will have deep expertise in designing and implementing scalable data pipelines, enterprise-grade data governance, security, and AI-powered engineering automation.This role involves playing a pivotal part in shaping the data ingestion,...