Crawling Specialist
1 week ago
Web Crawling SpecialistWe are seeking a skilled professional to spearhead the development and maintenance of web crawlers, ensuring high-quality data extraction from the web.The ideal candidate will have:Advanced programming skills in PythonExperience in web scraping frameworksKnowledge of browser automation tools such as Playwright or SeleniumFamiliarity with distributed scraping techniques and data pipelinesEnhance existing web scraping projects and develop new crawlers using Python-based tools and frameworksClean, validate, and integrate extracted data into downstream storage systemsImplement anti-bot measures and optimize crawling efficiencyMaintain compliance with web crawling best practices