PythonWebScrapingExpert

Senior Python Developer - Web Scraping and Automation

• ">
• Our company is seeking an experienced Senior Python Developer with proven expertise in Scrapy.">

We are a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology.

This role involves designing, developing, and maintaining scalable web scraping frameworks using Scrapy, as well as working with additional libraries/tools such as BeautifulSoup, Selenium, Playwright, Requests, etc.

You will implement robust error handling, data parsing, and data storage mechanisms (JSON, CSV, SQL/NoSQL databases), build and optimize asynchronous scraping workflows, and handle multithreading/multiprocessing.

Collaboration with product managers, QA, and DevOps teams is crucial to ensure timely delivery.

The ideal candidate has 2+ years of experience in Python development with Scrapy expertise, proficiency with automation libraries, experience with REST APIs, asynchronous programming, and concurrency, and familiarity with databases (SQL/NoSQL) and cloud-based data pipelines.

Strong problem-solving skills and ability to meet deadlines in an Agile environment are essential for success in this role.

A knowledge of DevOps tools such as Docker, GitHub Actions, or CI/CD pipelines is preferred but not required.