Python +Webscrapping
4 days ago
Navi Mumbai, Maharashtra, India
Reserve Bank Information Technology
Full time
We are seeking a skilled Python Developer with hands-on experience in web scraping to join our data engineering team. The ideal candidate will be responsible for building robust scraping pipelines, extracting structured data from various websites, and ensuring data quality and compliance with ethical scraping practices.
Key Responsibilities
- Develop and maintain scalable web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, Selenium, or Playwright.
- Handle dynamic content, pagination, and authentication mechanisms in scraping workflows.
- Clean, transform, and store scraped data in structured formats (CSV, JSON, databases).
- Monitor scraping jobs and troubleshoot failures or data inconsistencies.
- Collaborate with data analysts and engineers to deliver high-quality datasets.
- Ensure scraping practices comply with legal and ethical standards , rate limiting, etc.).
