Python +Webscrapping
2 days ago
We are seeking a skilled Python Developer with hands-on experience in web scraping to join our data engineering team. The ideal candidate will be responsible for building robust scraping pipelines, extracting structured data from various websites, and ensuring data quality and compliance with ethical scraping practices.
Key Responsibilities
- Develop and maintain scalable web scraping scripts using Python libraries such as BeautifulSoup, Scrapy, Selenium, or Playwright.
- Handle dynamic content, pagination, and authentication mechanisms in scraping workflows.
- Clean, transform, and store scraped data in structured formats (CSV, JSON, databases).
- Monitor scraping jobs and troubleshoot failures or data inconsistencies.
- Collaborate with data analysts and engineers to deliver high-quality datasets.
- Ensure scraping practices comply with legal and ethical standards , rate limiting, etc.).
-
Data Engineer/Analyst
1 week ago
Mumbai, India Hiring Infinity Full timeWeve assembled a world-class team and are building a firm grounded in intellectual rigor, commitment to excellence, and a culture of ownership. Were energized by the scale of the opportunities ahead and are looking for teammates who want to help build something fast-moving, high-impact, and built to win.KEY RESPONSIBILITIES : - Construct analytical...