Web Scraper
2 weeks ago
**About Parati**:
Parati is a strategy and product consulting company helping businesses with market intelligence, product management, and go-to-market strategies. The business services are supported through a suite of in-house digital products. An outcome-driven full-suite consulting organization, helping businesses develop and take their products and services to market.
We're currently seeking an experienced Web Scraper to join us and contribute to our data collection and analysis efforts.
**Responsibilities**:
- Perform and manage data scraping, data validation, and data uploads into the database on a regular base
- Support the team on their data needs by extracting data through SQL queries and providing the output file to the team
- Develop and maintain web scraping scripts to extract data from various websites according to project requirements.
- Collaborate with cross-functional teams to understand data needs and implement scraping solutions that align with business objectives.
- Monitor and manage data quality to ensure accuracy, completeness, and consistency in the collected information.
- Regularly update and optimize existing scraping scripts to accommodate changes in target websites' structures and to enhance performance.
- Implement techniques to avoid IP blocks, and anti-scraping measures, and ensure the scraping process is efficient and respectful of target websites' policies.
- Research and evaluate new scraping tools, libraries, and technologies to stay current with industry best practices.
- Document scraping processes, methodologies, and technical specifications for future reference and team collaboration.
- Participate in code reviews and provide constructive feedback to peers to maintain high coding standards and data integrity.
- Assist in data preprocessing, cleaning, and transformation as needed to support downstream analysis and reporting.
**Good to have**:
- Experience with website design or maintenance on platforms like Wix, Wordpress, etc.
- Experience with creating a SQL database
**Qualifications**:
- Bachelor's/Masters degree.
- Proven experience of 1-3 years in web scraping using tools and libraries such as Beautiful
Soup, Scrapy, Selenium, or similar.
- Strong proficiency in programming languages like Python, with the ability to write clean, efficient, and maintainable code.
- Understanding of HTML, CSS, and basic web technologies to effectively navigate and extract data from web pages.
- Familiarity with HTTP protocols, cookies, and handling different types of responses.
- Experience with version control systems (e.g., Git) and collaborative coding practices.
- Excellent problem-solving skills and the ability to adapt to changing requirements and priorities.
- Strong attention to detail and a commitment to delivering accurate and reliable data.
- Effective communication skills, with the ability to explain technical concepts to non-technical stakeholders.
- Knowledge of data privacy and legal considerations related to web scraping.
- Prior experience in data preprocessing and analysis is a plus.
**Salary**: ₹400,000.00 - ₹800,000.00 per year
Schedule:
- Monday to Friday
**Experience**:
- Web Scraping: 1 year (required)
- Data entry: 1 year (required)
- Database Creation: 1 year (required)
- Data Scraping: 1 year (required)
