Web Scraping Expert

9 hours ago

Remote, India FullStackTechies Full time

AIMLEAP is Hiring:
**Web Scraping Expert (Scrapy & Python) WFH**
Experience: 3 to 5 Years
Location: Work from Home/Bangalore/India

**Salary**: 3 Lacs to 7 Lacs INR PA
No of positions: 4 Nos
Educational qualification: CS/IT/Engineering
Industry: IT/ITES
Notice Period**:Immediate**
- Experienced in developing and maintaining robust web scraping pipelines using Scrapy, a high-performance Python framework
- Proficient in Implementing efficient crawling strategies to handle pagination, dynamic content, and complex website structures
- Exposure in data cleaning and manipulation libraries (Pandas, NumPy) and data extraction methods (CSS selectors, XPath)

**Responsibilities**:

- Design, develop, and maintain web scraping projects using Scrapy, including:

- Crawling websites to extract specific data points
- Implementing efficient crawling strategies to handle pagination, dynamic content, and complex website structures
- Employing data extraction techniques with CSS selectors and XPath
- Processing and cleaning scraped data using Python libraries (e.g., Pandas, NumPy)
- Storing extracted data in appropriate formats (e.g., CSV, JSON, databases)
- Collaborate with data engineers and analysts to identify data needs and define scraping requirements
- Write well-documented, maintainable, and efficient Scrapy code
- Integrate scraping pipelines with other Python frameworks and tools as needed
- Stay up-to-date with the latest web scraping trends and best practices
- Troubleshoot and address challenges related to rate limiting, authentication, and website changes
- Implement caching strategies for efficient data retrieval and reduced website load
- Consider potential ethical and legal implications of web scraping

**Qualifications**:

- Proven experience with web scraping techniques and tools (Scrapy preferred)
- Strong proficiency in Python programming
- Knowledge of HTML and CSS for navigating website structures
- Experience with data extraction methods (CSS selectors, XPath)
- Familiarity with data cleaning and manipulation libraries (Pandas, NumPy)
- Understanding of distributed crawling concepts for large-scale data extraction
- Excellent problem-solving and analytical skills
- Ability to work independently and as part of a team
- Strong communication and documentation skills

Pay: ₹300,000.00 - ₹700,000.00 per year

**Benefits**:

- Health insurance
- Work from home

Schedule:

- Day shift

Supplemental pay types:

- Yearly bonus

Application Question(s):

- Years of experience in Python
- Years of experience in Scrapy
- Years of experience in CSS selectors and XPath
- Current CTC
- Notice Period (in days)

**Experience**:

- total work: 1 year (preferred)

Work Location: Remote

  • Web Scraping Specialist

    2 weeks ago

    Remote, India Hypersonix Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Web Scraping Specialist

    5 days ago

    Pacific Remote Islands Marine National Monument, India Hypersonix Full time

    Position Overview: We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Python Automation and Web Scraping Specialist

    4 days ago

    Remote, India RANKKKING Full time ₹ 3,00,000 - ₹ 4,20,000 per year

    Job Title: Python Automation & Web Scraping Specialist (Remote)Job Type: Full-time (Remote)Salary: ₹25,000 – ₹35,000 per monthSchedule: Monday to Saturday, 9:30 AM – 6:30 PMJob Summary:We are seeking a proficient Python Automation & Web Scraping Specialist with a minimum of 2 years of professional experience. This is a remote, full-time position. The...

  • Web Scraping Internship

    2 days ago

    Remote, India Talrn Full time

    Web Scraper Intern Location: Remote Duration: 3-6 months Start Date: Immediate Stipend: Unpaid **About the Role**: We are looking for a motivated Web Scraper Intern to join our team. You will be responsible for building and maintaining web scrapers, extracting and cleaning data, and automating data collection processes. This is a great opportunity to...

  • Python Developer – Web Scraping Specialist

    5 days ago

    Pacific Remote Islands Marine National Monument, India Enhance Tech Solutions Full time

    We are seeking an experienced Python Developer with a strong background in web scraping to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools. Key Responsibilities: Develop and maintain efficient web scraping spiders using Python and Scrapy Work...

  • Python Developer – Web Scraping Specialist(Scrapy Expert)

    5 days ago

    Pacific Remote Islands Marine National Monument, India Enhance Tech Solutions Full time

    We are seeking an experienced Python Developer with a strong background in web scraping (Scrapy Framework)to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools. Key Responsibilities: Develop and maintain efficient web scraping spiders using Python...

  • Browser Automation Expert

    1 week ago

    Remote, India Albireo Tech System Full time

    Browser Automation Expert (JavaScript, Selenium, Web Scraping) Description: We are looking for an experienced automation expert to help with browser automation tasks using JavaScript and Selenium (Python or Java). The work includes web scraping and automating routine browsing activities. **Requirements**: 5+ years of experience in browser...

  • Web Scraper Intern

    1 week ago

    Remote, India Green Dream Earth Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. The stipend is performance-based, linked to the number of successful...

  • Web Scraper Intern

    6 days ago

    Remote, India HelpStudyAbroad.com Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. **Responsibilities**: - Use official website of universities and...

  • Web Scrapper

    2 weeks ago

    Remote, India 7th Growth marketing Full time

    Data Scraper's job involves extracting data from websites and other online sources using software or scripts. They also clean, organize, and analyze the scraped data, ensuring compliance with website policies and legal guidelines. Data Scrapers often collaborate with data scientists and analysts to understand data requirements and ensure the scraped data is...