Web Scraping Expert

3 days ago

Bengaluru Karnataka, India FullStackTechies Full time

AIMLEAP is Hiring:
**Job Title**: Web Scraping Expert (Scrapy & Python)

**Company**: AIMLEAP

**CTC**: 3 LPA - 5 LPA ( **Depends on interview performance** )

**Department**: Data Engineering/Web Development

**Summary**:
We are seeking a talented and results-oriented Web Scraping Expert to join our team. You will be responsible for developing and maintaining robust web scraping pipelines using Scrapy, a high-performance Python framework. You will leverage your expertise in Python and web scraping techniques to extract valuable data from various online sources in a reliable and scalable manner.

**Responsibilities**:

- Design, develop, and maintain web scraping projects using Scrapy, including:

- Crawling websites to extract specific data points
- Implementing efficient crawling strategies to handle pagination, dynamic content, and complex website structures
- Employing data extraction techniques with CSS selectors and XPath
- Processing and cleaning scraped data using Python libraries (e.g., Pandas, NumPy)
- Storing extracted data in appropriate formats (e.g., CSV, JSON, databases)
- Collaborate with data engineers and analysts to identify data needs and define scraping requirements
- Write well-documented, maintainable, and efficient Scrapy code
- Integrate scraping pipelines with other Python frameworks and tools as needed
- Stay up-to-date with the latest web scraping trends and best practices
- Troubleshoot and address challenges related to rate limiting, authentication, and website changes
- Implement caching strategies for efficient data retrieval and reduced website load
- Consider potential ethical and legal implications of web scraping

**Qualifications**:

- Proven experience with web scraping techniques and tools (Scrapy preferred)
- Strong proficiency in Python programming
- Knowledge of HTML and CSS for navigating website structures
- Experience with data extraction methods (CSS selectors, XPath)
- Familiarity with data cleaning and manipulation libraries (Pandas, NumPy)
- Understanding of distributed crawling concepts for large-scale data extraction
- Excellent problem-solving and analytical skills
- Ability to work independently and as part of a team
- Strong communication and documentation skills

**Salary**: ₹300,000.00 - ₹600,000.00 per year

**Benefits**:

- Health insurance
- Work from home

Schedule:

- Day shift

Supplemental pay types:

- Yearly bonus

Application Question(s):

- Years of experience in web scraping
- Do you have experience in Scrapy
- Current CTC
- Notice period (in days)
- Experience in Middlewares.py,settings.py,pipelines.py

**Experience**:

- total work: 2 years (preferred)

Work Location: Remote

  • Web Scraping Expert

    5 days ago

    Bengaluru, India FullStackTechies Full time

    AIMLEAP is Hiring: **Web Scraping Expert - Python Trainer** Experience: 3 to 7 Years Location: Bangalore (Work from Home) No of positions: 2 Industry: Automation/IT-Software Employment Type**:Full Time/Part Time/Consulting** Educational Qualification: B.Tech / B.E / MCA / BCA/MBA Salary/CTC: 4 lacs to 8 lacs INR per annum Notice Period: Immediate - 1...

  • Web Scraping Specialist

    3 weeks ago

    Bengaluru, Karnataka, India Hypersonix Full time

    Position Overview We are seeking a highly skilled Web Scraping Architect to join our team The successful candidate will be responsible for designing implementing and maintaining web scraping processes to gather data from various online sources efficiently and accurately As a Web Scraping Specialist you will play a crucial role in collecting data for...

  • Web Scraping Specialist

    1 week ago

    Bengaluru, Karnataka, India Hypersonix Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Web Scraping Specialist

    3 hours ago

    Bengaluru, India Hypersonix Full time

    Position Overview: We are seeking a highly skilled Web Scraping A rchitect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Gmware - Web Scraping Developer

    2 weeks ago

    Bengaluru, India GM WARE Full time

    Job Description :Web Scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated knowledge experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.Roles and Responsibilities :- Develop and maintain service that extracts websites...

  • Python Developer Web Scraping

    6 days ago

    Bengaluru, Karnataka, India Gmware Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    Web Scraping engineerPython web scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.ResponsibilitiesDevelop and maintain a service that extracts website data using...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Web Scraping Developer

    2 weeks ago

    Bengaluru, India Gmware Full time

    We are hiring a Python Developer (0.52 yrs) for web scraping. Responsibilities: build & optimize scrapers, handle dynamic sites, proxies & CAPTCHAs, ensure data accuracy. Skills: Python, Scrapy, BeautifulSoup, Selenium, regex, debugging. Provident fundHealth insurance

  • Netscribes - Web Scraping API Developer - Python

    2 weeks ago

    Bengaluru, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Job Description :Key Responsibilities : - Web Scraping & Data Ingestion : Design, build, and maintain sophisticated web scraping applications to ingest competitor data from diverse online retail platforms.- API Development : Develop scalable RESTful APIs in Python (FastAPI / Flask / Django) to serve extracted data for downstream consumption by internal and...

  • Data Scraping Engineer

    5 days ago

    Bengaluru, Karnataka, India Stylumia Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description Technology Data Scraping Engineer (Intern)Location: Bengaluru | Full Time Apply Now Who We Are: Stylumia believes in augmenting human intelligence in fashion and lifestyle retail for a better world. With relevant data and the right technology, people and businesses in fashion and lifestyle retail can solve challenging problems and...