Web Scraping Engineer

9 hours ago


Mumbai, India Volody Product Full time

We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently.

Responsibilities :

  • Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows.

  • Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright).

  • Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.

  • Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.)

  • Handle dynamic content using headless browsers and solve CAPTCHAs & IP bans.

  • Collaborate with senior developers to improve code quality and efficiency.

Skills Required :

  • Python and scraping libraries such as Scrapy and BeautifulSoup

  • Experience with proxy management, CAPTCHA bypass techniques, and anti-bot evasion.

  • Ability to optimize crawlers for performance and minimize website detection risks.

  • Strong background in databases and data storage systems .

  • Prior Experience of scraping large-scale E-Commerce websites would be plus.

  • Willingness to learn and take feedback constructively.

  • Excellent communication and leadership abilities.



  • Mumbai, Maharashtra, India Volody Product Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently. Responsibilities : Write and maintain web scraping scripts using Python Optimize custom web scraping...

  • Web Scraping

    2 weeks ago


    Chandigarh, Mumbai, Pune, India Symphoni Hr Full time US$ 60,000 - US$ 1,20,000 per year

    JD for Python + Web ScrapingMumbai/Pune/Chandigarh(WFO)Requirement [3-7 Years experience in Web Scraping]Design, develop, and maintain web scraping scripts using Python.Extract, clean, and process large datasets from multiple sources.Identify and troubleshoot scraping issues and implement solutions.Ensure scrapers adhere to website policies and legal...


  • Mumbai, India WeAssemble Full time

    Junior Python Developer - Web ScrapingMumbai, MaharashtraWork Type : Full TimeWere looking for a Junior Python Developer who is passionate about web scraping and data extraction.If you love automating the web, navigating anti-bot mechanisms, and writing clean, efficient code, this role is for you!Key Responsibilities :- Design and build robust web scraping...


  • Mumbai, Maharashtra, India beBeeDataIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    Product Data Ingestion SpecialistWe're building a high-throughput pipeline to ingest product data from hundreds of domains. This role encompasses crawling (discovering and fetching pages via sitemaps/robots) and scraping (extracting structured specs, images, and PDFs into our schema).Key ResponsibilitiesDesign a scalable HTTP crawler with Playwright fallback...

  • Manager Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Alternative Path Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Alternative Path is seeking an experienced Technical Manager to engage and mentor a team of skilled Data engineers who collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across the team and various company departments to shape and innovate new products and features for our platform, enhancing...

  • Jr. Data Minning

    6 days ago


    Mumbai, Maharashtra, India Infytrix Ecom Private Limited Full time

    **Job Title**: Junior Data Engineer **Location**:Mumbai **Job Type**: Full-Time **Key Responsibilities**: - Develop, maintain, and optimize data pipelines to ensure the smooth extraction, transformation, and loading (ETL) of data. - Build and maintain web crawlers and scraping solutions to collect structured and unstructured data from various online...

  • Développeur web

    6 days ago


    Mumbai, Maharashtra, India 360 Space Full time

    LONG-TERM FREELANCE - Expert Web Scraping/Data ExtractionWe are looking for a high-level scraper / data automation expert ready to take on a long-term project with serious ambition. We're talking about a smart, evolving system that requires advanced technical skill, reliability, and creativity to bypass complex data access challenges. About the mission...


  • Mumbai, Maharashtra, India beBeeWebCrawlerEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Web Crawler EngineerWe are seeking a skilled Web Crawler Engineer to join our team. As a key member, you will be responsible for designing and developing web crawlers that efficiently extract valuable insights from the web.About this role:Maintain and enhance existing web scraping projects.Develop and refine crawlers using Python-based tools and...


  • Mumbai, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Web Scraping Developer RoleThis is a challenging and exciting role for a Junior Web Scraping Developer who is passionate about web scraping and data extraction.We are looking for someone with a strong understanding of HTML, DOM, and browser behavior to join our team. The ideal candidate will have hands-on experience with requests, Selenium, BeautifulSoup,...


  • Navi Mumbai, Maharashtra, India Softcell Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Key Responsibilities:Develop and maintain automated web scraping scripts using Python libraries such as Beautiful Soup, Scrapy, and Selenium.Optimize scraping pipelines for performance, scalability, and resource efficiency.Handle dynamic websites, CAPTCHA-solving, and implement IP rotation techniques for uninterrupted scraping.Process and clean raw data,...