Web Scraping Engineer

21 hours ago


Mumbai, Maharashtra, India Volody Product Full time ₹ 15,00,000 - ₹ 28,00,000 per year

We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently.

Responsibilities :

  • Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows.

  • Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright).

  • Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.

  • Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.)

  • Handle dynamic content using headless browsers and solve CAPTCHAs & IP bans.

  • Collaborate with senior developers to improve code quality and efficiency.

Skills Required :

  • Python and scraping libraries such as Scrapy and BeautifulSoup

  • Experience with proxy management, CAPTCHA bypass techniques, and anti-bot evasion.

  • Ability to optimize crawlers for performance and minimize website detection risks.

  • Strong background in databases and data storage systems .

  • Prior Experience of scraping large-scale E-Commerce websites would be plus.

  • Willingness to learn and take feedback constructively.

  • Excellent communication and leadership abilities.



  • Mumbai, Maharashtra, India beBeePython Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Python DeveloperWe are seeking an experienced Senior Python Developer with proven expertise in Scrapy and strong skills in web scraping and automation. Key Responsibilities:Main Responsibilities:Design, develop, and maintain scalable web scraping frameworks using Scrapy.Work with additional libraries/tools such as BeautifulSoup, Selenium, Playwright,...


  • Mumbai, Maharashtra, India Alternative Path Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Alternative Path is seeking an experienced Technical Manager to engage and mentor a team of skilled Data engineers who collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across the team and various company departments to shape and innovate new products and features for our platform, enhancing...


  • Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Lead Data Scraping EngineerWe are seeking a highly skilled and experienced professional to lead our data scraping team. The ideal candidate will have at least 4 years of hands-on experience in IT scraping, with a minimum of 2 years leading a team of 5+ developers.Design and develop scalable data scraping solutions using tools like Scrapy and...


  • Mumbai, Maharashtra, India beBeeWebScraping Full time ₹ 12,00,000 - ₹ 20,00,000

    Web Scraping Expert WantedWe are seeking a skilled Web Scraping Expert to join our team. As a key player in designing and developing robust web scraping solutions, you will be responsible for extracting structured and unstructured data from various websites and APIs.The ideal candidate will have hands-on experience in web scraping and data extraction, strong...


  • Mumbai, Maharashtra, India beBeeWebCrawlerEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Web Crawler EngineerWe are seeking a skilled Web Crawler Engineer to join our team. As a key member, you will be responsible for designing and developing web crawlers that efficiently extract valuable insights from the web.About this role:Maintain and enhance existing web scraping projects.Develop and refine crawlers using Python-based tools and...


  • Mumbai, Maharashtra, India beBeeAutomation Full time ₹ 50,000 - ₹ 70,000

    Web Automation Expert WantedWe are seeking a skilled Web Automation Specialist to design and build intelligent systems that can interact with websites, perform smart actions, and extract data automatically.The ideal candidate will have strong expertise in web automation, combining AI techniques with web crawling/automation tools to create scalable and...


  • Mumbai, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Web Scraping Developer RoleThis is a challenging and exciting role for a Junior Web Scraping Developer who is passionate about web scraping and data extraction.We are looking for someone with a strong understanding of HTML, DOM, and browser behavior to join our team. The ideal candidate will have hands-on experience with requests, Selenium, BeautifulSoup,...


  • Navi Mumbai, Maharashtra, India Softcell Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Key Responsibilities:Develop and maintain automated web scraping scripts using Python libraries such as Beautiful Soup, Scrapy, and Selenium.Optimize scraping pipelines for performance, scalability, and resource efficiency.Handle dynamic websites, CAPTCHA-solving, and implement IP rotation techniques for uninterrupted scraping.Process and clean raw data,...


  • Mumbai, Maharashtra, India WeAssemble Full time

    Junior Python Developer - Web ScrapingMumbai, MaharashtraWork Type : Full TimeWere looking for a Junior Python Developer who is passionate about web scraping and data extraction.If you love automating the web, navigating anti-bot mechanisms, and writing clean, efficient code, this role is for youKey Responsibilities :- Design and build robust web scraping...

  • Data Extraction Expert

    14 hours ago


    Mumbai, Maharashtra, India beBeeSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Web Scraping SpecialistAs a skilled Web Scraping Specialist, you will be responsible for designing and implementing efficient and scalable data scraping systems using tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas. Your primary goal will be to extract structured and unstructured data from various websites and APIs.Key Responsibilities:Design,...