
Web Scraping Engineer
21 hours ago
We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently.
Responsibilities :
Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows.
Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright).
Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.
Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.)
Handle dynamic content using headless browsers and solve CAPTCHAs & IP bans.
Collaborate with senior developers to improve code quality and efficiency.
Skills Required :
Python and scraping libraries such as Scrapy and BeautifulSoup
Experience with proxy management, CAPTCHA bypass techniques, and anti-bot evasion.
Ability to optimize crawlers for performance and minimize website detection risks.
Strong background in databases and data storage systems .
Prior Experience of scraping large-scale E-Commerce websites would be plus.
Willingness to learn and take feedback constructively.
Excellent communication and leadership abilities.
-
Experienced Web Scraping Expert
1 week ago
Mumbai, Maharashtra, India beBeePython Full time ₹ 12,00,000 - ₹ 20,00,000Senior Python DeveloperWe are seeking an experienced Senior Python Developer with proven expertise in Scrapy and strong skills in web scraping and automation. Key Responsibilities:Main Responsibilities:Design, develop, and maintain scalable web scraping frameworks using Scrapy.Work with additional libraries/tools such as BeautifulSoup, Selenium, Playwright,...
-
Manager Data Engineer
5 days ago
Mumbai, Maharashtra, India Alternative Path Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAlternative Path is seeking an experienced Technical Manager to engage and mentor a team of skilled Data engineers who collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across the team and various company departments to shape and innovate new products and features for our platform, enhancing...
-
Senior Software Engineering Manager
1 week ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Lead Data Scraping EngineerWe are seeking a highly skilled and experienced professional to lead our data scraping team. The ideal candidate will have at least 4 years of hands-on experience in IT scraping, with a minimum of 2 years leading a team of 5+ developers.Design and develop scalable data scraping solutions using tools like Scrapy and...
-
Senior Data Extraction Specialist
1 week ago
Mumbai, Maharashtra, India beBeeWebScraping Full time ₹ 12,00,000 - ₹ 20,00,000Web Scraping Expert WantedWe are seeking a skilled Web Scraping Expert to join our team. As a key player in designing and developing robust web scraping solutions, you will be responsible for extracting structured and unstructured data from various websites and APIs.The ideal candidate will have hands-on experience in web scraping and data extraction, strong...
-
Senior Data Extraction Specialist
3 days ago
Mumbai, Maharashtra, India beBeeWebCrawlerEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000Web Crawler EngineerWe are seeking a skilled Web Crawler Engineer to join our team. As a key member, you will be responsible for designing and developing web crawlers that efficiently extract valuable insights from the web.About this role:Maintain and enhance existing web scraping projects.Develop and refine crawlers using Python-based tools and...
-
AI-Powered Web Automation Specialist
1 week ago
Mumbai, Maharashtra, India beBeeAutomation Full time ₹ 50,000 - ₹ 70,000Web Automation Expert WantedWe are seeking a skilled Web Automation Specialist to design and build intelligent systems that can interact with websites, perform smart actions, and extract data automatically.The ideal candidate will have strong expertise in web automation, combining AI techniques with web crawling/automation tools to create scalable and...
-
Junior Data Extraction Specialist
3 days ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000Web Scraping Developer RoleThis is a challenging and exciting role for a Junior Web Scraping Developer who is passionate about web scraping and data extraction.We are looking for someone with a strong understanding of HTML, DOM, and browser behavior to join our team. The ideal candidate will have hands-on experience with requests, Selenium, BeautifulSoup,...
-
Python Software Developer
1 hour ago
Navi Mumbai, Maharashtra, India Softcell Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per yearKey Responsibilities:Develop and maintain automated web scraping scripts using Python libraries such as Beautiful Soup, Scrapy, and Selenium.Optimize scraping pipelines for performance, scalability, and resource efficiency.Handle dynamic websites, CAPTCHA-solving, and implement IP rotation techniques for uninterrupted scraping.Process and clean raw data,...
-
Junior Python Developer
3 days ago
Mumbai, Maharashtra, India WeAssemble Full timeJunior Python Developer - Web ScrapingMumbai, MaharashtraWork Type : Full TimeWere looking for a Junior Python Developer who is passionate about web scraping and data extraction.If you love automating the web, navigating anti-bot mechanisms, and writing clean, efficient code, this role is for youKey Responsibilities :- Design and build robust web scraping...
-
Data Extraction Expert
14 hours ago
Mumbai, Maharashtra, India beBeeSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000Web Scraping SpecialistAs a skilled Web Scraping Specialist, you will be responsible for designing and implementing efficient and scalable data scraping systems using tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas. Your primary goal will be to extract structured and unstructured data from various websites and APIs.Key Responsibilities:Design,...