
Web Scraping Engineer
9 hours ago
We are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently.
Responsibilities :
Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows.
Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright).
Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.
Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.)
Handle dynamic content using headless browsers and solve CAPTCHAs & IP bans.
Collaborate with senior developers to improve code quality and efficiency.
Skills Required :
Python and scraping libraries such as Scrapy and BeautifulSoup
Experience with proxy management, CAPTCHA bypass techniques, and anti-bot evasion.
Ability to optimize crawlers for performance and minimize website detection risks.
Strong background in databases and data storage systems .
Prior Experience of scraping large-scale E-Commerce websites would be plus.
Willingness to learn and take feedback constructively.
Excellent communication and leadership abilities.
-
Web Scraping Engineer
1 week ago
Mumbai, Maharashtra, India Volody Product Full time ₹ 15,00,000 - ₹ 28,00,000 per yearWe are seeking an experienced Web Scraping Engineer with deep expertise in Scrapy to develop, maintain, and optimize web crawlers. The ideal candidate will have a strong background in extracting, processing, and managing large-scale web data efficiently. Responsibilities : Write and maintain web scraping scripts using Python Optimize custom web scraping...
-
Web Scraping
2 weeks ago
Chandigarh, Mumbai, Pune, India Symphoni Hr Full time US$ 60,000 - US$ 1,20,000 per yearJD for Python + Web ScrapingMumbai/Pune/Chandigarh(WFO)Requirement [3-7 Years experience in Web Scraping]Design, develop, and maintain web scraping scripts using Python.Extract, clean, and process large datasets from multiple sources.Identify and troubleshoot scraping issues and implement solutions.Ensure scrapers adhere to website policies and legal...
-
Junior Python Developer
3 days ago
Mumbai, India WeAssemble Full timeJunior Python Developer - Web ScrapingMumbai, MaharashtraWork Type : Full TimeWere looking for a Junior Python Developer who is passionate about web scraping and data extraction.If you love automating the web, navigating anti-bot mechanisms, and writing clean, efficient code, this role is for you!Key Responsibilities :- Design and build robust web scraping...
-
Web Crawling and Scraping Expert
7 days ago
Mumbai, Maharashtra, India beBeeDataIngestion Full time ₹ 20,00,000 - ₹ 25,00,000Product Data Ingestion SpecialistWe're building a high-throughput pipeline to ingest product data from hundreds of domains. This role encompasses crawling (discovering and fetching pages via sitemaps/robots) and scraping (extracting structured specs, images, and PDFs into our schema).Key ResponsibilitiesDesign a scalable HTTP crawler with Playwright fallback...
-
Manager Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Alternative Path Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAlternative Path is seeking an experienced Technical Manager to engage and mentor a team of skilled Data engineers who collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across the team and various company departments to shape and innovate new products and features for our platform, enhancing...
-
Jr. Data Minning
6 days ago
Mumbai, Maharashtra, India Infytrix Ecom Private Limited Full time**Job Title**: Junior Data Engineer **Location**:Mumbai **Job Type**: Full-Time **Key Responsibilities**: - Develop, maintain, and optimize data pipelines to ensure the smooth extraction, transformation, and loading (ETL) of data. - Build and maintain web crawlers and scraping solutions to collect structured and unstructured data from various online...
-
Développeur web
6 days ago
Mumbai, Maharashtra, India 360 Space Full timeLONG-TERM FREELANCE - Expert Web Scraping/Data ExtractionWe are looking for a high-level scraper / data automation expert ready to take on a long-term project with serious ambition. We're talking about a smart, evolving system that requires advanced technical skill, reliability, and creativity to bypass complex data access challenges. About the mission...
-
Senior Data Extraction Specialist
2 weeks ago
Mumbai, Maharashtra, India beBeeWebCrawlerEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000Web Crawler EngineerWe are seeking a skilled Web Crawler Engineer to join our team. As a key member, you will be responsible for designing and developing web crawlers that efficiently extract valuable insights from the web.About this role:Maintain and enhance existing web scraping projects.Develop and refine crawlers using Python-based tools and...
-
Junior Data Extraction Specialist
2 weeks ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000Web Scraping Developer RoleThis is a challenging and exciting role for a Junior Web Scraping Developer who is passionate about web scraping and data extraction.We are looking for someone with a strong understanding of HTML, DOM, and browser behavior to join our team. The ideal candidate will have hands-on experience with requests, Selenium, BeautifulSoup,...
-
Python Software Developer
1 week ago
Navi Mumbai, Maharashtra, India Softcell Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per yearKey Responsibilities:Develop and maintain automated web scraping scripts using Python libraries such as Beautiful Soup, Scrapy, and Selenium.Optimize scraping pipelines for performance, scalability, and resource efficiency.Handle dynamic websites, CAPTCHA-solving, and implement IP rotation techniques for uninterrupted scraping.Process and clean raw data,...