
Python Developer – Web Scraping Specialist(Scrapy Expert)
3 weeks ago
We are seeking an experienced Python Developer with a strong background in web scraping (Scrapy Framework)to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools.
Key Responsibilities:
- Develop and maintain efficient web scraping spiders using Python and Scrapy
- Work with AI Spider Templates, Page Object Patterns, and Spidermon for maintainable scraping architecture
- Extract structured and unstructured data via public APIs and dynamic web content
- Handle challenges involving JavaScript-rendered content, HTTP/web protocols, and HTML/CSS structure parsing
- Implement IP rotation and proxy management strategies to avoid blocking
- Clean, normalize, and store extracted data for downstream processing
- Automate scraping workflows using Scrapy Cloud or similar platforms
- Collaborate with data scientists, analysts, and engineers to deliver high-quality datasets
Required Skills & Qualifications:
- Minimum 2 years of hands-on experience in web scraping using Python
- Solid understanding of Scrapy, Requests, BeautifulSoup, and/or Selenium
- Familiarity with dynamic content rendering, JavaScript troubleshooting, and browser automation
- Working knowledge of data cleaning, workflow automation, and cloud scraping environments
- Experience with API integration and JSON/XML data parsing
- Proficiency in HTML/CSS, HTTP protocols, and debugging tools
- Knowledge of proxy services, IP rotation tools, and anti-bot handling techniques
- Familiar with version control systems (e.g., Git)
Preferred Qualifications:
- Experience with Spidermon, Scrapy Cloud, or similar orchestration tools
- Exposure to data storage solutions like PostgreSQL, MongoDB, or cloud databases
- Basic understanding of AI-based scraping templates or machine learning techniques in data extraction
Benefits:
- Competitive salary
- Flexible working hours
- Opportunity to work on cutting-edge data projects
- Learning & development budget
- Remote working options
Job Type: Full-time
Pay: ₹20, ₹35,000.00 per month
Benefits:
- Work from home
Application Question(s):
- What is your last ctc ?
Experience:
- Python: 2 years (Required)
Language:
- English (Required)
Work Location: Remote
-
Python Developer – Web Scraping Specialist
3 weeks ago
Pacific Remote Islands Marine National Monument, India Enhance Tech Solutions Full timeWe are seeking an experienced Python Developer with a strong background in web scraping to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools. Key Responsibilities: Develop and maintain efficient web scraping spiders using Python and Scrapy Work...
-
Remote, India Enhance Tech Solutions Full time ₹ 2,40,000 - ₹ 4,20,000 per yearWe are seeking an experienced Python Developer with a strong background in web scraping (Scrapy Framework)to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools.Key Responsibilities:Develop and maintain efficient web scraping spiders using Python...
-
Web Scraping Specialist
3 weeks ago
Pacific Remote Islands Marine National Monument, India Hypersonix Full timePosition Overview: We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...
-
Python Developer – Web Scraping Specialist
2 weeks ago
Remote, India Enhance Tech Solutions Full time ₹ 2,40,000 - ₹ 4,20,000 per yearWe are seeking an experienced Python Developer with a strong background in web scraping to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools.Key Responsibilities:Develop and maintain efficient web scraping spiders using Python and ScrapyWork with...
-
Python Web Scraping Developer
2 weeks ago
Remote, India Serv Armada Infotech Technologies Pvt Ltd Full time ₹ 20,000 - ₹ 50,000 per yearAbout Us:We are a technology solutions company providing innovative services across multiple industries including hospitality, retail, real estate, construction, and more. We are looking to expand our team with a skilled Python Web Scraping Developer to support various data extraction and automation projects.Role Overview:As a Python Web Scraping Developer,...
-
Python Automation and Web Scraping Specialist
19 hours ago
Remote, India RANKKKING Full time ₹ 3,00,000 - ₹ 4,20,000 per yearJob Title: Python Automation & Web Scraping Specialist (Remote)Job Type: Full-time (Remote)Salary: ₹25,000 – ₹35,000 per monthSchedule: Monday to Saturday, 9:30 AM – 6:30 PMJob Summary:We are seeking a proficient Python Automation & Web Scraping Specialist with a minimum of 2 years of professional experience. This is a remote, full-time position. The...
-
Web Scraping Specialist
1 week ago
Remote, India Hypersonix Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosition Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...
-
Data Scraping
1 week ago
Remote, India Growth For Impact Full time ₹ 1,44,000 - ₹ 1,80,000 per yearTo show that you read the job description, start your application with the phrase- "Yes, I know scraping"About the organization: Growth for Impact is building a platform to enable collaborating for sustainable action.As a new initiative, we are building a niche job board to enable purpose-driven talent find the right kind of roles for them.Website- About the...
-
Lead Data Engineer
3 weeks ago
Pacific Remote Islands Marine National Monument, India Knowledge artisans Pvt Ltd Full timeWe are seeking an experienced Lead Data Engineer to design, develop, and optimize scalable data platforms while driving AI-powered innovation. This role combines hands-on technical expertise with leadership responsibilities, mentoring a team of data engineers and collaborating with cross-functional teams to shape the future of data-driven IT asset...
-
Machine Learning Internship
2 weeks ago
Remote, India Topinvento Full time**Job Title**: Web Scraping Intern **Job Summary**: **Key Responsibilities**: - **Data Collection and Scraping**: - Identify target websites and scrape data using Python libraries (e.g., BeautifulSoup, Scrapy) or browser automation tools (e.g., Selenium, Puppeteer). - Handle dynamic websites, including those built with JavaScript frameworks (React,...