Python Developer – Web Scraping Specialist(Scrapy Expert)

3 days ago

Remote, India Enhance Tech Solutions Full time ₹ 2,40,000 - ₹ 4,20,000 per year

We are seeking an experienced Python Developer with a strong background in web scraping (Scrapy Framework)to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools.

Key Responsibilities:

  • Develop and maintain efficient web scraping spiders using Python and Scrapy
  • Work with AI Spider Templates, Page Object Patterns, and Spidermon for maintainable scraping architecture
  • Extract structured and unstructured data via public APIs and dynamic web content
  • Handle challenges involving JavaScript-rendered content, HTTP/web protocols, and HTML/CSS structure parsing
  • Implement IP rotation and proxy management strategies to avoid blocking
  • Clean, normalize, and store extracted data for downstream processing
  • Automate scraping workflows using Scrapy Cloud or similar platforms
  • Collaborate with data scientists, analysts, and engineers to deliver high-quality datasets

Required Skills & Qualifications:

  • Minimum 2 years of hands-on experience in web scraping using Python
  • Solid understanding of Scrapy, Requests, BeautifulSoup, and/or Selenium
  • Familiarity with dynamic content rendering, JavaScript troubleshooting, and browser automation
  • Working knowledge of data cleaning, workflow automation, and cloud scraping environments
  • Experience with API integration and JSON/XML data parsing
  • Proficiency in HTML/CSS, HTTP protocols, and debugging tools
  • Knowledge of proxy services, IP rotation tools, and anti-bot handling techniques
  • Familiar with version control systems (e.g., Git)

Preferred Qualifications:

  • Experience with Spidermon, Scrapy Cloud, or similar orchestration tools
  • Exposure to data storage solutions like PostgreSQL, MongoDB, or cloud databases
  • Basic understanding of AI-based scraping templates or machine learning techniques in data extraction

Benefits:

  • Competitive salary
  • Flexible working hours
  • Opportunity to work on cutting-edge data projects
  • Learning & development budget
  • Remote working options

Job Type: Full-time

Pay: ₹20, ₹35,000.00 per month

Benefits:

  • Work from home

Application Question(s):

  • What is your last ctc ?

Experience:

  • Python: 2 years (Required)

Language:

  • English (Required)

Work Location: Remote

  • Python Developer – Web Scraping Specialist

    3 days ago

    Remote, India Enhance Tech Solutions Full time ₹ 2,40,000 - ₹ 4,20,000 per year

    We are seeking an experienced Python Developer with a strong background in web scraping to join our growing data engineering team. You will work on building robust, scalable data extraction pipelines using modern scraping frameworks and automation tools.Key Responsibilities:Develop and maintain efficient web scraping spiders using Python and ScrapyWork with...

  • Python Web Scraping Developer

    3 days ago

    Remote, India Serv Armada Infotech Technologies Pvt Ltd Full time ₹ 20,000 - ₹ 50,000 per year

    About Us:We are a technology solutions company providing innovative services across multiple industries including hospitality, retail, real estate, construction, and more. We are looking to expand our team with a skilled Python Web Scraping Developer to support various data extraction and automation projects.Role Overview:As a Python Web Scraping Developer,...

  • Python Automation and Web Scraping Specialist

    2 weeks ago

    Remote, India RANKKKING Full time ₹ 3,00,000 - ₹ 4,20,000 per year

    Job Title: Python Automation & Web Scraping Specialist (Remote)Job Type: Full-time (Remote)Salary: ₹25,000 – ₹35,000 per monthSchedule: Monday to Saturday, 9:30 AM – 6:30 PMJob Summary:We are seeking a proficient Python Automation & Web Scraping Specialist with a minimum of 2 years of professional experience. This is a remote, full-time position. The...

  • Python/JavaScript Developer – Web Scraping

    4 days ago

    Remote, India FullStackTechies Full time ₹ 3,50,000 - ₹ 6,00,000 per year

    Python/JavaScript Developer – Web Scraping Experience: 3+ YearsLocation: RemoteMode of Engagement: Full-timeNo of Positions: 3Educational Qualifications: Bachelor's degree in Computer ScienceIndustry: IT / Software DevelopmentNotice Period: Immediate Joiners PreferredWhat We Are Looking For:Strong expertise in web scraping with hands-on experience in...

  • Web Scraping-intern

    1 day ago

    Remote, India Mavenai Technologies Full time

    Requirements: Proficiency in programming languages such as Python or JavaScript Familiarity with web scraping frameworks and tools such as Scrapy, Beautiful Soup, or Selenium Understanding of HTML, CSS, and JavaScript Knowledge of data parsing and cleaning techniques Familiarity with database management systems such as MySQL or PostgreSQL Good communication...

  • Python Backend Engineer + Web scraper

    1 week ago

    Remote, India TriDevSofts Full time ₹ 9,60,000 - ₹ 14,40,000 per year

    Position: Associate Tech Specialist / Tech SpecialistExperience: 6 to 8 YearsLocation: RemoteWork timing: 2 PM to 11 PMContact Duration: 6 Months (Extendable)PF & BGV MandatoryRoles and Responsibilities:* Lead the design, architecture, and implementation of scalable and maintainable web scraping solutions using the Scrapy framework, integrated with tools...

  • Associate Tech Specialist

    1 week ago

    Remote, India TriDevSofts Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Position: Associate Tech Specialist / Tech SpecialistExperience: 6 to 8 YearsLocation: RemoteWork timing: 2 PM to 11 PMContact Duration: 6 Months (Extendable)PF & BGV MandatoryRoles and Responsibilities:* Lead the design, architecture, and implementation of scalable and maintainable web scraping solutions using the Scrapy framework, integrated with tools...

  • Web Scraper Intern

    7 days ago

    Remote, India HelpStudyAbroad.com Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. **Responsibilities**: - Use official website of universities and...

  • Web Scraper Intern

    2 weeks ago

    Remote, India Green Dream Earth Full time

    **Position Overview**: We are seeking a detail-oriented Web Scraper Intern to extract data from university websites. You will be responsible for scraping university information and course details, organizing this data in an Excel template, and sharing your code via GitHub or Google Colab. The stipend is performance-based, linked to the number of successful...

  • Data Scraping

    23 hours ago

    Remote, India Growth For Impact Full time ₹ 1,44,000 - ₹ 1,80,000 per year

    To show that you read the job description, start your application with the phrase- "Yes, I know scraping"About the organization: Growth for Impact is building a platform to enable collaborating for sustainable action.As a new initiative, we are building a niche job board to enable purpose-driven talent find the right kind of roles for them.Website- About the...