Python/JavaScript Developer – Web Scraping

1 week ago


India AIMLEAP Full time

Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years)

Experience: 3+ Years 

Location: Remote

Mode of Engagement: Full-time

No of Positions: 3

Educational Qualifications: Bachelor's degree in Computer Science, Information Technology

Industry: IT / Software Development

Notice Period: Immediate Joiners Preferred


What We Are Looking For:


  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges


Key Responsibilities


  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks/libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI/ML-based solutions in scraping workflows, such as:
  • Using LLMs for content parsing/cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI/CD practices for scraper code.


Qualifications


  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright/Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL/NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI/ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction/processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 yearsExperience: 4 to 7 Years Location: RemoteMode of Engagement: Full-timeNo of Positions: 3Educational Qualifications: Bachelor's degree in Computer Science, Information TechnologyIndustry: IT / Software DevelopmentNotice Period: Immediate Joiners PreferredWhat We Are Looking For:Strong expertise in web...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: ...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: -...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: -...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years  Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For:...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years  Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years  Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: Strong...


  • India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years) Experience: 3+ Years  Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are...