Python/JavaScript Developer – Web Scraping

4 weeks ago

India AIMLEAP Full time

Python/JavaScript Developer – Web Scraping - 4 to 7 years

Experience: 4 to 7 Years

Location: Remote

Mode of Engagement: Full-time

No of Positions: 3

Educational Qualifications: Bachelor's degree in Computer Science, Information Technology

Industry: IT / Software Development

Notice Period: Immediate Joiners Preferred


What We Are Looking For:


  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges


Key Responsibilities


  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks/libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI/ML-based solutions in scraping workflows, such as:
  • Using LLMs for content parsing/cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI/CD practices for scraper code.


Qualifications


  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright/Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL/NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI/ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction/processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.

  • Python/JavaScript Developer

    4 weeks ago

    India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We...

  • Python/JavaScript Developer – Web Scraping

    4 weeks ago

    India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: ...

  • Python/JavaScript Developer – Web Scraping

    4 weeks ago

    India AIMLEAP Full time

    Python/JavaScript Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: -...

  • Python/javascript developer

    3 weeks ago

    India AIMLEAP Full time

    Python/Java Script Developer – Web Scraping - 4 to 7 years Experience: 4 to 7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor's degree in Computer Science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred What We Are Looking For: ...

  • Senior Web Scraping Engineer

    2 weeks ago

    India S2T AI - AI-Powered Investigations Full time

    We are on the lookout for a highly competent, self-motivated Senior Web Scraping Engineer with real-world experience in API Scraping or Mobile Scraping to join our India team. The Role: Gather and process raw data at scale (including writing scripts, web scraping, calling APIs) Work in a larger team. Able to work independently to complete assigned tasks The...

  • AI Web Scraping Engineer

    3 weeks ago

    india, IN S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:Design and implement scalable data extraction solutions using AI to rapidly...

  • Senior Web Scraping Engineer

    3 weeks ago

    india, IN S2T AI - AI-Powered Investigations Full time

    We are on the lookout for a highly competent, self-motivated Senior Web Scraping Engineer with real-world experience in API Scraping or Mobile Scraping to join our India team.The Role:Gather and process raw data at scale (including writing scripts, web scraping, calling APIs)Work in a larger team.Able to work independently to complete assigned tasksThe...

  • Python Automation and Web Scraping Specialist

    2 weeks ago

    Bengaluru, India Foresiet Full time

    Job Description Company Description Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and...

  • AI Web Scraping Engineer

    4 weeks ago

    India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development. The Role: Design and implement scalable data extraction solutions using AI to...

  • Data Engineer

    3 weeks ago

    india, IN Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...