Python/JavaScript Developer – Web Scraping

3 weeks ago

Bareilly, India AIMLEAP Full time

Python/JavaScript Developer – Web Scraping - 4 to 7 years

Experience: 4 to 7 Years

Location: Remote

Mode of Engagement: Full-time

No of Positions: 3

Educational Qualifications: Bachelor's degree in Computer Science, Information Technology

Industry: IT / Software Development

Notice Period: Immediate Joiners Preferred


What We Are Looking For:


  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges


Key Responsibilities


  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks/libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI/ML-based solutions in scraping workflows, such as:
  • Using LLMs for content parsing/cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI/CD practices for scraper code.


Qualifications


  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright/Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL/NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI/ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction/processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.

  • Python/javascript developer – web scraping

    3 weeks ago

    Bareilly, India AIMLEAP Full time

    Python/Java Script Developer – Web Scraping - 4 to 7 yearsExperience: 4 to 7 Years Location: RemoteMode of Engagement: Full-timeNo of Positions: 3Educational Qualifications: Bachelor's degree in Computer Science, Information TechnologyIndustry: IT / Software DevelopmentNotice Period: Immediate Joiners PreferredWhat We Are Looking For:Strong expertise in...

  • AI Web Scraping Engineer

    3 weeks ago

    Bareilly, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:Design and implement scalable data extraction solutions using AI to rapidly...

  • PHP Developer

    1 week ago

    Bareilly, Uttar Pradesh, India SD Web Solution Full time ₹ 3,60,000 - ₹ 8,40,000 per year

    Date posted: September 20, 2025Pay: ₹30, ₹70,000.00 per monthJob description:We're Hiring: PHP DeveloperLocation: Bareilly (U.P) (On-Site)Company: SD Web Solutions – Innovation With TrustAbout Us:At SD Web Solutions, we are a technology-driven company delivering cutting-edge solutions in web development, digital transformation, branding, and...

  • Web Designer

    7 days ago

    Bareilly, Uttar Pradesh, India SD Web Solution Full time ₹ 2,00,000 - ₹ 6,00,000 per year

    As a Web Designer at SD Web Solutions, you will have the opportunity to showcase your creative abilities by blending code and design to develop visually stunning websites. You will be an integral part of our digital team, contributing to projects that require expertise in HTML, CSS, JS, Canva, and Photoshop. - Create visually stunning websites by combining...

  • Web Application Developer

    1 week ago

    Bareilly, India Cladbe Full time

    Company DescriptionCladbe is India's leading PropTech SaaS platform, engineered to revolutionize how real estate developers, builders, agents, and channel partners manage their entire business lifecycle. We empower companies to digitalize, streamline, and scale operations from lead capture to project handover.Role DescriptionWe're seeking a talented and...

  • Ai engineer

    4 weeks ago

    Bareilly, India Gumo Full time

    Responsibilities:Design, build, and maintain our AI-driven knowledge graph creation pipelineIntegrate third-party APIs for web scraping (e.g., Browserless), search (e.g., Tavily), and multimedia processingDevelop and refine sophisticated prompts for Large Language Models (Amazon Bedrock, Claude) to perform high-accuracy data extraction from unstructured text...

  • RPA Engineer

    6 days ago

    Bareilly, India PropertyLoop Full time

    Job Title: RPA Engineer – Web-Form AutomationLocation: India – Remote (core overlap with GMT + IST)Employment Type: Full-time, PermanentReports To: Lead Technologist & Product Strategy Liaison (UK)About Us:PropertyLoop is a UK-based technology company that specialises in streamlining operations through automated processes. Our platform collects...

  • Senior Ruby on Rails Developer

    2 weeks ago

    Bareilly, India Programmers.io Full time

    Job Overview:We’re looking for a skilled Full Stack Developer with experience in AWS, Ruby on Rails, React.js, JavaScript, MySQL, and Elasticsearch. You’ll be responsible for building scalable web applications, implementing backend services, and optimizing performance across the stack.Key Skills Required:Backend: Ruby on Rails, MySQL.Frontend:...

  • Digital Marketing Manager

    3 days ago

    Bareilly, Uttar Pradesh, India SD Web Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionWith over 13 years of market presence, SD Web Solutions offers Web Design, Mobile Development, eCommerce Solutions, and Digital Marketing services to clients ranging from startups to big brands. Innovation, creativity, quality, and promptness are the core values that drive our work. These principles are ingrained in every aspect of what we...

  • Blockchain Developer

    6 days ago

    Bareilly, Uttar Pradesh, India Swapdigit LLP Full time ₹ 15,000 - ₹ 28,00,000 per year

    We are seeking a highly skilled Blockchain Developer to join our growing team. The ideal candidate will have hands-on experience in designing, implementing, and deploying blockchain solutions. You will be responsible for building secure and scalable decentralized applications, writing smart contracts, and integrating blockchain technology with existing...