Python/JavaScript Developer – Web Scraping

6 days ago

Solapur, India AIMLEAP Full time

Python/JavaScript Developer – Web Scraping & AI/ML (3 to 6 years)

Experience: 3+ Years 

Location: Remote

Mode of Engagement: Full-time

No of Positions: 3

Educational Qualifications: Bachelor's degree in Computer Science, Information Technology

Industry: IT / Software Development

Notice Period: Immediate Joiners Preferred


What We Are Looking For:


  • Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
  • Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
  • Skilled in JavaScript for web scraping and automation tasks.
  • Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
  • Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
  • Passionate about leveraging advanced technologies to solve complex data challenges


Key Responsibilities


  • Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
  • Optimize scraping pipelines for scalability, reliability, and performance.
  • Work with Scrapy and related Python frameworks/libraries for crawler development.
  • Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
  • Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
  • Implement AI/ML-based solutions in scraping workflows, such as:
  • Using LLMs for content parsing/cleaning.
  • Automating CAPTCHA solving and anti-bot evasion.
  • Improving data matching, deduplication, and entity recognition.
  • Collaborate with data engineers and product teams to ensure scraped data quality and usability.
  • Maintain proper documentation, testing, and CI/CD practices for scraper code.


Qualifications


  • Bachelor's degree in computer science, IT, or related field.
  • Strong programming skills in Python (Scrapy, Requests, Playwright/Selenium).
  • Proficiency in JavaScript for handling browser automation and dynamic sites.
  • Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
  • Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
  • Experience working with databases (SQL/NoSQL) for storing and processing scraped data.
  • Hands-on experience in AI/ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction/processing.
  • Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
  • Strong problem-solving skills for dealing with anti-bot measures and rate limits.
  • Excellent communication and collaboration skills.

  • Senior AI Developer

    4 weeks ago

    Solapur, Maharashtra, India Stamens Software Pvt. Ltd. Full time

    Job Title: Senior AI Developer-Intelligent Web AutomationLocation: Fully RemoteEmployment Type: Full Time/Contract/FreelancerInitial Contract Duration: 6 months — may be extendedExperience: 3+ years in AI + automationBudget: 50 LPA – 70 LPA Position Overview:We are looking for an senior experienced AI/ML Developer with strong expertise in web automation...

  • Web developer

    10 hours ago

    Solapur, India CUS Solution Full time

    Job SummaryWe are looking for a talented and detail-oriented Web Developer to design, build, and maintain responsive, user-friendly, and scalable websites and web applications. The ideal candidate should have a strong background in front-end and/or back-end development, excellent problem-solving skills, and the ability to work in a fast-paced environment...

  • Javascript Developer

    3 weeks ago

    Solapur, Maharashtra, India People Prime Worldwide Full time

    About Company:Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.The company is...

  • Junior Full Stack Developer

    2 weeks ago

    Solapur, India Shri Sai Tech LLC Full time

    Experience: FresherJob Type: Full-timeLocation: Solapur (Onsite) Job Description: We are looking for an enthusiastic Junior Full Stack Developer (Fresher) to join our team in Solapur. In this role, you will work on both front-end and back-end development, assisting in building scalable and user-friendly applications. This is a great opportunity for fresh...

  • Junior Full Stack Developer

    3 days ago

    Solapur, Maharashtra, India Shri Sai Tech LLC Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    Experience: FresherJob Type: Full-timeLocation: Solapur (Onsite)Job Description:We are looking for an enthusiastic Junior Full Stack Developer (Fresher) to join our team in Solapur. In this role, you will work on both front-end and back-end development, assisting in building scalable and user-friendly applications. This is a great opportunity for fresh...

  • Back End Developer

    4 weeks ago

    Solapur, Maharashtra, India Pixeldust Technologies Full time

    Role Overview:We are seeking an experienced and talented Back-End Developer with expertise in Python and Graph Data to join our growing team. The ideal candidate will work on designing, developing, and maintaining scalable back-end services, APIs, and databases, particularly focused on handling complex graph data. You will contribute to the optimization and...

  • Software Development Engineer In Test

    4 weeks ago

    Solapur, Maharashtra, India Medpace Full time

    Job Summary Medpace is growing rapidly and we are currently seeking a full-time office-based SDET to join our Information Technology IT team in our Mumbai office The SDET position is a vital role whose success relies upon your knowledge experience and dedication The Medpace IT department delivers software solutions that enable and empower both...

  • Quality Assurance Automation Engineer

    3 weeks ago

    Solapur, Maharashtra, India TestGrid Full time

    Job Title: Quality Assurance Automation EngineerLocation: Remote (India)Employment Type: Full-timeJob Description Company Description TestGrid is a leading provider of end-to-end automation cloud and on-premise testing solutions. The company focuses on simplifying the testing process with innovative AI-powered technology to help organizations achieve time...

  • UI Developer

    3 weeks ago

    Solapur, Maharashtra, India AmpleLogic Full time

    We are seeking a talented and passionate UI Developer to join our team at AmpleLogic. The ideal candidate will be responsible for designing and developing user interfaces that provide exceptional user experience. You will collaborate with product managers and stakeholders to create intuitive and visually appealing applications. If you have a strong portfolio...

  • Frontend Developer

    2 days ago

    Solapur, India WebBuddy LLC Full time

    Company Description At WebBuddy LLC, we are a web design and development agency dedicated to shaping your online presence. With our team of expert developers, creative designers, and strategic thinkers, we transform ideas into digital realities for clients across the globe. We focus on delivering customized web solutions that drive business growth, and we...