Python Web Scraping Engineer – Automation

2 weeks ago

bangalore, India AIMLEAP Full time

Python Web Scraping Engineer – Advanced Automation (WFH) Experience: 3–10 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We Are Looking For Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer. Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems. Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions. Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits. Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage. Responsibilities Develop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright/Selenium/Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services, proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.  Qualifications 3–10 years of experience in Python-based web scraping and automation. Strong experience in Selenium, Playwright, Puppeteer, and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy. Hands-on experience with proxy networks, fingerprinting, session handling, and anti-bot strategies. Understanding of SQL/NoSQL databases for structured data storage. Experience working with AWS/GCP/Azure is a plus. Strong debugging, analytical, and problem-solving skills. 

  • Python Automation and Web Scraping Specialist

    3 weeks ago

    Bangalore Division, India Foresiet Full time

    Company Description Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research...

  • Python Automation

    10 hours ago

    bangalore, India Claw Legaltech Full time

    Our CompanyClaw LegalTech is building India’s most powerful legal automation platform, enabling lawyers, law firms, and enterprises to streamline research, case tracking, drafting, and compliance using AI.Our engineering team develops highly scalable infrastructure, web automations, and API layers that power real-time data retrieval across courts,...

  • Web Scraping Engineer

    6 days ago

    bangalore, India noon Full time

    Job title: Web Scraping Engineer Location: Gurgaon About the Role We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms . The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing,...

  • Data Engineer

    1 day ago

    bangalore, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Senior Web Automation Specialist

    2 weeks ago

    bangalore, India beBeeWebAutomation Full time

    Senior Web Automation SpecialistWe are seeking a highly skilled Senior Web Automation Specialist to join our team. As a key member of our automation team, you will be responsible for designing and developing high-scale automated web scraping workflows for dynamic and protected websites.Your primary focus will be on implementing browser automation solutions...

  • Web Scraping Specialist

    4 weeks ago

    Bangalore, Karnataka, India Hypersonix Full time

    Position Overview We are seeking a highly skilled Web Scraping Architect to join our team The successful candidate will be responsible for designing implementing and maintaining web scraping processes to gather data from various online sources efficiently and accurately As a Web Scraping Specialist you will play a crucial role in collecting data for...

  • Web Crawling Engineer

    3 days ago

    bangalore, India Forage AI Full time

    We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Salary budget...

  • Senior Web Crawler Specialist

    2 weeks ago

    bangalore, India beBeeEngineer Full time

    We are seeking a skilled engineer to build and maintain web crawlers, extract valuable insights from the web, and ensure data quality.The ideal candidate will have strong programming skills and experience in scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Key Responsibilities:Maintain and enhance existing web scraping...

  • Internal Automation Engineer

    2 days ago

    bangalore, India RivetStays Full time

    RivetStays is hiring an Internal Automation Engineer to build and maintain automations that streamline internal workflows, integrate our tools, and reduce manual effort across teams. You’ll design reliable systems that connect APIs, databases, platforms like Airtable and n8n/Make, and deploy automation services on AWS. What you’ll do Build and maintain...

  • Web Crawling Specialist

    3 days ago

    bangalore, India beBeeWebCrawler Full time

    Job Opportunity: Web Crawling SpecialistWe are seeking an experienced Web Crawling Specialist to join our team and contribute to the development of innovative web crawling solutions.The ideal candidate will have strong expertise in Python programming, particularly in web scraping frameworks such as Scrapy. Experience with browser automation tools like...