Python Web Scraping Engineer – Automation

2 weeks ago

Tiruppur, India AIMLEAP Full time

Python Web Scraping Engineer – Advanced Automation (WFH) Experience: 3–10 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We Are Looking For Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer. Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems. Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions. Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits. Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage. Responsibilities Develop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright/Selenium/Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services, proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.  Qualifications 3–10 years of experience in Python-based web scraping and automation. Strong experience in Selenium, Playwright, Puppeteer, and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy. Hands-on experience with proxy networks, fingerprinting, session handling, and anti-bot strategies. Understanding of SQL/NoSQL databases for structured data storage. Experience working with AWS/GCP/Azure is a plus. Strong debugging, analytical, and problem-solving skills. 

  • Python Web Scraping Automation Specialist

    1 week ago

    tiruppur, India beBeeAutomation Full time

    Web Scraping Automation SpecialistWe are seeking an experienced Web Scraping Automation Specialist to join our team. In this role, you will be responsible for designing and implementing high-scale automated scraping workflows for dynamic and protected websites.Key Responsibilities:Develop and maintain high-scale automated scraping workflows for dynamic and...

  • Data engineer

    2 weeks ago

    Tiruppur, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Web Crawler Specialist

    1 week ago

    tiruppur, India beBeeCrawler Full time

    Web Crawler SpecialistWe are seeking a Web Crawler Specialist to build and maintain web crawlers, extract valuable insights from the web, and ensure data quality.The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.

  • Senior Web Data Specialist

    1 week ago

    tiruppur, India beBeeData Full time

    Job OverviewWe are seeking a skilled professional to collaborate with our team in shaping and innovating new products and features.Key ResponsibilitiesUtilize various web scraping techniques to extract data and then apply Python's Pandas library for data cleaning and manipulation.Integrate scraped data into a database or warehouse, and schedule scrapers...

  • Web Information Extractor

    24 hours ago

    tiruppur, India beBeeWebInformationExtractor Full time

    Job Title: Web Information ExtractorWe are seeking a highly skilled professional to lead our web data extraction efforts. As a Web Information Extractor, you will be responsible for developing and maintaining sophisticated crawlers that efficiently extract valuable insights from the web.Maintain and enhance existing web scraping and data crawling projects...

  • Data Extraction Specialist

    1 day ago

    tiruppur, India beBeeAutomation Full time

    Job Title: Data Extraction SpecialistAs a data extraction specialist, you will be responsible for developing and maintaining large-scale automated web scraping workflows. This involves creating complex browser automation solutions using tools such as Selenium, Playwright, or Puppeteer to extract data from dynamic and protected websites.Develop sophisticated...

  • Senior Data Engineer

    1 week ago

    tiruppur, India beBeeDataEngineering Full time

    Data Engineering Manager – Web CrawlingWe are seeking a seasoned Technical Lead to oversee the development and optimization of web crawling systems and pipeline architecture.Lead and mentor data engineering teams to ensure high-quality delivery and adherence to best practices.Architect, implement and optimize scalable data pipelines that support...

  • Python Automation Test Engineer

    4 weeks ago

    Tiruppur, India Whatjobs IN C2 Full time

    Role: Python Automation Test Engineer - Pytest Experience: 4+ years Location: PAN India Immediate Joiners Only Job Description - Strong Python programming skills with hands-on experience in automation scripting. - Expertise in Pytest and Robot Framework. - Solid experience with Selenium WebDriver for web testing and Appium for mobile automation...

  • Senior Web Scraping Developer

    7 days ago

    tiruppur, India beBeeData Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining web scrapers for alternative datasets.You will work collaboratively with analysts to understand and anticipate requirements, and contribute to the development of proprietary datasets, timely...

  • Founding Software Engineer

    1 week ago

    tiruppur, India beBeeSoftware Full time

    Job Title: Backend Software EngineerJob Description:We are seeking an experienced software engineer to join our team as a founding member responsible for architecting the core system of our AI-based decision engine.The chosen candidate will be responsible for designing and implementing the context layer, which serves as the sensory system that determines how...