Python Web Scraping Engineer – Automation

3 days ago

Aligarh, India AIMLEAP Full time

Python Web Scraping Engineer – Advanced Automation (WFH) Experience: 3–10 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We Are Looking For Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer. Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems. Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions. Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits. Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage. Responsibilities Develop and maintain high-scale automated scraping workflows for dynamic and protected websites. Implement browser automation solutions with Playwright/Selenium/Puppeteer for complex user flows and asynchronous rendering. Integrate CAPTCHA-solving services, proxy rotation systems, and advanced anti-detection mechanisms. Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling. Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.  Qualifications 3–10 years of experience in Python-based web scraping and automation. Strong experience in Selenium, Playwright, Puppeteer, and browser automation. Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy. Hands-on experience with proxy networks, fingerprinting, session handling, and anti-bot strategies. Understanding of SQL/NoSQL databases for structured data storage. Experience working with AWS/GCP/Azure is a plus. Strong debugging, analytical, and problem-solving skills. 

  • Ai web scraping engineer

    3 weeks ago

    Aligarh, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development. The Role: Design and implement scalable data extraction solutions using AI to rapidly...

  • Data Engineering Manager – Web Crawling

    3 days ago

    Aligarh, India AIMLEAP Full time

    Data Engineering Manager – Web Crawling & Pipeline Architecture Experience: 7 to 12 Years Location: Remote / Bangalore Engagement: Full-time Positions: 2 Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / E-commerce / FinTech / Healthcare Notice Period: Immediate  What We Are Looking For Proven...

  • Automation Engineer

    6 days ago

    Aligarh, India LTIMindtree Full time

    Years of Experience : 5-8 yearsLocation: Hyderabad\PunePrimary Skill : Automation+Python+Ansible+Docker+Kubernetes+Shell scriptingDevelop and maintain automation scripts and tools using Python and Shell scripting.Implement configuration management and infrastructure automation using Ansible.Design and manage containerized environments with Docker and...

  • Automation Engineer

    6 days ago

    Aligarh, India LTIMindtree Full time

    Years of Experience : 5-8 yearsLocation: Hyderabad\PunePrimary Skill : Automation+Python+Ansible+Docker+Kubernetes+Shell scriptingDevelop and maintain automation scripts and tools using Python and Shell scripting.Implement configuration management and infrastructure automation using Ansible.Design and manage containerized environments with Docker and...

  • SDET(Python Automation Testing)

    3 weeks ago

    Aligarh, India People Prime Worldwide Full time

    About Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and...

  • Cloud automation and test engineer

    2 weeks ago

    Aligarh, India Implere Technologies Pvt Ltd Full time

    Job Description: Cloud Automation & Test Engineer Role: Cloud Automation and Test Engineer Objective: Enhance the quality and reliability of the Hyper Compute Cluster Service (HCS) on Google Cloud by designing and implementing automation tests across APIs, end-to-end workflows, and critical user journeys. Key Responsibilities API Test Development Design and...

  • Automation test analyst

    4 weeks ago

    Aligarh, India SDLC Corp Full time

    Job Title: Automation Tester – Fintech Domain Experience Required: 3 Years Location: Sector 94, Noida Employment Type: Full-time (Immediate Joiner Preferred) Job Description: We are looking for an experienced Automation Tester with strong exposure to Fintech applications . The ideal candidate should have hands-on experience in automation frameworks, API...

  • Cypress Automation Tester

    3 weeks ago

    Aligarh, India Tata Consultancy Services Full time

    Hello, Greetings from TCS!TCS is hiring for Cypress Automation TesterDesired Experience Range: 6-8 YearsJob Location: BengaluruRequired Technical Skill Set :- Cypress Automation ToolGood to Have : SQL, Postman, SwaggerResponsibility of / Expectations from the RoleDevelop, execute, and maintain automated test scripts using Cypress to ensure the quality of web...

  • Automation QA Engineer

    17 hours ago

    Aligarh, India Luxoft Full time

    Project description We are seeking a skilled and motivated Automation QA Engineer to join our team. You will be working in a dynamic and fast paced, digital space, utilizing some of the latest technologies. Responsibilities - Design, build and maintain an test automation framework - Manage, monitor and improve the infrastructure - Develop custom tools and...

  • Automation Testing + Playwright

    3 weeks ago

    Aligarh, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Automation Testing + PlaywrightDesired Experience Range: 5 to 10 YearsJob Location: Chennai / Mumbai / PuneMandatory skillsAutomation engineer with 3-6 years of working experience.Experience on test automation tools (Playwright, Protractor, Cucumber, Selenium)Hands on command with scripting language preferably JavaScript...