Python Web Scraping – Automation

1 day ago

Remote, India FullStackTechies Full time ₹ 43,20,000 - ₹ 72,00,000 per year

Python Web Scraping Engineer – Advanced Automation (WFH)

Experience: 3–10 Years

Location: Remote

Mode of Engagement: Full-time

No of Positions: 8

Educational Qualification: Bachelor's degree in Computer Science, IT, or related field

Industry: IT / Software Services / Data & AI

Notice Period: Immediate Joiners Preferred

What We Are Looking For

  • Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
  • Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems.
  • Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
  • Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
  • Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.

Responsibilities

  • Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
  • Implement browser automation solutions with Playwright/Selenium/Puppeteer for complex user flows and asynchronous rendering.
  • Integrate CAPTCHA-solving services, proxy rotation systems, and advanced anti-detection mechanisms.
  • Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
  • Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.

Qualifications

  • 3–10 years of experience in Python-based web scraping and automation.
  • Strong experience in Selenium, Playwright, Puppeteer, and browser automation.
  • Fluent in Python with experience using Requests, BeautifulSoup, Async frameworks, or Scrapy.
  • Hands-on experience with proxy networks, fingerprinting, session handling, and anti-bot strategies.
  • Understanding of SQL/NoSQL databases for structured data storage.
  • Experience working with AWS/GCP/Azure is a plus.
  • Strong debugging, analytical, and problem-solving skills.

Job Type: Full-time

Pay: ₹30, ₹60,000.00 per month

Benefits:

  • Health insurance
  • Provident Fund
  • Work from home

Application Question(s):

  • Years of experience scraping JavaScript-heavy websites using Selenium, Playwright, or Puppeteer?
  • Experience with proxy rotation, fingerprinting, and anti-bot bypass techniques in real scraping projects?
  • Experience in maintaining cookies, sessions, and local storage to handle authenticated scraping flows?
  • Years of experience in CAPTCHA-solving (AI-based or third-party) in your automation workflows?
  • Years of experience building scalable Python-based ETL/data pipelines for automated extraction and processing?
  • Notice period (days)
  • Current CTC (monthly)

Work Location: Remote

  • Python Trainer

    5 days ago

    Remote, India AIMLEAP Full time

    AIMLEAP is Hiring: **Python Trainer (Web Scraping Experience)** Experience: 3 to 7 Years Location: Bangalore (Work from Home) No of positions: 2 Industry: Automation/IT-Software Employment Type**:Full Time/Part Time/Consulting** Educational Qualification: B.Tech / B.E / MCA / BCA/MBA Salary/CTC: 4 lacs to 8 lacs INR per annum Notice Period: Immediate - 1...

  • Web Scraping Specialist

    4 days ago

    remote, India Hypersonix Full time

    Position Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Web Scraping Specialist

    3 days ago

    Remote, India Hypersonix Full time ₹ 1,00,000 - ₹ 20,00,000 per year

    Position Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Web Scraping Specialist

    3 days ago

    Remote, India Hypersonix Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Position Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Web Scraping-intern

    2 weeks ago

    Remote, India Mavenai Technologies Full time

    Requirements: Proficiency in programming languages such as Python or JavaScript Familiarity with web scraping frameworks and tools such as Scrapy, Beautiful Soup, or Selenium Understanding of HTML, CSS, and JavaScript Knowledge of data parsing and cleaning techniques Familiarity with database management systems such as MySQL or PostgreSQL Good communication...

  • Python Automation Intern

    3 days ago

    Remote, India S&M Consultant Full time ₹ 96,000 - ₹ 1,20,000 per year

    About the Internship:Sohman Trading is seeking a motivated Python Automation Intern to join our team and contribute to the development of SEO agents and automation tools. This is an excellent opportunity for students and recent graduates to gain hands-on experience in Python development, web automation, and API integration.Key Responsibilities:Develop and...

  • Python Developer

    3 days ago

    Remote, India STR Softwares Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Job OverviewWe are looking for a Python Developer with a strong background in backend development, microservices, automation, and modern API frameworks. The ideal candidate should be a fast learner with a solid understanding of complex systems.You will work on projects involving FastAPI, REST APIs, microservices, API integrations, and machine learning...

  • Data Engineering Manager – Web Crawling

    1 day ago

    Remote, India FullStackTechies Full time ₹ 10,000 - ₹ 20,00,000 per year

    Data Engineering Manager – Web Crawling & Pipeline ArchitectureExperience: 7 to 12 YearsLocation: Remote / BangaloreEngagement: Full-timePositions: 2Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / E-commerce / FinTech / HealthcareNotice Period: ImmediateWhat We Are Looking ForProven experience leading data...

  • Machine Learning Internship

    6 days ago

    Remote, India Topinvento Full time

    **Job Title**: Web Scraping Intern **Job Summary**: **Key Responsibilities**: - **Data Collection and Scraping**: - Identify target websites and scrape data using Python libraries (e.g., BeautifulSoup, Scrapy) or browser automation tools (e.g., Selenium, Puppeteer). - Handle dynamic websites, including those built with JavaScript frameworks (React,...

  • Data Pipelines Engineering Manager – Python

    1 week ago

    Remote, India FullStackTechies Full time ₹ 9,00,000 - ₹ 13,50,000 per year

    Data Systems Engineering Manager – PythonExperience: 7 to 12 YearsLocation: Remote (Work from Home) / Bangalore / IndiaMode of Engagement: Full-timeNo of Positions: 2Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: ImmediateWhat We Are Looking For:7–12...