Python Developer – Web Scraping

3 days ago

bangalore, India AIMLEAP Full time

Python Developer – Web Scraping & Automation (WFH)   Experience:  3-5 Years  Location:  Remote  Mode of Engagement:  Full-time  No of Positions:  3  Educational Qualifications:  Bachelor’s degree in Computer Science / Information Technology  Industry:  IT / Software Development  Notice Period:  Immediate Joiners Preferred  What We Are Looking For:   Strong hands-on experience in Python  for large-scale web scraping and automation.  Expert in web scraping using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.   Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.  Experience in backend/API development using FastAPI, Django, or Flask .  Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.  Strong debugging, error-handling, and optimization skills.  Ability to independently deliver reliable and scalable data extraction solutions.  Key Responsibilities:   Develop, optimize, and maintain web scraping scripts and automation pipelines  in Python.  Extract data from static, dynamic, and JavaScript-heavy websites using browser automation.  Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges.  Build and maintain REST APIs  to support data access and processing.  Implement end-to-end pipelines for data cleaning, transformation, and storage  (CSV, JSON, DB).  Work with SQL/NoSQL databases  to store and manage scraped datasets.  Use Docker  for containerization and deploy scraping tools to cloud environments.  Troubleshoot scraping failures, automate recovery, and ensure high data accuracy.  Maintain logs, monitoring, and documentation for scraping workflows.  Qualifications:   Strong programming experience in Python .  Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests .  Understanding HTTP, APIs, headers, cookies, sessions, and web protocols.  Experience with backend frameworks: FastAPI / Django / Flask .  Experience working with Docker  and basic CI/CD workflows is good to have .  Knowledge of relational and non-relational databases.  Strong debugging, optimization, and troubleshooting abilities. 

  • Python Developer – Web Scraping

    4 days ago

    bangalore, India AIMLEAP Full time

    Python Developer – Web Scraping & Automation (WFH) Experience: 3-5 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3 Educational Qualifications: Bachelor’s degree in Computer Science / Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred  What We Are Looking...

  • Python Developer

    2 days ago

    bangalore, India AIMLEAP Full time

    Python Developer – Web Scraping & Automation (WFH)   Experience:  3-5 Years  Location:  Remote  Mode of Engagement:  Full-time  No of Positions:  3  Educational Qualifications:  Bachelor’s degree in Computer Science / Information Technology  Industry:  IT / Software Development  Notice Period:  Immediate Joiners Preferred   What We Are...

  • Web Scraping Specialist

    6 days ago

    Bangalore, Karnataka, India Hypersonix Full time

    Position Overview We are seeking a highly skilled Web Scraping Architect to join our team The successful candidate will be responsible for designing implementing and maintaining web scraping processes to gather data from various online sources efficiently and accurately As a Web Scraping Specialist you will play a crucial role in collecting data for...

  • Python Automation and Web Scraping Specialist

    11 hours ago

    Bangalore Division, India Foresiet Full time

    Company Description Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research...

  • Data Engineer

    6 days ago

    bangalore, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Data Engineer

    9 hours ago

    bangalore, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • AI Web Scraping Engineer

    1 week ago

    bangalore, India S2T AI - AI-Powered Investigations Full time

    We're seeking a forward-thinking Web Scraping Engineer who leverages AI tools to accelerate development and streamline data extraction processes. Join our India team and work at the intersection of traditional scraping expertise and cutting-edge AI-powered development.The Role:Design and implement scalable data extraction solutions using AI to rapidly...

  • Senior Associate- Web Scrapping

    2 weeks ago

    bangalore, India Acuity Knowledge Partners Full time

    Job Responsibilities: Develop and maintain web scraping scripts using Javascript, Python and Selenium to extract data from websites and APIs Understanding requirement of customer needs, identify source and scrape/collect data. Writing efficient, reusable, testable, and testing scalable code. Build code that is easily readable, properly documented, and...

  • Web Developers Wanted! Remote Working

    5 days ago

    Bangalore, India Foresiet Full time

    Company Description Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research...

  • Web Crawling Engineer

    1 week ago

    bangalore, India Forage AI Full time

    We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Salary budget...