Python developer – web scraping

3 days ago

Pune, India AIMLEAP Full time

Python Developer – Web Scraping & Automation (WFH)   Experience:  3-5 Years  Location:  Remote  Mode of Engagement:  Full-time  No of Positions:  3  Educational Qualifications:  Bachelor’s degree in Computer Science / Information Technology  Industry:  IT / Software Development  Notice Period:  Immediate Joiners Preferred    What We Are Looking For:   Strong hands-on experience in Python  for large-scale web scraping and automation.  Expert in web scraping using Scrapy, Beautiful Soup, Selenium, Playwright, and Requests.   Excellent understanding of HTML, CSS, DOM structure , and browser-rendered content.  Experience in backend/API development using Fast API, Django, or Flask .  Ability to handle proxies, user-agent rotation, cookies, sessions, and anti-bot mechanisms.  Strong debugging, error-handling, and optimization skills.  Ability to independently deliver reliable and scalable data extraction solutions.    Key Responsibilities:   Develop, optimize, and maintain web scraping scripts and automation pipelines  in Python.  Extract data from static, dynamic, and Java Script-heavy websites using browser automation.  Manage pagination, authentication of workflows, cookies, sessions , and rendering challenges.  Build and maintain REST APIs  to support data access and processing.  Implement end-to-end pipelines for data cleaning, transformation, and storage  (CSV, JSON, DB).  Work with SQL/No SQL databases  to store and manage scraped datasets.  Use Docker  for containerization and deploy scraping tools to cloud environments.  Troubleshoot scraping failures, automate recovery, and ensure high data accuracy.  Maintain logs, monitoring, and documentation for scraping workflows.    Qualifications:   Strong programming experience in Python .  Proficiency with Scrapy, Beautiful Soup, Selenium, Playwright, and Requests .  Understanding HTTP, APIs, headers, cookies, sessions, and web protocols.  Experience with backend frameworks: Fast API / Django / Flask .  Experience working with Docker  and basic CI/CD workflows is good to have .  Knowledge of relational and non-relational databases.  Strong debugging, optimization, and troubleshooting abilities. 

  • Software Engineer-Python Web scraping

    3 days ago

    Pune, India NielsenIQ Full time

    Company Description Job Description Python Web Scraping EngineerChennai/Pune About the Job NIQ Digital Shelf is one of Europe’s fastest-growing companies in the Retail Analytics space. Every day, we collect and process over 60 billion data points from web and mobile sources to power real-time market insights. Our tools help major brands and retailers...

  • Software Engineer-Python Web scraping

    1 week ago

    Pune/Pimpri-Chinchwad Area, India NielsenIQ Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionJob Description**Python Web Scraping EngineerChennai/PuneAbout The Job**NIQ Digital Shelf is one of Europe's fastest-growing companies in the Retail Analytics space. Every day, we collect and process over 60 billion data points from web and mobile sources to power real-time market insights. Our tools help major brands and retailers...

  • Python Developer

    1 week ago

    Pune, India Talent Corner Full time

    Roles and Responsibilities 2 years of Python web scraping expProficiency on the Linux platformEnhance existing data extraction, web scraping tools Python scripts for regular data updates code versioning tool particularly Git Desired Candidate Profile Familiarity with libraries such as Scrapy, Selenium, Playwright, Requests, and Beautifulsoup

  • Python Developer

    2 weeks ago

    Chandigarh Mumbai Pune, India Stalwart Management Consulting Full time ₹ 12,00,000 - ₹ 15,00,000 per year

    Job Description:Minimum Experience :- 4-5 years (not less than that)Notice period :- Max days or lessCTC : LpaLocation :- Mumbai, Pune, ChandigarhWe can categorize as per below-Scripting & Scrapping / Crawling Skills: 5Non Scraping : 5Python + Django+ Flask (Front end developers): 2Python Application Developer : 3Candidate should willing to learn if he...

  • Web Scraper Developer

    5 days ago

    Pune, India HEROIC.com Full time

    Job Description About the Job: HEROIC Cybersecurity ( HEROIC.com ) is seeking a Web Scraper Developer with deep expertise in building scalable, automated web data collection systems to power our AI-driven cybersecurity intelligence platforms. You will be responsible for developing, deploying, and maintaining high-performance web crawlers and data extraction...

  • Web Scraper Developer

    5 days ago

    Pune, India HEROIC.com Full time

    About the Job: HEROIC Cybersecurity ( HEROIC ) is seeking a Web Scraper Developer with deep expertise in building scalable, automated web data collection systems to power our AI-driven cybersecurity intelligence platforms. You will be responsible for developing, deploying, and maintaining high-performance web crawlers and data extraction pipelines that...

  • Web Scraper Developer

    1 week ago

    Pune, Maharashtra, India HEROIC Cybersecurity Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Job:HEROIC Cybersecurity ( ) is seeking a Web Scraper Developer with deep expertise in building scalable, automated web data collection systems to power our AI-driven cybersecurity intelligence platforms.You will be responsible for developing, deploying, and maintaining high-performance web crawlers and data extraction pipelines that source threat...

  • Python Web Developer- Banking

    2 weeks ago

    Pune, Maharashtra, India Tietoevry Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionWe are looking for a talented developer with strong experience in Python web development or Oracle PL/SQL — expertise in either skill is a must, and candidates proficient in both will be preferred. The role involves designing, developing, and maintaining scalable web-based applications with a focus on backend logic, performance, and database...

  • Python Web Developer- Banking

    2 weeks ago

    Pune, Maharashtra, India Tietoevry Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description We are looking for a talented developer with strong experience in Python web development or Oracle PL/SQL — expertise in either skill is a must, and candidates proficient in both will be preferred. The role involves designing, developing, and maintaining scalable web-based applications with a focus on backend logic, performance, and...

  • NodeJS Developer

    2 weeks ago

    Pune, Maharashtra, India VRLab Technologies Pvt Ltd. Full time ₹ 2,50,000 - ₹ 7,50,000 per year

    We are looking for a Developer responsible for managing the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for...