Python Web Scraping Developer

7 days ago


India Petras Solutions Private Limited Full time

About the Job : In full growth, particularly internationally, we are looking for new collaborators to join our fabulous team A young but experienced, dynamic and complementary team: a resolutely start-up spirit Real job and career opportunities A friendly atmosphere and a climate of trust that promotes autonomy and challenge" Responsibilities : - Responsible for the capture of massive data on the web and mobile terminals, and the design of architectures such as extraction, deduplication, classification, clustering, and filtering - Responsible for the design and development of distributed web crawlers, able to independently solve various problems encountered in the actual development process - Responsible for the research and development of web page information extraction technology algorithms to improve the efficiency and quality of data capture - Responsible for the analysis and warehousing of crawled data, monitoring of the crawler system and abnormal alarms - Responsible for designing and developing data collection strategies and anti-shielding rules to improve the efficiency and quality of data collection; - Responsible for the design and development of core algorithms according to the system data processing flow and business function requirements; Qualifications : Must Haves : - Proficient in Python language, familiar with one or more of the commonly used crawler frameworks, such as Scrapy framework or other Web scraping frameworks, with independent development experience. - Have 4-15 years of experience - Familiar with vertical search crawlers and distributed web crawlers, deeply understand the principles of web crawlers, have rich experience in data crawling, parsing, cleaning, and storage related projects, and master anti-crawler technology and breakthrough solutions. - Master the basic operation of linux, - Experience in distributed crawler architecture design, IP farms and proxy is preferred. - A solid foundation in data structure and algorithms is preferred. Good to have: - Familiar with common data storage and various data processing technologies are preferred. - Familiar with commonly used frameworks such as ssh, multi-threading, network communication programming related knowledge. - Familiar with at least one RDBMS and non-structure DB technologies. - Hands-on experience for crawling any eCommerce platform is a big plus. - Additional Information - Enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms. - Recharge and revitalize with help of wellness plans made for you and your family. - Plan your future with financial wellness tools. - Stay relevant and upskill yourself with career development opportunities. Our Benefits - Flexible working environment - Volunteer time off - LinkedIn Learning - Employee-Assistance-Program (EAP) (ref:hirist.tech)



  • India Forage AI Full time

    We are seeking a talented Python Web Scraping Developer to join our team at Forage AI. As a Python Web Scraping Developer, you will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.You will develop and refine crawlers using Python-based tools and frameworks such as Scrapy, and...


  • India MrScraper Full time

    Job Overview: We are seeking a skilled Web Scraping Engineer to help us extract, process, and analyze large-scale data from the web. This role involves developing efficient, scalable, and resilient scraping solutions to gather structured and unstructured data from diverse online sources. Key Responsibilities: Design, build, and maintain web scraping scripts,...


  • India MrScraper Full time

    Job Overview:We're looking for a Web Scraping Engineer to join our team and help us extract, process, and analyze large-scale data from the web. You'll be responsible for developing efficient, scalable, and resilient scraping solutions to gather structured and unstructured data from diverse online sources. If you thrive on solving complex problems, working...

  • Data Scientist

    4 days ago


    India Adglobal360 Full time

    We are seeking a highly skilled Data Scientist to join our team as a Web Scraping Specialist. In this role, you will be responsible for designing and developing robust web scraping solutions using Python and related libraries.">The ideal candidate will have strong expertise in web scraping and data extraction using Python, proficiency in web scraping...


  • Anywhere in India/Multiple Locations ALTERNATIVE PATH PRIVATE LIMITED Full time

    Company Overview">The Web Scraping Team at Alternative Path Private Limited is a dynamic and innovative group focused on delivering high-quality proprietary datasets, timely notifications, and exceptional service to support clients' daily investment decisions.Job DescriptionWe are seeking a creative and detail-oriented developer to contribute to client...

  • Web Scraping Expert

    5 days ago


    India YipitData Full time

    Crafting Resilient Web ScrapersYipitData is seeking a skilled Web Scraping Expert to join our Data Solutions team. In this transformative role, you will design, refactor, and maintain web scrapers that drive critical reports across our organization, ensuring data ingestion processes are resilient, efficient, and scalable.About the JobCollaborate with...

  • Web Scraping Expert

    7 days ago


    India brightedge Full time

    Data Engineer Job DescriptionThe successful candidate will be responsible for developing and maintaining data collection pipelines to efficiently ingest and store structured and unstructured data. They will also implement web scraping techniques and APIs for real-time and batch data retrieval. Additionally, they will optimize data storage and query...


  • India brightedge Full time

    We are seeking a Backend Engineer to design, implement, and optimize data collection, storage, and processing pipelines. The ideal candidate will have expertise in handling structured and unstructured data, optimizing query performance, and ensuring efficient data retrieval. This role involves working with APIs, cloud logging, data streaming, and anomaly...

  • Python Developer

    4 days ago


    India Adglobal360 Full time

    As a Python Developer, you will play a key role in designing and developing robust web scraping solutions using Python and related libraries. You will be responsible for ensuring data accuracy and consistency through thorough validation and cleaning, implementing and maintaining web crawling and data extraction pipelines, and writing clean, efficient, and...


  • India Angel & Genie Full time

    Job DescriptionJob Summary:We are seeking a skilled Web Scraping Developer to design and develop scalable and efficient web scraping applications to extract data from various websites. The ideal candidate should be proficient in PHP/Python, web scraping frameworks (Scrapy, Beautiful Soup), MySQL, HTML/CSS and Javascript. This role requires strong analytical...


  • India Forage AI Full time

    We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Key...


  • India Hexaware Technologies Ltd. Full time

    **About Hexaware Technologies Ltd.**We are a leading technology company seeking an experienced Python AI Software Developer to join our team.The ideal candidate will have strong background in Generative AI (GenAI) and hands-on experience with LLM's.This role involves developing and maintaining Python-based applications focused on GenAI, working closely with...

  • Web Data Analyst

    3 days ago


    India MrScraper Full time

    Job OverviewWe are seeking a highly skilled Web Data Analyst to join our innovative team at MrScraper. As a key member of our data extraction team, you will play a crucial role in helping us extract, process, and analyze large-scale data from the web.ResponsibilitiesDesign, build, and maintain web scraping scripts, bots, and crawlers to collect data from...

  • Senior Developer

    4 days ago


    India Adglobal360 Full time

    Company: AGL - Hakuhodo Location: Gurugram, Haryana, India Job Title: Python Senior Developer Experience: 5 Years Role/Profile: Python Senior Developer About AGL - Hakuhodo: AGL - Hakuhodo is a dynamic and innovative company specializing in (Insert brief description of AGL - Hakuhodo's industry/services, e.g., digital marketing, data analytics, etc.). We are...


  • India Adglobal360 Full time

    We are seeking an experienced Senior Software Engineer to join our team as a Web Crawling Expert. In this role, you will be responsible for designing and developing robust web crawling solutions using Python and related libraries.">The ideal candidate will have strong expertise in web scraping and data extraction using Python, proficiency in web scraping...


  • India Forage AI Full time

    Forage AI is seeking a skilled Web Crawling Specialist to join our remote team. As a Web Crawling Specialist, you will play a crucial role in developing and refining crawlers using Python-based tools and frameworks. This involves building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.To excel in this role,...


  • India hotsourced Full time

    Job DescriptionSummaryWere a fully female-founded company on a mission to change the way people search and shop online for fashionforever Were going to spark a new era of fashion discovery, igniting confidence in everybody and every body, and to create a world where fashion confidence starts with us.We are at the beginning of an exciting journey and were...


  • India Direct Resource Solutions Full time

    Job Title: Python Django DeveloperDuration Full TimeLocation: RemoteJob Summary:We are looking for an experienced Python Django Developer with 7+ years of relevant experience to joinour engineering team. You will be responsible for designing, developing, and maintaining robust,scalable applications. The ideal candidate will have a strong foundation in...


  • India Recro Full time

    Job DescriptionResponsibilities:- Design, build, and optimize scalable backend systems for large data processing.- Work with Python and FastAPI to build services and applications.- Develop systems to manage large-scale datasets, including web scraping and data wrangling.- Utilize PostgreSQL for managing relational data, and GCP/AWS for cloud storage and...


  • India Recro Full time

    Responsibilities:Design, build, and optimize scalable backend systems for large data processing.Work with Python and FastAPI to build services and applications.Develop systems to manage large-scale datasets, including web scraping and data wrangling.Utilize PostgreSQL for managing relational data, and GCP/AWS for cloud storage and computing.Collaborate with...