GMWARE - Python Developer - Web Scraping & Crawling

3 weeks ago


Bangalore, Karnataka, India GM WARE Full time

Job Description :

Python Lead Engineer - Web Scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.

Responsibilities :

- Develop and maintain service that extracts websites data using scrapers and APIs across multiple sophisticated websites

- Extract structured / unstructured data and manipulate data through text processing, image processing, regular expressions etc.

- Writing reusable, testable, and efficient code


- Responsible for extracting and ingesting data from websites using web crawling tools.

Requirements :

- Experience running large scale web scrapes

- Solid Python knowledge

- Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).

- Great communication skills (written and Spoken in English)

- Bachelor's Degree in Computer Science or a related field or the equivalent demonstrated experience

- 4+ years of work experience in Python based web scraping

- Sound understanding and knowledge of Python and good experience in any of the web crawling tools like requests, scrapy, BeautifulSoup, Selenium etc.

(ref:hirist.tech)

  • Bangalore, Karnataka, India GM WARE Full time

    Role : Python Engineer - Web Scraping & CrawlingPython Web scraping Engineer :- Web Scraping will be responsible for efficient web scraping/web crawling and parsing. - The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.Responsibilities :- Develop...


  • Bangalore, Karnataka, India GM WARE Full time

    Role : Python Engineer - Web Scraping & CrawlingPython Web scraping Engineer :- Web Scraping will be responsible for efficient web scraping/web crawling and parsing. - The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.Responsibilities :- Develop...


  • Bangalore, Karnataka, India GM WARE Full time

    Python Engineer - Web Scraping & Crawling Python Lead Engineer - Web Scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set : - Develop and maintain service that extracts websites...

  • AI Palette

    3 weeks ago


    Bangalore, Karnataka, India AI Palette Full time

    We are Ai Palette : We think the world would be a nicer place to be if Food Companies could create products that the consumers really want. So we are making it happen. We want to be the most preferred Food AI company in the world. We're making it possible by building an AI-powered SaaS platform based on our founders' experience in the Food Industry &...

  • AI Palette

    3 weeks ago


    Bangalore, Karnataka, India AI Palette Full time

    We are Ai Palette : We think the world would be a nicer place to be if Food Companies could create products that the consumers really want. So we are making it happen. We want to be the most preferred Food AI company in the world. We're making it possible by building an AI-powered SaaS platform based on our founders' experience in the Food Industry &...


  • Bangalore/Hyderabad, Karnataka, India Whizz HR Full time

    We are seeking a highly skilled and experienced Python Web Scraping Engineer with 4 to 6 years of experience to join our team. The ideal candidate will have a strong background in web scraping, data extraction, and automation using Python. As a Python Web Scraping Engineer, you will be responsible for developing and maintaining web scraping scripts,...


  • Bangalore/Hyderabad, Karnataka, India Whizz HR Full time

    We are seeking a highly skilled and experienced Python Web Scraping Engineer with 4 to 6 years of experience to join our team. The ideal candidate will have a strong background in web scraping, data extraction, and automation using Python. As a Python Web Scraping Engineer, you will be responsible for developing and maintaining web scraping scripts,...


  • Bangalore, Karnataka, India GM WARE Full time

    Python/Django DeveloperWe are seeking a highly skilled and experienced Django Developer to join our team , you will be responsible for leading and mentoring a team of developers, ensuring the successful delivery of projects, and maintaining a high level of code quality and best practices. Key Skills: Python, Django, Rest API, ORM, Django Rest Framework...


  • Bangalore, Karnataka, India MountTalent Consulting Full time

    Organization Overview:At Hoomanely, we are obsessed with Pet Health and Longevity.Our Vision: To build the world's only "Pet-first" smart ecosystem, including the right conscious products engineered to peak and sustain a pet's well-being and prosperityOur Mission: To transform knowledge systems around Pet Care Management and its conscious...

  • Lead Backend Developer

    2 months ago


    Bangalore, Karnataka, India MountTalent Consulting Full time

    Organization Overview:At Hoomanely, we are obsessed with Pet Health and Longevity.Our Vision: To build the world's only "Pet-first" smart ecosystem, including the right conscious products engineered to peak and sustain a pet's well-being and prosperityOur Mission: To transform knowledge systems around Pet Care Management and its conscious...

  • Backend Engineer

    3 weeks ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Skills : Hadoop, Java, Python, Scala, SqlRequirements :- 3-4+ yrs as a backend developer- Worked in a good startup or good engineering colleges- Working with an early-stage startup in a role that involves- Building scalable systems to extract information from 15Mn+ domains.- Being able to extract people information from these domains- Extracting...

  • Backend Engineer

    2 months ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Skills : Hadoop, Java, Python, Scala, SqlRequirements :- 3-4+ yrs as a backend developer- Worked in a good startup or good engineering colleges- Working with an early-stage startup in a role that involves- Building scalable systems to extract information from 15Mn+ domains.- Being able to extract people information from these domains- Extracting...


  • Bangalore, Karnataka, India KreditBee Full time

    Job Description :Key Responsibilities :- Develop the Policies & Next Gen. Rule Engine for Digital Lending- Develop various RestFul APIs & Integrate with various data sourcesJob Duties :- Develop the Policies & Next Gen. Rule Engine for Digital Lending- Develop various RestFul APIs & Integrate with various data sources- Develop tools & techniques related to...


  • Bangalore, Karnataka, India KreditBee Full time

    Job Description :Key Responsibilities :- Develop the Policies & Next Gen. Rule Engine for Digital Lending- Develop various RestFul APIs & Integrate with various data sourcesJob Duties :- Develop the Policies & Next Gen. Rule Engine for Digital Lending- Develop various RestFul APIs & Integrate with various data sources- Develop tools & techniques related to...

  • Python Developer

    1 month ago


    Bangalore/Hyderabad, Karnataka, India Innova ESI Full time

    Job Description:We are seeking a Python Developer for an on-site role in Hyderabad. The Python Developer will be responsible for handling day-to-day tasks related to back-end web development, software development, object-oriented programming (OOP), programming, and databases. Working closely with our team, the Python Developer will contribute to the design,...


  • Bangalore, Karnataka, India KreditBee Full time

    About :A highly motivated and passionate individual who has experience in executing end to end application deliveries; bringing them to production with high quality. Passionate about building flexible and scalable solutions with an eye for details and can weigh pros and cons to find the best possible solutions.As a Python Backend Developer, you should be...


  • Bangalore, Karnataka, India KreditBee Full time

    About :A highly motivated and passionate individual who has experience in executing end to end application deliveries; bringing them to production with high quality. Passionate about building flexible and scalable solutions with an eye for details and can weigh pros and cons to find the best possible solutions.As a Python Backend Developer, you should be...


  • Bangalore, Karnataka, India Sourcingxpress Full time

    Job Description: Web Automation Engineer. Position Overview: We are seeking a highly skilled and motivated Web Automation Engineer to join our dynamic team. The ideal candidate will have a strong background in web automation using Python, Selenium, and Pytest, along with experience in API automation using Rest Assured. As a Web Automation Engineer, you will...


  • Bangalore, Karnataka, India Edge.ai Full time

    Who we are?At Edge, we believe simplifying employee data will help large corporates solve sub-optimal talent management problems. This data is more critical after the pandemic, as managing a remote workforce has shifted from optional to essential.We have spent our last eight years understanding the workforce from the IT and BFSI industries. We haveused this...


  • Bangalore, Karnataka, India Edge.ai Full time

    Who we are ?At Edge, we believe simplifying employee data will help large corporates solve sub-optimal talent management problems. This data is more critical after the pandemic, as managing a remote workforce has shifted from optional to essential.We have spent our last eight years understanding the workforce from the IT and BFSI industries.We haveused this...