Netscribes - Web Scraping API Developer - Python

1 week ago

Bengaluru, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

Job Description :


Key Responsibilities :


- Web Scraping & Data Ingestion : Design, build, and maintain sophisticated web scraping applications to ingest competitor data from diverse online retail platforms.


- API Development : Develop scalable RESTful APIs in Python (FastAPI / Flask / Django) to serve extracted data for downstream consumption by internal and external systems.


- Deployment & Orchestration : Containerize and deploy API services using Docker and orchestrate deployments via Azure DevOps / GitHub Actions.


- Azure Cloud Utilization : Leverage a wide array of Azure services including Azure Functions, Azure App Services, Azure Data Lake, Azure Key Vault, and Azure Monitor / Application Insights for end-to-end deployment, monitoring, and observability.


- Robust Pipeline Development : Implement comprehensive logging, exception handling, and retry mechanisms to build highly robust and fault-tolerant scraping and ingestion pipelines.


- Tooling & Libraries : Integrate and utilize open-source libraries such as BeautifulSoup, Scrapy, Playwright, Puppeteer, and Selenium for scalable and efficient web data extraction.


- Data Collaboration : Collaborate closely with Data Scientists and Analysts to ensure the scraped data is queryable, usable, and valuable for analytics.


- Monitoring & Dashboards : Build dashboards or simple frontends (if needed) to effectively monitor scraping coverage, API health, and overall system performance.


- Development Practices : Adhere to best practices for Git-based version control, work within agile methodologies using tools like JIRA/Confluence, and actively participate in code reviews and CI/CD cycles.


Required Skills & Qualifications :


Programming and APIs :


- Strong proficiency in Python (3.x) with significant production experience.


- Proven expertise in REST API development using frameworks like FastAPI, Flask, or Django REST Framework.


- Extensive experience with Web Scraping tools such as BeautifulSoup, Scrapy, Playwright/Selenium.


- Solid understanding of JSON handling, data transformation, and robust exception management.

(ref:hirist.tech)

  • Python API Developer

    3 weeks ago

    Bengaluru, Karnataka, India Akira Consultancy Pvt. Ltd. Full time

    About the Role :We are seeking a highly skilled Web Scraping & Python API Developer to build and maintain scalable data extraction systems from various websites and APIs. The ideal candidate has hands-on experience with web scraping frameworks, RESTful API development, and data integration techniques.Responsibilities :- Design and develop robust, scalable...

  • Netscribes - Data Engineer - Python/Java

    16 hours ago

    Bengaluru, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    About Netscribes :Netscribes is a global market intelligence and content services provider that helps corporations achieve strategic objectives through a wide range of offerings. Our solutions rely on a unique combination of qualitative and quantitative primary research, secondary/desk research, social media analytics, and IP research. For more than 15...

  • Gmware - Web Scraping Developer

    1 week ago

    Bengaluru, India GM WARE Full time

    Job Description :Web Scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated knowledge experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines.Roles and Responsibilities :- Develop and maintain service that extracts websites...

  • Web Scraping Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Hypersonix Full time

    Position Overview We are seeking a highly skilled Web Scraping Architect to join our team The successful candidate will be responsible for designing implementing and maintaining web scraping processes to gather data from various online sources efficiently and accurately As a Web Scraping Specialist you will play a crucial role in collecting data for...

  • Web Scraping Developer

    6 days ago

    Bengaluru, India Gmware Full time

    We are hiring a Python Developer (0.52 yrs) for web scraping. Responsibilities: build & optimize scrapers, handle dynamic sites, proxies & CAPTCHAs, ensure data accuracy. Skills: Python, Scrapy, BeautifulSoup, Selenium, regex, debugging. Provident fundHealth insurance

  • Web Scraping Specialist

    4 days ago

    Bengaluru, Karnataka, India Hypersonix Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position Overview:We are seeking a highly skilled Web Scraping Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining web scraping processes to gather data from various online sources efficiently and accurately. As a Web Scraping Specialist, you will play a crucial role in collecting data for...

  • Web Scraping Expert

    2 weeks ago

    Bengaluru, India FullStackTechies Full time

    AIMLEAP is Hiring: **Web Scraping Expert - Python Trainer** Experience: 3 to 7 Years Location: Bangalore (Work from Home) No of positions: 2 Work Timing**:8:30AM to 1:00 PM** Industry: Automation/IT-Software Employment Type**:Full Time/Part Time/Consulting** Educational Qualification: B.Tech / B.E / MCA / BCA/MBA Salary/CTC: 4 lacs to 8 lacs INR per...

  • Data Engineer

    1 week ago

    Bengaluru, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Python Web Scraping Scrapy Selenium Xpath Beautiful

    2 weeks ago

    Bengaluru, India Acesoft Labs Full time

    **JOB DESCRIPTION** PYTHON SCRPY DEVELOPER SKILLS:PYTHON,WEB SCRAPING Using Scrapy or Xpath or Beautiful soup Implement features and support Job Ingestion (Python, Scrapy, Xpaths). Troubleshoot and debug issues on Linux based systems. Communicate and work with Customer Service teams and other stakeholders. Have the capacity to onboard new hires and...

  • Senior Web Data Extraction Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataMining Full time ₹ 9,00,000 - ₹ 18,00,000

    Data Mining AnalystPosition: Data Mining AnalystThis role entails leveraging web scraping and data extraction expertise to drive business insights. We are seeking a skilled professional with expertise in automating data extraction processes from web platforms, utilizing tools like Python, Selenium, Pandas, SQL, and APIs.The ideal candidate will have the...