Web scraping engineer

3 weeks ago

Vijayawada, India Noon Full time

Job title: Web Scraping Engineer Location: Gurgaon About the Role We are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms . The ideal candidate will design and implement robust scrapers to collect, clean, and normalize product data (pricing, availability, reviews, images, etc.) that power our analytics and competitive pricing systems. What you'll do : Develop and maintain scalable scraping pipelines to extract structured data from complex, dynamic e-commerce sites. Design and manage distributed scraping infrastructure (e.g., rotating proxies, request throttling). Handle dynamic rendering, anti-bot measures, and API integrations where applicable. Implement data quality validation, normalization, and deduplication routines Optimize performance and reliability of scrapers with scheduling, retry logic, and monitoring Collaborate with data engineers and product teams to define data needs and integration workflows. Maintain compliance with relevant site terms of service, data usage policies, and legal constraints. What you'll need : 3+ years of professional experience in web scraping , data extraction , or automation. Strong Python skills with libraries such as Scrapy , Beautiful Soup , Requests , or aiohttp. Experience with proxy management and anti-bot evasion (e.g., rotating IPs, user agents, cookies, CAPTCHA handling). Solid understanding of HTML , Java Script , and network protocols (HTTP, REST) . Familiarity with GCP or AWS for deploying scalable scraping systems. Experience storing and processing data using My SQL , Elasticsearch , or S3. Experience scraping product pages (ASINs, listings, offers) and/or using Product Advertising API is strongly preferred . Experience with distributed scraping frameworks (e.g., Scrapyd, Airflow, Celery). Knowledge of data pipelines or ETL design. Experience with competitive pricing , catalog mapping , or e-commerce analytics. Familiarity with Docker and CI/CD tools. Who will excel? We’re looking for people with high standards who understand that hard work matters. You need to be relentlessly resourceful and operate with a deep bias for action. We need people with the courage to be fiercely original. noon is not for everyone; readiness to adapt, pivot, and learn is essential. If the above values resonate with you, then noon might be the place for you

  • Advanced Web Scraping Specialist

    2 weeks ago

    vijayawada, India beBeeAutomation Full time

    Web Scraping Engineer – Advanced Automation We are seeking an experienced Web Scraping Engineer to design and develop high-scale automated scraping workflows for dynamic and protected websites.The ideal candidate will have hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer, as well as expertise in...

  • Web Scraping Solutions Developer

    2 days ago

    vijayawada, India beBeeDataExtractor Full time

    Job DescriptionAs a seasoned expert in data extraction, this role involves designing and implementing high-scale automated scraping workflows for dynamic and protected websites.Key responsibilities include developing browser automation solutions with Playwright/Selenium/Puppeteer, integrating CAPTCHA-solving services, and building robust ETL-style data...

  • Python Web Scraping Engineer – Automation

    2 weeks ago

    vijayawada, India AIMLEAP Full time

    Python Web Scraping Engineer – Advanced Automation (WFH) Experience: 3–10 Years Location: Remote (Work from Home) Mode of Engagement: Full-time No of Positions: 8 Educational Qualification: Bachelor's degree in Computer Science, IT, or related field Industry: IT / Software Services / Data & AI Notice Period: Immediate Joiners Preferred What We...

  • Web Scraping Developer

    2 weeks ago

    vijayawada, India beBeeWebScraper Full time

    Job Description:We are seeking a skilled Web Scraping Developer to collaborate with our teams in innovating new products and features for the platform.This role involves working independently but collaboratively to design, implement, and maintain Web scrapers for alternative datasets. You will also perform data cleaning, exploration, and transformation of...

  • Senior Web Data Extraction Specialist

    2 days ago

    vijayawada, India beBeeData Full time

    As a web data extraction specialist, you will be responsible for designing and implementing efficient crawling strategies to extract valuable insights from the web.The ideal candidate will have strong programming skills in Python, experience with web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.You'll work on...

  • Software Development Professional

    1 day ago

    vijayawada, India beBeeData Full time

    Job DescriptionWe are seeking a skilled professional to collaborate on client projects with an asset management firm. In this role, you will work closely with individuals across various departments to develop and innovate new products and features for our platform, enhancing existing ones.You will have a high degree of independence and trust, but you won't...

  • Full stack engineer with ai/ml

    3 weeks ago

    Vijayawada, India People Prime Worldwide Full time

    About Company:- A leading global information technology, consulting, and business process services organization, the company delivers innovative solutions that enable clients across industries to thrive in the digital era. With a strong focus on technology-driven transformation, it helps enterprises harness the power of cloud, AI, automation, and analytics...

  • Software Engineer

    1 day ago

    Vijayawada, India Forage AI Full time

    Experience required: 2–4 years of professional software engineering experience.Budget for the role - Max Up to Rs. 15 LPA depending on your interview.100% remote OpportunityRole Overview:You will design, build, and operate software for data collection and processing at scale. The role is hands‑on, with emphasis on clean design, reliability, and...

  • Executive Data Strategist

    2 weeks ago

    vijayawada, India beBeeData Full time

    Senior Data AnalystWe are seeking a skilled Senior Data Analyst to join our team.The ideal candidate will have expertise in data wrangling, automation, and basic analysis using Python.Developing automated workflows to collect and manage conference and healthcare-related data.Using Excel for organizing and analyzing datasets.Collaborating with teammates to...

  • Web Developer Role

    7 days ago

    vijayawada, India beBeeFrontend Full time

    Job SummaryWe are seeking a highly skilled Frontend Engineer to join our team. The ideal candidate will have a strong background in web development, with expertise in designing and developing user-facing features.Key Responsibilities:Design, develop, and optimize user-facing featuresCollaborate with cross-functional teams to achieve project goalsMaintain...