Senior Web Scraping Engineer

4 weeks ago


Alappuzha, India Zomunk Full time

About usWe're building a product that relies heavily on collecting structured data from a number of known websites. We need someone experienced who can own this part of the system end-to-end; from writing scrapers to making sure they scale and stay reliable.This is a senior role. We're looking for someone who has already dealt with the real-world problems of web scraping and can work independently.What you'll doBuild and maintain scrapers for 24-30 websites (starting with 6).Handle authenticated sites, sessions, cookies, tokens, etc.Work with search endpoints and dynamic content.Architect the data ingestion pipeline, caching, retries, and queues.Make the scrapers stable and resilient even as websites change.Collaborate closely with our backend team to define and use APIs.Handle scaling, rate limits, and performance.What we're looking for (hard requirements)5 - 7+ years of building production-grade web scrapersStrong experience with both API-based scraping and browser automation (Playwright/Puppeteer)Familiarity with proxies/IP rotation and basic anti-bot handlingComfortable with auth flows (cookies, sessions, tokens)Ability to design pipelines: ingestion → clean → store → cacheCan work independently and own the scraper system end-to-endNice to have (not required)Familiarity with Cloudflare's ecosystem.Python, Node.js (TypeScipt only), or Go; any backend language is fine, TypeScript is preferred.Who will do well hereYou enjoy scrapers that work reliably, and predictably.You think in terms of systems, not quick patches.You can work remotely and manage your own time.You appreciate straightforward communication and minimal bureaucracy.CompensationBase: ₹3,00,000 - 4,00,000 per month (36 - 48 LPA). Equity/options are available if you choose to take a lower cash component.



  • alappuzha, India beBeeWebScraping Full time

    We are seeking a highly skilled Python Web Scraping Specialist to join our team. The ideal candidate will have extensive experience in web scraping and automation, with a strong focus on designing scalable data pipelines.This role requires a deep understanding of Python-based web scraping and automation, as well as expertise in tools such as Selenium,...

  • Senior Data Extractor

    2 weeks ago


    alappuzha, India beBeeWebCrawlingEngineer Full time

    We are seeking a Web Crawling Engineer to join our team in building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.Key Responsibilities:Maintain and enhance existing web scraping projects using Python-based tools and frameworks.Develop and refine crawlers to handle dynamic content and optimize crawling...


  • alappuzha, India beBeeMachineLearning Full time

    Automated Workflow DeveloperAs an Automated Workflow Developer, you will play a pivotal role in crafting robust automated workflows to collect and manage conference and healthcare-related data. Utilizing Python and other tools, you will analyze large datasets to contribute to AI/ML-driven solutions.Working closely with your team, you will collaborate to...


  • alappuzha, India beBeeFrontend Full time

    We are seeking an accomplished Frontend Engineering leader to spearhead our Web Fabric initiative.Key responsibilities include defining the frontend architecture, leading a team of engineers and managers in delivering high-velocity React/Next.js applications, and establishing best practices for CI/CD, testing, observability, and release automation.The ideal...


  • alappuzha, India beBeeWeb Full time

    Senior Web Development SpecialistWe are seeking an exceptional web development specialist to join our team. This individual will be responsible for creating and maintaining stunning websites using Webflow, collaborating with designers and content creators, and implementing responsive, accessible, and performance-friendly layouts.Key Responsibilities:Create,...


  • alappuzha, India beBeeWebDeveloper Full time

    Our ideal candidate is a skilled Senior Web Developer with expertise in WordPress and Magento platforms.As a senior team member, you will work on a range of WordPress websites, utilizing Elementor to develop, maintain, and optimize the sites.You will also support our existing Magento store by enhancing its functionality, troubleshooting technical issues...


  • alappuzha, India beBeeSoftware Full time

    Job OverviewHyly.AI's multifaceted intelligence fabric seamlessly integrates artificial, business, and human intelligence to drive growth.As a key member of our engineering team, you will lead the development of our web-based products, focusing on scalable architecture, low-latency user experiences, and high-quality UX.Key responsibilities include defining...


  • alappuzha, India beBeeDataEngineer Full time

    Job OpportunityWe are seeking a skilled professional to collaborate on client projects. In this role, you will work independently with support from experienced team members.Role OverviewExtract data from various sources using web scraping techniques and then utilize Python's Pandas library for data cleaning and manipulation.Integrate data into a...


  • alappuzha, India beBeeSystems Full time

    Backend Systems ArchitectWe are seeking a skilled Backend Engineer to design and develop the core architecture of our AI system.The ideal candidate will be responsible for building high-throughput backend systems using Python, Go or Java.Standardize Data Schemas: Create and maintain standardized data models that normalize conflicting metrics across disparate...


  • alappuzha, India beBeeAutomation Full time

    Senior Software Development Engineer TestWe are seeking a seasoned software development engineer in test who can leverage their expertise in automating testing for web and API systems. The ideal candidate will have hands-on experience with Playwright, good debugging and problem-solving skills, and excellent communication abilities.This role requires...