Senior Web Scraping Engineer

2 weeks ago

Gandhinagar, India Whatjobs IN C2 Full time

About us We're building a product that relies heavily on collecting structured data from a number of known websites. We need someone experienced who can own this part of the system end-to-end; from writing scrapers to making sure they scale and stay reliable. This is a senior role. We're looking for someone who has already dealt with the real-world problems of web scraping and can work independently. What you'll do Build and maintain scrapers for 24-30 websites (starting with 6). Handle authenticated sites, sessions, cookies, tokens, etc. Work with search endpoints and dynamic content. Architect the data ingestion pipeline, caching, retries, and queues. Make the scrapers stable and resilient even as websites change. Collaborate closely with our backend team to define and use APIs. Handle scaling, rate limits, and performance. What we're looking for (hard requirements) 5 - 7+ years of building production-grade web scrapers Strong experience with both API-based scraping and browser automation (Playwright/Puppeteer) Familiarity with proxies/IP rotation and basic anti-bot handling Comfortable with auth flows (cookies, sessions, tokens) Ability to design pipelines: ingestion → clean → store → cache Can work independently and own the scraper system end-to-end Nice to have (not required) Familiarity with Cloudflare's ecosystem. Python, Node.Js (TypeScipt only), or Go; any backend language isfine, TypeScript is preferred. Who will do well here You enjoy scrapers that work reliably, and predictably. You think in terms of systems, not quick patches. You can work remotely and manage your own time. You appreciate straightforward communication and minimal bureaucracy. Compensation Base: ₹3,00,000 - 4,00,000 per month (36 - 48 LPA). Equity/options are available if you choose to take a lower cash component.

  • Web Scraping Specialist

    2 days ago

    Gandhinagar, India beBeeData Full time

    Web Scraping DeveloperThis is an exciting opportunity for a detail-oriented developer to join our team as a Web Scraping Developer.About the Role:The Web Scraping Team seeks a skilled developer who can contribute to client projects and deliver high-quality datasets, timely notifications, and exceptional service.Key Responsibilities:Collaborate with analysts...

  • Advanced Web Scraping Specialist

    4 days ago

    Gandhinagar, India beBeeAutomation Full time

    Job Title: Advanced Web Scraping SpecialistJob Description:We are seeking a seasoned web scraping expert to develop and maintain high-scale automated workflows for dynamic websites.As an advanced web scraping specialist, you will design scalable data pipelines to automate extraction, validation, transformation, and storage of complex data.Using your...

  • Senior Web Data Analyst

    4 days ago

    gandhinagar, India beBeeDataExtractor Full time

    Job OverviewWe are seeking a seasoned Web Information Extractor to spearhead the development and maintenance of web crawling technologies, driving innovation in data extraction and quality assurance.Maintain and enhance existing web scraping projects leveraging Python-based tools and frameworks to optimize performance.Design and refine crawlers using...

  • Senior Web Software Engineer

    4 days ago

    Gandhinagar, India beBeeLanguage Full time

    PHP Developer Intern Position OverviewAs a key member of our team, you will be responsible for writing clean and efficient code for web applications using PHP. You will also participate in testing processes and collaborate with senior developers to ensure the highest quality of work.Candidates should have a strong understanding of the PHP language and be...

  • Senior Full Stack Web Developer

    2 days ago

    Gandhinagar, India beBeeFullStack Full time

    Job Title: Senior Full Stack Web DeveloperAre you an expert in both frontend and backend development? Do you want to lead the charge on delivering high-quality, scalable web applications?We are seeking a seasoned Angular Frontend + .NET Backend developer to join our team as a senior full stack web developer.Design, develop, and deliver end-to-end enterprise...

  • Web Platform Engineer

    4 days ago

    Gandhinagar, India beBeeWebEngineer Full time

    Job OverviewWe're seeking a skilled engineer to build and scale our web platform.Key Responsibilities:Design and implement robust WordPress websites and web applications.Develop new features, functionalities, and improvements for our online presence.Collaborate with cross-functional teams (marketing, product, engineering) to ensure seamless integration with...

  • Senior Web Developer

    4 days ago

    gandhinagar, India beBeeSoftwareEngineer Full time

    Job OpportunityWe are seeking an experienced software engineer to design and implement the front-end of our modern web application using VueJS and TypeScript.The ideal candidate will have 5+ years of experience in front-end development.Mandatory skills include VueJS 2/3, TypeScript, Kubernetes/Docker, CSS and Front-end Best Practices, Git Version Control,...

  • Highly Skilled Web Developer Wanted

    2 days ago

    Gandhinagar, India beBeeSoftware Full time

    About Pocket FM is a leading audio entertainment platform powering a new generation of storytelling through audiobooks, audio series and podcasts across multiple languages. We are redefining how content is consumed in the audio-first world.We are looking for a talented and product-focused Senior Software Engineer-Web to join our team in shaping innovative...

  • Senior Front-End Web Developer

    4 days ago

    Gandhinagar, India beBeeFrontEnd Full time

    Web Engineering SpecialistWe are seeking a seasoned Web Engineering Specialist who excels in crafting clean, responsive, and scalable web interfaces using HTML5, CSS3, and Bootstrap.The successful candidate will collaborate closely with designers, back-end developers, and stakeholders to deliver modern, high-performance digital experiences across browsers...

  • Senior Web Developer

    1 hour ago

    Gandhinagar, India beBeePHPDeveloper Full time

    Job DescriptionA skilled PHP developer will design, develop and maintain high-quality web applications using Core PHP and Object-Oriented Programming concepts.Key Responsibilities:Write clean, well-structured and high-performance PHP code.Troubleshoot, test and maintain core application features.Develop scalable and secure web solutions that meet business...