Senior Web Scraping Developer

1 week ago


Mount Abu, Rajasthan, India beBeeWebScraper Full time ₹ 15,00,000 - ₹ 25,00,000
Job Summary

We are seeking a seasoned Python developer to lead our web scraping initiatives. The ideal candidate will design, develop, and optimize large-scale scraping solutions that power data-driven decision-making.

Main Responsibilities:

  • Design, develop, and maintain scalable web scraping frameworks using Scrapy (mandatory).
  • Work with additional libraries/tools such as BeautifulSoup, Selenium, Playwright, Requests, etc.
  • Implement robust error handling, data parsing, and data storage mechanisms (JSON, CSV, SQL/NoSQL databases).
  • Build and optimize asynchronous scraping workflows and handle multithreading/multiprocessing.
  • Collaborate with product managers, QA, and DevOps teams to ensure timely delivery.
  • Research and adopt new scraping technologies to improve performance, scalability, and efficiency.

Required Skills and Qualifications:

  • 2+ years of experience in Python development with Scrapy expertise (must-have).
  • Proficiency with automation libraries such as Playwright or Selenium.
  • Experience with REST APIs, asynchronous programming, and concurrency.
  • Familiarity with databases (SQL/NoSQL) and cloud-based data pipelines.
  • Strong problem-solving skills and ability to meet deadlines in an Agile environment.

What We Offer:

  • A competitive salary and benefits package.
  • A flexible and collaborative work environment.
  • Ample opportunities for career growth and skill development.

  • Senior Data Analyst

    2 days ago


    Mount Abu, Rajasthan, India beBeeDataAnalyst Full time ₹ 8,00,000 - ₹ 15,00,000

    Key Responsibilities:Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Use tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas for data scraping and processing.Build and manage automated scripts to scrape dynamic websites, including handling JavaScript-driven...


  • Mount Abu, Rajasthan, India beBeeScraping Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a skilled Senior Web Scraping Specialist to design and implement an HTTP-first crawler with Playwright fallback for JS-heavy pages.Develop a high-throughput product data ingestion pipeline across hundreds of domains.Owning the automation around scheduling, retries, and monitoring.Integrate third-party APIs as first-class sources.The ideal...


  • Mount Abu, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Lead Data EngineerWe are seeking a highly skilled and experienced data engineer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.Key Responsibilities:Design and develop scalable data scraping solutions using tools like Scrapy and Python...


  • Mount Abu, Rajasthan, India beBeeDataAutomation Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Expert Web Scraping and Data ExtractionWe are seeking a highly skilled web scraping/data automation expert to join us on a long-term project. The goal is to develop a sophisticated, evolving system that requires advanced technical expertise, reliability, and creativity to bypass complex data access challenges.Our mission involves building a strategic data...


  • Mount Abu, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled software developer to collaborate on client projects.In this role, you will work closely with various company departments to shape and innovate new products and features for our platform. You will have a large degree of independence and trust, but won't be isolated; the support of team leads and technology team members is behind you....


  • Mount Abu, Rajasthan, India beBeeDataScraping Full time US$ 6,00,000 - US$ 10,00,000

    As a skilled web scraping specialist, you will be responsible for designing and implementing efficient and scalable data extraction systems to gather structured and unstructured data from various websites and APIs. Your expertise in Python, Selenium, and Pandas will enable you to develop robust web scraping solutions that handle dynamic content and ensure...


  • Mount Abu, Rajasthan, India beBeeArtificial Full time ₹ 50,000 - ₹ 70,000

    Job Title: Senior AI DeveloperJob Overview:We are seeking an accomplished AI/ML expert to design and build an intelligent system capable of interacting with websites, performing smart actions (clicking, downloading, form filling, navigation), and extracting data automatically.The role involves combining AI techniques with web crawling/automation tools to...


  • Mount Abu, Rajasthan, India beBeeWebDataExtractor Full time ₹ 8,00,000 - ₹ 12,00,000

    We're seeking a skilled web data extractor to build and maintain web crawlers, extract valuable insights from the web, and ensure data quality.Key Responsibilities:Maintain and enhance existing web scraping projects using Python-based tools and frameworks.Develop and refine crawlers to handle dynamic content and optimize crawling efficiency.Clean, validate,...


  • Mount Abu, Rajasthan, India beBeeWebdeveloper Full time ₹ 80,00,000 - ₹ 1,20,00,000

    About the RoleThe role of Senior PHP Developer+WordPress involves developing, maintaining, and enhancing web applications using PHP and WordPress. This is a full-time on-site position that requires programming, object-oriented programming (OOP), back-end web development, and collaboration with front-end developers to create seamless user experiences.


  • Mount Abu, Rajasthan, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title: Senior Web Application DeveloperWe are seeking an experienced Senior Web Application Developer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining scalable web applications using Angular 16+ and .NET Core 6.Key Responsibilities:Web Development: Develop robust and scalable web applications...