Efficient Web Crawler Developer Wanted

6 days ago

Bareilly, Uttar Pradesh, India beBeeWebCrawler Full time ₹ 60,00,000 - ₹ 1,20,00,000
Job Title: Web Crawler Developer

We are seeking a skilled web crawler developer who will design and implement efficient web crawling systems to extract valuable insights from the web.

The ideal candidate has strong programming skills in Python and experience with web scraping frameworks, browser automation tools, and handling anti-scraping challenges.

This is a remote position requiring high-speed internet connectivity, a capable computer, headphones with clear audio quality, and a stable power connection.

About the Job
  • Develop and maintain web crawlers using Python-based tools and frameworks.
  • Utilize browser automation tools (e.g., Playwright, Selenium) to handle dynamic content.
  • Clean, validate, and integrate extracted data into downstream storage systems.
  • Implement and manage solutions for anti-bot measures (CAPTCHAs, IP rotation, etc.).
  • Optimize crawling efficiency and ensure compliance with web crawling best practices.
Required Skills & Qualifications:
  • Proficiency in Python and 2 years of work experience in web scraping frameworks.
  • Strong knowledge of browser automation tools such as Playwright or Selenium.
  • Solid understanding of HTML, CSS, and selector languages (XPath/CSS).
  • Experience in handling anti-scraping challenges and ensuring robust data extraction.
Benefits:
  • Remote work environment with flexible scheduling.
  • Opportunity to work on cutting-edge web crawling projects.
  • Continuous learning and professional growth opportunities.
What We Offer:
  • High-speed internet connectivity for video calls and efficient work.
  • A capable business-grade computer (e.g., modern processor, 8 GB+ of RAM).
  • Headphones with clear audio quality.
  • A stable power connection and backups in case of internet/power failure.

  • Expert Web Developer Wanted

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeWebDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Web Development Expert WantedAt a cutting-edge digital marketing agency, we're on the lookout for an accomplished web development expert to join our team.This is a fantastic opportunity to leverage your technical expertise in designing and developing innovative web solutions using Shopify, WordPress, and custom websites.Maintain and update websites to ensure...

  • Experienced Web Developer Wanted

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeWebDeveloper Full time ₹ 14,00,000 - ₹ 17,00,000

    Job DescriptionWe are seeking a skilled web developer to design, develop and maintain scalable web applications using PHP and related technologies.This role involves writing clean, efficient and well-documented code, troubleshooting issues and collaborating with cross-functional teams to deliver high-quality software solutions.You will be responsible for...

  • Highly Experienced Web Developer Wanted

    2 weeks ago

    Bareilly, Uttar Pradesh, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Software Engineer OpportunityWe seek an experienced Senior Software Engineer to lead the development of scalable web applications.The ideal candidate will have a strong background in software design, development, and maintenance. They will be responsible for designing, developing, and maintaining robust web applications using Angular and .NET Core.Key...

  • Expert PHP Developer Wanted

    4 days ago

    Bareilly, Uttar Pradesh, India beBeePHPDeveloper Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Expert PHP Developer WantedWe are seeking an experienced expert in PHP and Laravel development to work on our high-quality web applications. As a key member of the team, you will be responsible for developing and maintaining cutting-edge web applications using the Laravel framework.Key Responsibilities:Develop and maintain web applications using the Laravel...

  • Web Solutions Developer

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeFullstack Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role\Helpers provide web solutions by developing, deploying and maintaining scalable and efficient web applications. They work closely with stakeholders to identify requirements, prioritize tasks, and analyze impact of changes.\Responsibilities\• Develop new features and functionality in web applications from scratch\\[br]\\

  • Product Data Ingestion Specialist

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeWebScraper Full time ₹ 40,00,000 - ₹ 50,00,000

    Senior Web Scraping Engineer PositionA senior web scraping engineer will be responsible for designing and implementing a high-throughput product data ingestion pipeline across hundreds of domains.Key Responsibilities:Design an HTTP-first crawler with Playwright fallback for JS-heavy pages.Implement sitemap diffing and conditional GETs (ETag/Last-Modified)...

  • E-Commerce Web Development Specialist

    1 week ago

    Bareilly, Uttar Pradesh, India beBeeDeveloper Full time ₹ 60,00,000 - ₹ 1,20,00,000

    **E-commerce Web Developer Wanted**We are seeking a skilled web developer with expertise in designing, developing, and maintaining responsive, user-friendly websites for e-commerce businesses.Create and optimize e-commerce websites using Shopify and WordPress platforms.Craft custom themes, templates, and plugins to meet business requirements.B build and...

  • Senior Web Development Specialist

    3 days ago

    Bareilly, Uttar Pradesh, India beBeeDeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are looking for a skilled Ruby on Rails Developer to join our team. This is an exciting opportunity to work with cutting-edge technology and be part of a dynamic and innovative company.As a Ruby on Rails Developer, you will be responsible for designing, developing, and deploying high-quality web applications using Ruby on Rails and other...

  • Expert Web Developer

    4 hours ago

    Bareilly, Uttar Pradesh, India beBeeDevelopment Full time US$ 1,80,000 - US$ 2,10,000

    Web Development Expert WantedTechHarbor Partners is a global IT consulting and digital solutions firm that assists businesses across the globe in overcoming complex technology challenges and scaling effectively.The Web Development Expert will be responsible for designing, developing, and maintaining web applications. The day-to-day tasks include writing...

  • Web Application Developer

    1 week ago

    Bareilly, Uttar Pradesh, India beBeedeveloper Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Web Application DeveloperWe are looking for a skilled Web Application Developer to join our team.The ideal candidate should have expertise in Laravel and CodeIgniter frameworks, as well as knowledge of HTML, CSS, and JavaScript. They should be able to write clean, efficient, and maintainable code and ensure compatibility and responsiveness across...