Web Crawler Specialist

23 hours ago

Jaipur, Rajasthan, India beBeeWebCrawler Full time ₹ 90,00,000 - ₹ 1,20,00,000

**Job Opportunity:** Web Crawler Specialist

We are seeking a skilled and experienced Web Crawler Specialist to join our team. The ideal candidate will be responsible for designing, developing, and maintaining web crawlers to extract valuable insights from the web.

Key Responsibilities:

  • Design and develop web crawlers using Python-based tools and frameworks.
  • Implement and maintain existing web scraping and data crawling projects.
  • Clean, validate, and integrate extracted data into downstream storage systems.
  • Develop solutions for anti-bot measures to ensure robust data extraction and compliance with best practices.
  • Collaborate with cross-functional teams to optimize data acquisition strategies and improve overall efficiency.

Required Skills & Qualifications:

  • Proficiency in Python and experience with web scraping frameworks (especially Scrapy).
  • Strong knowledge of browser automation tools and selector languages (XPath/CSS).
  • Solid understanding of HTML, CSS, and distributed scraping techniques for efficient data pipelines.
  • Ability to troubleshoot and optimize web crawlers for performance, reliability, and scalability.
  • Excellent analytical, problem-solving, and communication skills.

Infrastructure Requirements:

To ensure uninterrupted work, you will need:

a high-speed internet connection for video calls and efficient work;

a capable business-grade computer with a modern processor, 8 GB+ of RAM, and no obstacles to efficient work;

good-quality headphones with clear audio; and

a stable power connection with backups in case of internet/power failure.

  • Web Specialist

    3 days ago

    Jaipur, Rajasthan, India 4iQ Institute Official Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company Description4iQ Institute Official provides opportunities to build careers in the IT & Tech sectors through a wide range of job-oriented courses. Our offerings include Ethical Hacking, Digital Marketing, Graphic Design, Video Editing, Software Development, E-Commerce, YouTube Mastery, WordPress Development, Web Development, and various programming...

  • Web Application Specialist

    5 days ago

    Jaipur, Rajasthan, India beBeeDeveloper Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Web Application SpecialistWe are seeking an experienced and skilled Web Application Specialist to join our team. In this role, you will be responsible for developing and maintaining user-facing features, ensuring the technical feasibility of UI/UX designs, optimizing applications for maximum speed and scalability, and collaborating with other team...

  • Data Integration Specialist

    6 days ago

    Jaipur, Rajasthan, India beBeeIntegration Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Integration SpecialistWe are seeking a skilled Data Integration Specialist to design and build data integration solutions using the o9 platform.Key Responsibilities:Create data crawlers to extract data from customers' data sources using ETL platforms, troubleshoot issues during data loading and processing.Design and implement data warehouse models in...

  • Search Engine Optimization Specialist

    3 days ago

    Jaipur, Rajasthan, India TELSYS WEB INFOTECH PRIVATE LIMITED Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Search Engine Optimization Specialist. = 5MIni. Exp 3 yearsCompany DescriptionTelsys Web Infotech Private Limited, incorporated on 25 September 2006, specializes in web, mobile app development, design, and marketing services. Our team has successfully completed numerous projects, helping startups and large businesses achieve their goals. Rated 5 stars by our...

  • Web Application Security Specialist

    3 days ago

    Jaipur, Rajasthan, India beBeeSecurity Full time ₹ 15,00,000 - ₹ 21,50,000

    The Firm is seeking a skilled Web Application Security specialist to expand its team and ensure the security of its web applications.The successful candidate will be responsible for deploying and maintaining web application security controls, including Web Application Firewalls (WAF), Bot Management, Content Validation and API Security.This role requires...

  • Web Development Specialist

    7 days ago

    Jaipur, Rajasthan, India beBeeDevelopment Full time ₹ 12,00,000 - ₹ 15,00,000

    Job OpportunityWe're passionate about digital advertising and dedicated to delivering exceptional client results. We're seeking a skilled Web Development Specialist to design and produce high-quality landing pages and websites across multiple platforms.This is a remote position, and you'll work closely with our team to deliver outstanding results. Your key...

  • Web Interface Specialist

    7 days ago

    Jaipur, Rajasthan, India beBeeFrontendDeveloper Full time ₹ 10,00,000 - ₹ 15,00,000

    Sign up and learn more before applying: www.ravian.ai will boost your chances of getting shortlisted. If you haven't signed up, we can't proceed.Role OverviewThis is a full-time remote Frontend Developer position. As a Frontend Developer, you'll be responsible for creating and implementing user interface components using web development technologies. Your...

  • Web Development Specialist

    5 days ago

    Jaipur, Rajasthan, India beBeeFullStack Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Senior Web ArchitectWe are seeking a skilled Senior Web Architect to design, develop and maintain scalable web applications using Angular and Node.js.Main Responsibilities:Create robust, efficient and well-structured code following industry best practices.Collaborate with cross-functional teams to deliver high-quality solutions within deadlines.Integrate...

  • Automate Large-Scale Web Applications

    6 days ago

    Jaipur, Rajasthan, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Automation SpecialistWe are seeking skilled Automation Specialists to automate large-scale web applications.This role involves utilizing expertise in TestComplete and JavaScript to create efficient test cases for unit tests (15,000–16,000) and end-to-end tests (5,000–6,000).Main Responsibilities:Design and execute comprehensive automation strategies...

  • Web Development Specialist

    23 hours ago

    Jaipur, Rajasthan, India beBeeDeveloper Full time ₹ 12,00,000 - ₹ 18,00,000

    Job OverviewWe are seeking a skilled and motivated Web Developer to join our digital team. The successful candidate will have a strong understanding of front-end and back-end development, responsive design, and be comfortable working with modern frameworks and technologies.This is an excellent opportunity for a talented individual to work on high-performance...