Web Scraping Lead Position

22 hours ago

Kanpur, Uttar Pradesh, India beBeeDataScraping Full time ₹ 18,00,000 - ₹ 25,00,000
Job Overview

We are seeking a highly skilled and experienced Web Scraping Lead to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

Key Responsibilities:

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
Required Skills and Experience

Data Scraping: Minimum 4 years in IT scraping industry

Leadership: Minimum 2 years leading a team of 5+ developers

Scraping Tools: Scrapy, Threading, requests, web automation

Technical Proficiency:

  1. Advanced Python
  2. Captcha solving and blocking handling
  3. Source reverse engineering
  4. Proxy management & IP rotation
  5. App automation, SSL Unpin, Frida
  6. API Management, Version Control Systems
  7. Error Handling, SQL, MongoDB, Pandas
Benefits

Opportunities for growth and professional development

Competitive salary and benefits package

Collaborative and dynamic work environment

Others

Experience with Linux is a plus

Knowledge of Appium, Fiddler, Burp Suite is also preferred

  • Senior Web Scraping Developer

    2 hours ago

    Kanpur, Uttar Pradesh, India beBeeScraping Full time ₹ 9,00,000 - ₹ 12,00,000

    Actowiz Solutions, a leading data solutions provider, delivers actionable insights by extracting clean and structured data through cutting-edge technology.The ideal candidate will craft and optimize large-scale scraping solutions that drive data-driven decision-making. Key responsibilities include:Develop scalable web scraping frameworks using Scrapy.Work...

  • Web Scraping and Data Analytics Professional

    2 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataMining Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Mining SpecialistJob Description:We seek a highly skilled data mining specialist with extensive expertise in web scraping and data extraction processes.The ideal candidate will have hands-on experience in automating data extraction from web platforms using Python, Selenium, BeautifulSoup, Scrapy, and Pandas.Key Responsibilities:Design, develop, and...

  • Systems Architect Position

    2 days ago

    Kanpur, Uttar Pradesh, India beBeescalability Full time ₹ 20,00,000 - ₹ 25,00,000

    Backend Systems Engineer PositionWe're looking for an experienced Backend Engineer to create scalable, high-performance systems that empower cross-functional teams through reliable backend services.About the RoleDevelop robust, well-documented APIs for internal and external use.Evaluate system performance and optimize for scalability, security, and...

  • Web Data Extraction Specialist

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Expert web scraping and data extraction specialists are sought for a long-term freelance project.This ambitious initiative involves creating a sophisticated, evolving system that requires advanced technical expertise, reliability, and creativity to bypass complex data access challenges.Key responsibilities will include:Designing and implementing smart data...

  • Senior Web Developer Position

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDevelopment Full time ₹ 8,00,000 - ₹ 12,00,000

    ">Web Developer Role">This is a full-time remote position for an experienced Web Developer. The ideal candidate will be responsible for both back-end and front-end development, creating and customizing websites, ensuring they are responsive and visually appealing.Key Responsibilities:Implement web designs using web development skillsMaintain and troubleshoot...

  • Senior Web Application Developer Position

    22 hours ago

    Kanpur, Uttar Pradesh, India beBeeFrontend Full time ₹ 10,00,000 - ₹ 15,00,000

    Shopify Front End DeveloperWe are seeking a skilled Web Programmer with experience in Shopify and JavaScript to fill this position. As a Web Programmer, you will be responsible for creating and maintaining the client side of our e-commerce platform.Responsibilities:Developing and customizing Shopify themes using DOM manipulation, asynchronous JavaScript,...

  • Web Interface Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeFrontend Full time ₹ 6,00,000 - ₹ 8,00,000

    Frontend Developer OpportunityAbout the Role:This Front-End Web Developer Intern position involves creating engaging and interactive user interfaces for our web applications. Responsibilities include designing responsive web interfaces using HTML, CSS, and JavaScript, creating UI components with React.js + Tailwind CSS, and integrating AI features with an...

  • Marketing Web Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeewebDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled Webflow Developer to join our team. The ideal candidate will have experience with Webflow, web design fundamentals, and the ability to follow brand guidelines.The successful candidate will be responsible for developing high-quality web experiences that meet conversion goals, page performance, and responsive design...

  • Senior Web Development Specialist

    1 day ago

    Kanpur, Uttar Pradesh, India beBeeOptimiser Full time US$ 9,600

    Job OverviewThe ideal candidate for this role will design and produce high-quality landing pages and websites using Go High Level, Unbounce, and Wordpress. They will work closely with the team to deliver exceptional results for clients.This is a remote position that requires an agile, professional, organized individual who can take on a range of...

  • Senior Front-End Developer Position

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeWebDeveloper Full time ₹ 18,00,000 - ₹ 25,00,000

    Full Stack Web DeveloperWe are seeking a highly skilled and motivated developer with good communication skills to join our organization.This is a full-time position where you will be responsible for developing a web application from scratch.You will work on building robust and scalable applications and contribute to meaningful projects that drive business...