Senior Web Scraping Solutions Developer

3 days ago

Kottayam, Kerala, India beBeeScraping Full time US$ 1,00,000 - US$ 2,00,000

Job Title: Senior Web Scraping Solutions Developer

Location: Remote/Onsite

Experience Level: Senior (4+ years)

Employment Type: Full-time

Job Description

We are seeking an experienced and skilled Web Scraping Solutions Developer to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in web scraping, with at least 2 years leading a team of 5+ developers.

This role requires deep technical knowledge in advanced web scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

Required Skills and Qualifications

  • Minimum 4 years in IT web scraping industry
  • Minimum 2 years leading a team of 5+ developers
  • Expertise in web scraping tools like Scrapy and Python libraries
  • Knowledge of advanced blocking and captcha-solving techniques
  • Experience with source code reverse engineering and automation
  • Ability to manage proxies, IP rotation, and SSL unpinning
  • Skills in API integrations, data pipelines, and version control systems
  • Strong understanding of error handling, SQL, MongoDB, and Pandas

Benefits

  • Opportunity to work on challenging web scraping projects
  • Collaborative and dynamic work environment
  • Continuous learning and skill development opportunities
  • Flexible working hours and remote work options

Others

  • Experience with Linux operating system
  • Knowledge of Appium, Fiddler, Burp Suite

Key Responsibilities:

  • Design and develop scalable web scraping solutions using tools like Scrapy and Python libraries
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions
  • Conduct source code reverse engineering and automate web interactions
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping
  • Maintain and improve API integrations and data pipelines
  • Ensure code quality through effective version control, error handling, and documentation
  • Collaborate with cross-functional teams for project planning and execution
  • Monitor performance and provide solutions under high-pressure environments

  • Senior Web Scraping Specialist

    3 days ago

    Kottayam, Kerala, India beBeeDataScientist Full time ₹ 20,00,000 - ₹ 25,00,000

    Key positions in our organization are available for experienced Python developers with strong expertise in web scraping and Optical Character Recognition (OCR) to design, develop, and optimize data extraction solutions.Key Responsibilities:Develop and maintain efficient Python scripts for web scraping from structured and unstructured sources, ensuring...

  • Senior Web Scraping Professional

    1 week ago

    Kottayam, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Web Scraping SpecialistWe are seeking a seasoned web scraping professional to spearhead our long-term project.The ideal candidate will possess advanced technical expertise, reliability, and creativity to overcome complex data access challenges. They will be responsible for designing and implementing a sophisticated system that involves extracting and...

  • Python Expert in Web Scraping and Automation

    1 week ago

    Kottayam, Kerala, India beBeeScraping Full time ₹ 15,12,000 - ₹ 20,11,200

    Senior Web Scraping DeveloperWe are seeking an experienced developer to create large-scale web scraping solutions using Python and Scrapy.The ideal candidate will design, develop, and optimize high-performance scraping frameworks that drive data-driven decision-making.Key Responsibilities:Design, develop, and maintain scalable web scraping architectures.Work...

  • Web Data Extraction Specialist

    4 days ago

    Kottayam, Kerala, India beBeeWeb Full time ₹ 9,00,000 - ₹ 18,00,000

    We are seeking a Junior Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Key...

  • Senior Data Miner

    2 days ago

    Kottayam, Kerala, India beBeeDataMining Full time US$ 90,000 - US$ 1,20,000

    Job Opportunity:We are looking for a seasoned Data Mining Expert to spearhead our web scraping efforts.Key Responsibilities:Design, develop, and maintain high-performance web scraping solutions to extract structured and unstructured data from various websites and APIs.Utilize tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas for data extraction...

  • Data Analyst Specialist

    21 hours ago

    Kottayam, Kerala, India beBeeDeveloper Full time ₹ 9,00,000 - ₹ 12,00,000

    Web Scraping DeveloperAre you a web scraping professional with expertise in automating data extraction processes from web platforms? We are seeking a skilled developer to design and implement efficient and scalable data scraping systems.Develop, maintain, and optimize robust web scraping solutions to extract structured and unstructured data from various...

  • Extracting Insights from Big Data

    1 week ago

    Kottayam, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Insights SpecialistAs a Data Insights Specialist, you will be responsible for designing, developing and maintaining robust web scraping solutions to extract structured and unstructured data from various websites and APIs. You will work with tools like Python, Selenium, BeautifulSoup, Scrapy and Pandas for data scraping and processing.You will...

  • Senior Data Architect

    1 day ago

    Kottayam, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking an experienced Data Architect to lead the development of data pipelines, web scraping solutions, and data visualization tools.The ideal candidate will have strong expertise in Python, data analysis, and database management, with hands-on experience in handling large datasets and building efficient data...

  • Data Scraper Professional

    1 week ago

    Kottayam, Kerala, India beBeeDataScraper Full time ₹ 18,00,000 - ₹ 26,00,000

    Job Title: Lead Data Scraping EngineerA highly skilled and experienced professional is required to design, develop, and lead data scraping solutions. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.Key Responsibilities:Develop scalable data scraping solutions...

  • Senior Web Developer

    1 day ago

    Kottayam, Kerala, India beBeeWebdeveloper Full time ₹ 15,000 - ₹ 24,000

    As a WordPress developer, you will play a pivotal role in building custom client dashboards that streamline content management and operational tasks.Job DescriptionOur company is seeking an accomplished WordPress developer with expertise in coding (PHP, HTML, CSS, JavaScript) to create bespoke web solutions for clients. The ideal candidate will be...