Senior Web Scraping Specialist

2 days ago


Alleppey, Kerala, India beBeeDataScraping Full time ₹ 90,00,000 - ₹ 1,20,00,000
Job Title: Data Scraping Engineer

We are seeking an experienced data scraping professional to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

  • This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.
Key Responsibilities:
  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.
Required Skills and Qualifications:
  • Data Scraping: Minimum 4 years in IT scraping industry
  • Leadership: Minimum 2 years leading a team of 5+ developers
  • Scraping Tools: Scrapy, Threading, requests, web automation
  • Technical Proficiency: Advanced Python, Captcha solving and blocking handling, Source reverse engineering, Proxy management & IP rotation, App automation, SSL Unpin, Frida, API Management, Version Control Systems, Error Handling, SQL, MongoDB, Pandas
  • Leadership Skills: Basic project management, Moderate documentation, Team handling, Pressure management, Flexibility and adaptability, High accountability
Benefits:
  • Opportunity to work on challenging projects
  • Chance to grow and develop as a leader
  • Collaborative and dynamic work environment
Others:
  • Experience with Linux is preferred
  • Knowledge of Appium, Fiddler, Burp Suite is also desired


  • Alleppey, Kerala, India beBeeScraping Full time ₹ 20,00,000 - ₹ 25,00,000

    Web Scraping Expert SoughtWe are searching for a highly skilled Web Scraping Professional to design and develop large-scale data extraction solutions using Scrapy. The ideal candidate will have expertise in web scraping, automation, and data processing.Design, implement, and maintain scalable web scraping frameworks using Scrapy (mandatory).Utilize...


  • Alleppey, Kerala, India beBeeDevelopment Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Web Development Expert WantedWe are seeking a skilled and ambitious developer to lead our long-term project involving advanced web scraping techniques, data automation, and complex system design.The ideal candidate will have experience with high-level programming languages, including Python and JavaScript, as well as proficiency in web development frameworks...


  • Alleppey, Kerala, India beBeeData Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Job OpportunityWe are seeking a skilled Data Engineer to collaborate on client projects.Key Responsibilities:Design, implement, and maintain web scrapers for alternative datasets.Perform data cleaning, exploration, transformation, and quality checks on scraped data.Collaborate with cross-functional teams to understand data requirements and implement...


  • Alleppey, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Insights SpecialistWe are seeking a skilled Data Insights Specialist to join our team. As a key member of our organization, you will be responsible for designing and implementing robust web scraping solutions to extract valuable data from various sources.The ideal candidate will have expertise in Python, Selenium, Pandas, SQL, and APIs with...


  • Alleppey, Kerala, India beBeeCrawling Full time ₹ 10,00,000 - ₹ 15,00,000

    Job OpportunityWe are seeking a Web Crawling Specialist who will be responsible for developing and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.The ideal candidate will have strong programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping...


  • Alleppey, Kerala, India beBeeDataMining Full time ₹ 15,00,000 - ₹ 20,00,000

    As a Data Mining Analyst, you will play a pivotal role in streamlining data extraction processes from web platforms.Key Responsibilities:Design and develop robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Utilize Python, Selenium, BeautifulSoup, Scrapy, and Pandas for data scraping and processing.Build...


  • Alleppey, Kerala, India beBeeSoftwareEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    Job OpportunityWe are seeking an experienced software engineer to design and optimize data extraction solutions.The ideal candidate will have expertise in web scraping, OCR, and building scalable scripts for performance and accuracy.Key Responsibilities:Develop and maintain high-quality scripts for web scraping from structured and unstructured...


  • Alleppey, Kerala, India beBeeScraping Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Technology ManagerWe are seeking a highly experienced senior technology manager to spearhead our IT operations. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.


  • Alleppey, Kerala, India beBeeDeveloper Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Automation Workflow DeveloperOur company is seeking an experienced Automation Workflow Developer to create a sophisticated, AI-powered sales and lead generation workflow using n8n. The ideal candidate will have a strong background in n8n, API integration, and AI integration.The workflow will be responsible for automating the process from initial...


  • Alleppey, Kerala, India beBeeArtificial Full time ₹ 50,000 - ₹ 70,000

    AI System DeveloperWe are seeking an experienced AI/ML developer to design and build an intelligent system that can interact with websites, perform smart actions, and extract data automatically.Develop a web automation system capable of interacting with websites intelligently.Implement workflows for web crawling, scraping, and automation (e.g., navigating...