Senior Web Data Automation Specialist

23 hours ago

Kollam, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Job Title: Tech Lead

Location: Ahmedabad / WFO

Experience Level: Senior (4+ years)

Employment Type: Full-time

We are seeking a highly skilled and experienced Lead Data Scraping Engineer.

  • This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, leadership skills to drive the team towards success.

Key Responsibilities

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of developers, managing project timelines and deliverables.
  • Implement blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.

Required Skills and Experience

Data Scraping:

  • Minimum 4 years in IT scraping industry

Leadership:

  • Minimum 2 years leading a team of developers

Scraping Tools:

  • Scrapy, Threading, requests, web automation

Technical Proficiency:

  • Advanced Python
  • Captcha solving and blocking handling
  • Source reverse engineering
  • Proxy management & IP rotation
  • App automation, SSL Unpin, Frida
  • API Management, Version Control Systems
  • Error Handling, SQL, MongoDB, Pandas

Leadership Skills

  • Basic project management
  • Moderate documentation
  • Team handling
  • Pressure management
  • Flexibility and adaptability
  • High accountability

Preferred (Good to Have)

  • Experience with Linux
  • Knowledge of Appium, Fiddler, Burp Suite

  • Web Scraping/ Data Automation Specialist

    4 days ago

    Kollam, Kerala, India beBeeDataExtractor Full time ₹ 50,00,000 - ₹ 75,00,000

    Long-term Freelance Web Scraping/ Data Extraction ExpertWe are seeking a seasoned web scraping and data extraction expert to collaborate on a long-term project with significant ambition.This involves developing an intelligent, evolving system that requires advanced technical expertise, reliability, and creativity to bypass complex data access...

  • Senior Web Scraping Specialist

    6 days ago

    Kollam, Kerala, India beBeeDataExtraction Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job OverviewWe are seeking a skilled professional to fill the role of Data Extraction Specialist. This position involves designing and implementing efficient data extraction systems from web platforms, utilizing tools such as Python, Selenium, BeautifulSoup, Scrapy, and Pandas.The ideal candidate will possess expertise in automating data extraction...

  • Data Automation Specialist

    6 days ago

    Kollam, Kerala, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Automation SpecialistA top player in legal automation seeks a highly skilled Data Automation Specialist to join their team. As a key member of the data processing unit, you will be responsible for extracting structured data from large files using Python and OCR-based extraction.The ideal candidate will have 1+ years of experience in a...

  • Senior Web Architecture Specialist

    6 days ago

    Kollam, Kerala, India beBeeWebArchitecture Full time ₹ 5,00,000 - ₹ 10,00,000

    Job Title: Senior Web Architecture SpecialistThis is a full-time remote opportunity for an experienced Senior Web Architecture Specialist. The selected candidate will be responsible for designing and implementing web architectures, developing and maintaining web applications, and ensuring smooth and efficient web performance.Key Responsibilities:Design and...

  • Senior QA Automation Engineer

    3 days ago

    Kollam, Kerala, India beBeeAutomation Full time ₹ 25,00,000 - ₹ 30,00,000

    Senior QA Automation Engineer (Python)We are seeking a highly skilled Senior QA Automation Engineer with 10+ years of experience in Quality Assurance. The ideal candidate will have proven expertise in Python-based test automation for web, API, and data workflows.The role involves building robust automation frameworks using Python, Selenium, Pandas, SQL, and...

  • AI Automation Specialist

    5 days ago

    Kollam, Kerala, India beBeeArtificialintelligence Full time ₹ 5,00,000 - ₹ 7,00,000

    Senior AI DeveloperJob Overview:We're seeking an experienced AI/ML Developer to design and develop an intelligent web automation system. The ideal candidate will have a strong expertise in web automation, including web crawling, scraping, and automation workflows.Key Responsibilities:Design and develop an AI-powered web automation system.Implement web...

  • Senior Test Automation Engineer

    5 days ago

    Kollam, Kerala, India beBeeAutomation Full time ₹ 21,21,910 - ₹ 32,78,290

    Automation ExpertWe are seeking a skilled Automation Specialist to join our team. The ideal candidate will have a strong background in Python-based automation testing and be able to develop, maintain, and execute automated tests across web and API layers.Key Responsibilities:Design, develop, and maintain robust automation frameworks using Python.Develop and...

  • Senior Automation Specialist

    5 days ago

    Kollam, Kerala, India beBeeAutomation Full time ₹ 15,41,750 - ₹ 21,86,250

    Automation ProfessionalWe are seeking a skilled automation expert to develop and maintain automation frameworks for web and API testing. The ideal candidate should have experience in building robust automation solutions, working in agile teams, and using tools like Jira for test management and defect tracking.Key Responsibilities:Design, develop, and...

  • Advanced Automation Specialist

    6 days ago

    Kollam, Kerala, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Automation Developer PositionWe are seeking a highly skilled and experienced Senior Automation Developer to lead our QA team in delivering high-quality web applications.The ideal candidate will have extensive experience in writing end-to-end test automation using Cypress.io, strong JavaScript/TypeScript skills, and a passion for delivering robust,...

  • Senior Automation Specialist

    1 day ago

    Kollam, Kerala, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Automation Selenium Framework DeveloperWe are seeking a skilled Automation Selenium Framework Developer to drive the success of our organization. The ideal candidate will have extensive experience in building, maintaining, and enhancing automated testing frameworks using Selenium WebDriver and related technologies.This role involves collaborating...