Senior Web Scraping Specialist

4 days ago

Palakkad, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

Lead Data Extraction Manager

The ideal candidate will be responsible for overseeing the extraction of large datasets from various web sources.

  • Design and develop scalable data extraction solutions using tools like Scrapy and Python libraries.
  • Manage a team of developers, ensuring project timelines and deliverables are met.
  • Implement advanced techniques to bypass web scraping restrictions.
  • Conduct source code analysis and automate web interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective extraction.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.

Required Skills and Qualifications:

  • Data Extraction: Minimum 4 years in IT industry
  • Leadership: Minimum 2 years leading a team of developers
  • Tools and Technologies: Scrapy, Threading, requests, web automation, Linux, Appium, Fiddler, Burp Suite
  • Technical Proficiency:
    • Advanced Python
    • Captcha solving and blocking handling
    • Source reverse engineering
    • Proxy management & IP rotation
    • App automation, SSL Unpin, Frida
    • API Management, Version Control Systems
    • Error Handling, SQL, MongoDB, Pandas
  • Leadership Skills:
    • Project management
    • Documentation
    • Team handling
    • Pressure management
    • Flexibility and adaptability
    • Accountability

Preferred Skills:

  • Experience with Linux
  • Knowledge of Appium, Fiddler, Burp Suite

  • Senior Web Scraping Expert

    3 days ago

    Palakkad, Kerala, India beBeeScraping Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity:We are seeking an experienced professional to fill the role of Senior Python Developer.The ideal candidate will design, develop, and optimize large-scale scraping solutions that power data-driven decision-making.Design, develop, and maintain scalable web scraping frameworks using Scrapy.Work with additional libraries/tools such as...

  • Data Mining Specialist

    3 days ago

    Palakkad, Kerala, India beBeeDataMining Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data Mining SpecialistWe are seeking a highly skilled Data Mining Specialist to automate data extraction processes from web platforms using Python, Selenium, Pandas, SQL, and APIs.Key Responsibilities:Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Use tools...

  • Web Data Extraction Expert

    1 week ago

    Palakkad, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Extract Data with PrecisionWe are seeking an expert web data extractor for a high-profile project requiring sophisticated technical skills. This complex mission involves extracting and structuring data from various online sources with dynamic content, custom headers, request simulation, automation flows, and more.Key ResponsibilitiesDevelop advanced web...

  • Web Application Specialist

    2 days ago

    Palakkad, Kerala, India beBeeDevelopment Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Frontend Developer PositionWe are seeking an experienced Senior Frontend Developer with a strong background in Angular to join our development team. In this role, you will be responsible for designing and building high-performance, scalable, and responsive web applications.

  • Sales Workflow Automation Engineer

    2 days ago

    Palakkad, Kerala, India beBeeAutomation Full time ₹ 10,00,000 - ₹ 14,00,000

    Project OverviewWe are seeking an automation specialist to build a sales and lead generation workflow using n8n.The goal is to automate the process from initial company identification to personalized email outreach, creating a powerful engine for our sales team.Responsibilities include:Building the end-to-end workflow in n8nIntegrating third-party services...

  • Sales Workflow Automation Specialist

    3 days ago

    Palakkad, Kerala, India beBeeAutomation Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job DescriptionWe are seeking an experienced automation developer to join our team and design a cutting-edge AI-powered sales workflow. This project aims to automate the process from company identification to personalized email outreach, creating a powerful engine for our sales team.The ideal candidate will have a strong background in n8n and experience...

  • Highly Skilled Web Development Specialist

    4 days ago

    Palakkad, Kerala, India beBeeWebDevelopment Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Description:">We are seeking a skilled Web Development Specialist to contribute to the creation and maintenance of our web applications.The ideal candidate will have a strong foundation in front-end and back-end web development, with proficiency in coding languages and experience in web design.

  • Web Development Specialist

    3 days ago

    Palakkad, Kerala, India beBeeWebDevelopment Full time ₹ 6,00,000 - ₹ 12,00,000

    As a web development specialist, you will play a crucial role in the success of our organization. Your primary responsibility will be to design, develop, and maintain high-quality web applications that meet the evolving needs of our customers.The ideal candidate will possess excellent technical skills, including experience in back-end web development,...

  • Senior Frontend Web Developer

    1 day ago

    Palakkad, Kerala, India beBeeJavaScript Full time ₹ 8,00,000 - ₹ 15,00,000

    Senior Web Application Developer Job DescriptionWe are seeking a highly skilled and experienced Senior Web Application Developer to join our team. As a senior developer, you will play a key role in designing, developing, and maintaining high-performance web applications using JavaScript and Node.js.Main Responsibilities:Develop, test, and maintain responsive...

  • Advanced AI Architect

    2 days ago

    Palakkad, Kerala, India beBeeArtificial Full time ₹ 50,000 - ₹ 70,000

    Job Title: Advanced AI ArchitectThis position requires the ability to integrate artificial intelligence with web automation tools to create a scalable solution.Key Responsibilities:Design and develop an AI-powered web automation system capable of interacting with websites intelligently.Implement web crawling, scraping, and automation workflows (e.g.,...