Senior Web Scraping Solutions Architect

2 days ago

Gandhinagar, Gujarat, India beBeeDataScrapingEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Lead Data Scraping Engineer

We are seeking an experienced Tech Lead to drive our data scraping efforts forward. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Required Skills and Experience:

  • Data Scraping: Minimum 4 years in IT scraping industry
  • Leadership: Minimum 2 years leading a team of 5+ developers
  • Scraping Tools: Scrapy, Threading, requests, web automation
  • Technical Proficiency:
  1. Advanced Python
  2. Captcha solving and blocking handling
  3. Source reverse engineering
  4. Proxy management & IP rotation
  5. App automation, SSL Unpin, Frida
  6. API Management, Version Control Systems
  7. Error Handling, SQL, MongoDB, Pandas
Leadership Skills:
  1. Brief project management
  2. Good documentation
  3. Team handling
  4. Pressure management
  5. Flexibility and adaptability
  6. High accountability

Preferred (Good to Have):

  • Experience with Linux
  • Knowledge of Appium, Fiddler, Burp Suite

  • Technical Web Scraping Specialist

    1 day ago

    Gandhinagar, Gujarat, India beBeeWebScraping Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Role: Technical Web Scraping SpecialistWe seek a highly skilled expert in designing and developing large-scale web scraping solutions using cutting-edge technology.The ideal candidate will leverage their expertise in Scrapy, Python, and related tools to deliver scalable data extraction and processing capabilities.Key Responsibilities:Design, develop, and...

  • Web Data Extraction Specialist

    4 days ago

    Gandhinagar, Gujarat, India beBeeExtraction Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Expert Web Scraping/Data Extraction ProfessionalWe are seeking a highly skilled and experienced professional in web scraping and data extraction to lead a long-term project with ambitious goals. The ideal candidate will possess advanced technical skills, reliability, and creativity to overcome complex data access challenges.About the Project:Our strategic...

  • Chief Web Architect

    1 day ago

    Gandhinagar, Gujarat, India beBeeWebDeveloper Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Web DeveloperJob Overview:Vasu Travel & Tourism LLC, a leading travel solutions provider, seeks an experienced Web Developer to join our team. As a key member of our digital department, you will be responsible for designing and developing cutting-edge web applications that cater to the diverse needs of our clients.Key Responsibilities:

  • Chief Enterprise Solution Architect

    10 hours ago

    Gandhinagar, Gujarat, India beBeeEnterprise Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Architect Enterprise SolutionsThis is an exceptional opportunity for a seasoned architect to lead the design and implementation of complex solutions that drive business transformation.As a Senior BPM Architect, you will be responsible for crafting architectures that meet the evolving needs of our clients. Your technical expertise in integration architecture,...

  • Java Solution Architect

    3 hours ago

    Gandhinagar, Gujarat, India People Prime Worldwide Full time

    About Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.About...

  • Business Insights Professional

    1 day ago

    Gandhinagar, Gujarat, India beBeeDataScience Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Business Insights ProfessionalThis is a data-focused role requiring expertise in automating data extraction processes from web platforms.Key Responsibilities:Design and implement efficient data scraping systems using Python, Selenium, Pandas, and APIs.Extract structured and unstructured data from various websites and APIs.Clean, preprocess, and...

  • Senior Enterprise SSO Architect

    13 hours ago

    Gandhinagar, Gujarat, India beBeesolution Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** JBoss SSO Solution Architect**Experience Level:** Senior**Location:** Gurgaon, India**Job Summary:We are seeking a seasoned expert in designing and implementing Single Sign-On solutions using Red Hat JBoss SSO (Keycloak). The ideal candidate will have strong expertise in identity and access management (IAM), authentication & authorization...

  • High-Traffic Ecommerce Solutions Architect

    2 days ago

    Gandhinagar, Gujarat, India beBeefrontend Full time ₹ 15,00,000 - ₹ 22,50,000

    Our team is seeking a seasoned Frontend Engineer to spearhead the development of high-traffic e-commerce experiences.About the roleWe're looking for an expert who can architect, code, and optimize modern React/Next.js applications that are fast, accessible, secure, and resilient.The ideal candidate will have deep knowledge of React.js and/or Next.js (Hooks:...

  • Senior Backend Systems Architect

    1 day ago

    Gandhinagar, Gujarat, India beBeebackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Backend Systems ArchitectWe are looking for a seasoned backend systems architect to spearhead the design and development of our next-gen FinTech platform.

  • Infrastructure Solutions Architect

    10 hours ago

    Gandhinagar, Gujarat, India beBeeNetwork Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Infrastructure Solutions ArchitectWe are seeking a seasoned professional to design, implement and maintain complex LAN technology infrastructure. With a strong background in switching, routing and security, this expert will support and implement IP-based networks ensuring stability, security and effective use of technology.Key...