Senior Web Scraper

5 days ago

Hubli, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

Lead Data Engineer

We are seeking an experienced engineer to join our organization. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of developers.

This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Required Skills and Qualifications:

  • Data Scraping: Minimum 4 years in IT scraping industry
  • Leadership: Minimum 2 years leading a team of developers
  • Scraping Tools: Scrapy, Threading, requests, web automation
  • Technical Proficiency:
    • Advanced Python
    • Captcha solving and blocking handling
    • Source reverse engineering
    • Proxy management & IP rotation
    • App automation, SSL Unpin, Frida
    • API Management, Version Control Systems
    • Error Handling, SQL, MongoDB, Pandas
  • Leadership Skills:
    • Basic project management
    • Modest documentation
    • Team handling
    • Pressure management
    • Flexibility and adaptability
    • High accountability

Preferred (Good to Have):

  • Experience with Linux
  • Knowledge of Appium, Fiddler, Burp Suite

  • Senior Web Developer

    5 days ago

    Hubli, Karnataka, India beBeeWordPress Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleSenior Web DeveloperAbout the RoleWe are seeking a skilled web developer to join our remote team. The ideal candidate will have expertise in developing high-performance web applications using PHP, MySQL, HTML5, CSS3, and JavaScript.Key ResponsibilitiesDevelop and customize WordPress themes and plugins.Build dynamic and responsive websites.Integrate...

  • Senior Web Application Developer

    4 days ago

    Hubli, Karnataka, India beBeeDevelopment Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a seasoned web application developer to join our team in Tirupati. As a Senior PHP Developer+WordPress, you will be responsible for designing and implementing scalable solutions using PHP and WordPress.Back-End Web Development, Object-Oriented Programming (OOP), and Programming skillsExperience in Front-End DevelopmentKnowledge...

  • Python Web Scraping Specialist

    4 days ago

    Hubli, Karnataka, India beBeeScraping Full time ₹ 10,00,000 - ₹ 20,00,000

    Senior Python DeveloperWe're seeking a skilled Senior Python Developer to join our team and lead the development of scalable web scraping frameworks.Design, develop, and maintain robust web scraping frameworks using Scrapy.Work with additional libraries such as BeautifulSoup, Selenium, Playwright, Requests, etc.Implement efficient error handling, data...

  • Senior Web Applications Developer

    1 week ago

    Hubli, Karnataka, India beBeeBackend Full time ₹ 18,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Senior Full Stack Developer to fill a key role in our technology team.About the Role:The successful candidate will design, develop, and maintain scalable web applications using Angular 16+ and .NET Core 6.Key Responsibilities:Develop clean, maintainable, and efficient code following industry best practices.Collaborate with...

  • Senior Web Development Professional

    3 days ago

    Hubli, Karnataka, India beBeeDevelopment Full time ₹ 20,00,000 - ₹ 30,00,000

    Web Development LeadWe are seeking a seasoned professional with profound expertise in PHP frameworks and WordPress development, complemented by strong project management skills. This role will lead and mentor a team of developers, overseeing full-cycle web development projects to ensure timely, high-quality delivery aligned with business goals.Key...

  • Backend Web Developer Specialist

    3 days ago

    Hubli, Karnataka, India beBeeBackendDeveloper Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Backend Web Developer SpecialistThis role involves contributing to the development and maintenance of multiple web applications.As a senior software developer, you will collaborate with cross-functional teams to build scalable web solutions using PHP, Angular, and RESTful APIs.Utilize expertise in TypeScript, HTML5, CSS3, and JavaScript to deliver...

  • Expert Web Application Specialist

    6 days ago

    Hubli, Karnataka, India beBeeFrontEnd Full time ₹ 10,00,000 - ₹ 12,00,000

    Senior Frontend DeveloperWe are seeking a highly skilled Senior Frontend Developer to join our team. As a key member of the front-end development team, you will be responsible for delivering cutting-edge web applications using React and GraphQL.Key Responsibilities:Design and develop responsive web pages using HTML, CSS, and JavaScriptImplement front-end...

  • Senior Web Developer

    4 days ago

    Hubli, Karnataka, India beBeeSoftwareCraftsman Full time ₹ 12,00,000 - ₹ 15,00,000

    Job TitleWe are seeking a seasoned Software Craftsman with extensive expertise in server-side scripting to collaborate with our development team. The ideal candidate should possess a deep understanding of PHP, web development frameworks, and database integration.The successful applicant will be responsible for crafting dynamic web applications, working...

  • Chief Web Application Developer

    4 days ago

    Hubli, Karnataka, India beBeeSoftwareEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Software EngineerAs a seasoned Senior Software Engineer, you will play a pivotal role in shaping the future of GIS-based web applications, mobile applications, and custom integrations.Your primary objective will be to deliver high-quality feature deliveries across multiple interfaces while working closely with cross-functional teams to drive product...

  • Full Stack Web Application Developer

    3 days ago

    Hubli, Karnataka, India beBeeSoftware Full time ₹ 25,00,000 - ₹ 40,00,000

    Senior Full Stack Developer PositionWe are seeking a seasoned Senior Full Stack Developer to join our team of passionate professionals. This role involves designing, developing, and maintaining scalable web applications while ensuring high-quality test coverage.About the Role:Develop robust and scalable web applications using Angular and .NET Core.Design and...