Senior Web Crawler Specialist

2 weeks ago

bangalore, India beBeeEngineer Full time

We are seeking a skilled engineer to build and maintain web crawlers, extract valuable insights from the web, and ensure data quality.The ideal candidate will have strong programming skills and experience in scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Key Responsibilities:Maintain and enhance existing web scraping projects.Develop and refine crawlers using Python-based tools and frameworks.Utilize browser automation tools (e.g., Playwright, Selenium) to handle dynamic content.Clean, validate, and integrate extracted data into storage systems.Implement solutions for anti-bot measures (CAPTCHAs, IP rotation, etc.).Optimize crawling efficiency and ensure compliance with web crawling best practices.Collaborate with cross-functional teams to improve data acquisition strategies.Required Skills & Qualifications:Proficiency in Python and 2 years of experience in web scraping frameworks.Strong knowledge of browser automation tools.Solid understanding of HTML, CSS, and selector languages (XPath/CSS).Experience in handling anti-scraping challenges and ensuring robust data extraction.Familiarity with distributed scraping techniques and data pipelines.Ability to troubleshoot and optimize web crawlers for performance and reliability.Strong analytical and problem-solving skills with attention to detail.Excellent communication and inter-personal skills.

  • Highly Experienced Python Web Crawler Developer Wanted

    4 days ago

    bangalore, India beBeePython Full time

    Job OpportunityJob SummaryWe are seeking an experienced Senior Python Developer to join our team.This role involves developing and maintaining efficient web crawlers with a focus on speed, performance, and scalability.The ideal candidate will have strong coding skills in Python and a good understanding of how web pages, HTTP, and crawlers work.They should...

  • Web Crawling Specialist

    3 days ago

    bangalore, India beBeeWebCrawler Full time

    Job Opportunity: Web Crawling SpecialistWe are seeking an experienced Web Crawling Specialist to join our team and contribute to the development of innovative web crawling solutions.The ideal candidate will have strong expertise in Python programming, particularly in web scraping frameworks such as Scrapy. Experience with browser automation tools like...

  • Expert Web Data Extractor

    1 week ago

    bangalore, India beBeeWebCrawling Full time

    Web Crawling DeveloperWe are seeking a skilled professional to build and maintain web crawlers, extract valuable insights from the web, and ensure data quality.The ideal candidate has strong programming skills in Python and experience with web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.Maintain and enhance existing...

  • Web Crawling Engineer

    3 days ago

    bangalore, India Forage AI Full time

    We are seeking a Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. Salary budget...

  • Senior Python Developer

    2 days ago

    bangalore, India DBiz.ai Full time

    Responsibilities:Develop and maintain efficient web crawlers with a focus on speed, performance, and scalability.Write clean, reusable, and optimized Python code for large-scale data extraction.Analyze and understand website structures, implement logic to handle dynamic and JS-rendered pages.Troubleshoot and debug crawl issues, optimize request handling, and...

  • Senior Python Developer

    3 weeks ago

    bangalore, India DBiz.ai Full time

    Responsibilities: Develop and maintain efficient web crawlers with a focus on speed, performance, and scalability . Write clean, reusable, and optimized Python code for large-scale data extraction. Analyze and understand website structures, implement logic to handle dynamic and JS-rendered pages . Troubleshoot and debug crawl issues, optimize request...

  • Senior Web Automation Specialist

    2 weeks ago

    bangalore, India beBeeWebAutomation Full time

    Senior Web Automation SpecialistWe are seeking a highly skilled Senior Web Automation Specialist to join our team. As a key member of our automation team, you will be responsible for designing and developing high-scale automated web scraping workflows for dynamic and protected websites.Your primary focus will be on implementing browser automation solutions...

  • Senior Web Architecture Specialist

    3 days ago

    bangalore, India beBeeWeb Full time

    Job SummaryWe are seeking a seasoned Senior Web Architecture Specialist to lead the development of scalable, robust, and high-performance web applications.About the RoleThis is an exceptional opportunity for a highly skilled and experienced professional to spearhead the design, development, and deployment of cutting-edge full-stack solutions.Main...

  • Web Development Specialist

    4 days ago

    bangalore, India beBeeDeveloper Full time

    Web Development Specialist RoleWe are seeking a skilled professional to join our team as a Web Development Specialist. This role involves designing, developing, and maintaining scalable web applications using ASP.NET MVC and C#. The ideal candidate will have hands-on experience in both backend and frontend technologies, including Angular.The key...

  • Data Pipeline Architect

    1 week ago

    bangalore, India beBeeDataSpecialist Full time

    Senior Data SpecialistWe are seeking a highly skilled Senior Data Specialist with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our team.Design, develop, and maintain scalable ETL/ELT pipelines using PySpark and AWS Glue.Build and optimize data models in Snowflake to support reporting, analytics, and machine learning...