High-Performance Data Extractor

2 days ago


India beBeeWeb Full time ₹ 6,00,000 - ₹ 8,00,000
Job Description

We are seeking a skilled Web Scraping Engineer to join our team. This is an exciting opportunity to build a high-throughput product data ingestion pipeline across hundreds of domains.

As a Senior Web Scraping Engineer, you will own the crawling/extraction layer end-to-end: crawling with a fallback, per-domain learned selectors, and reliable PDF handling (datasheets/specs). You will also drive automation around scheduling, retries, and monitoring so runs are hands-off, and you will integrate vendor/public APIs wherever available to complement crawling.

This role spans crawling (discovering & fetching pages via sitemaps/robots) and scraping (extracting structured specs, images, and PDFs into our schema).

  1. Design a crawler (Scrapy or aio with a Playwright fallback only for JS-heavy pages)
  2. Implement sitemap diffing and conditional GETs (ETag/Last-Modified) for incremental runs
  3. Build a lightweight


  • India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering RoleWe are seeking a talented data engineer to design and build high-performance data pipelines that process large datasets. As a key member of our team, you will optimize existing systems, identify performance bottlenecks, and implement solutions to improve efficiency.


  • India beBeeData Full time ₹ 1,50,000 - ₹ 28,00,000

    Job Title: Data EngineerAbout This RoleWe are seeking a skilled Data Engineer to join our team. In this role, you will play a critical part in designing, building, and operating scalable data infrastructure to support large-scale applications.The ideal candidate will have deep expertise in distributed computing frameworks, cloud infrastructure, data storage...


  • India beBeeBw Full time ₹ 17,43,000 - ₹ 23,59,000

    BW 4 HANA Developer RoleAs a senior professional in our organization, you will be responsible for designing and implementing solutions that meet development standards. Your primary focus will be on performing developmental and testing tasks for larger projects, providing accurate estimates for these phases.Key Responsibilities:Analyze enhancement requests...


  • India beBeeData Full time ₹ 4,00,000 - ₹ 8,00,000

    Data Engineering RoleWe are seeking a seasoned Data Engineer to spearhead the development of our technology platform from scratch.This is an exceptional opportunity for a visionary professional to shape the technology vision, architecture, and engineering culture of our organization right from the ground up.You will contribute directly to foundational...


  • India beBeeData Full time ₹ 7,50,000 - ₹ 15,00,000

    Web Crawling Engineer PositionWe are seeking a skilled Web Crawling Engineer who will be responsible for designing and implementing web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling...


  • India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data EngineerWe are looking for a talented professional to design, build, and maintain high-performance data pipelines that process terabytes of data. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.About the JobThis role involves designing and...


  • India beBeeBigDataDeveloper Full time ₹ 14,24,000 - ₹ 23,12,000

    Job DescriptionWe're a company driven by purpose, dedicated to creating solutions that safeguard people, places, and communities.For over 23 years, law enforcement and federal agencies have trusted us as their partner in keeping nations and enriching lives.We envision the future of intelligence gathering through AI and machine learning-based solutions that...

  • SAP Berater

    6 days ago


    India People Prime Worldwide Full time

    Our is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA). · Job Title: SAP Datasphere...


  • India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Description:">We are seeking a highly skilled professional to join our team as a Data Engineer. As a key member of our technical staff, you will be responsible for designing, developing, and deploying large-scale data processing systems."">Key Responsibilities:">Design and develop high-performance data processing pipelines using Apache Spark and...


  • India beBeeDataExchange Full time ₹ 20,00,000 - ₹ 25,00,000

    High-Performance Data Exchange Platform Specialist">Job DescriptionExciting opportunities await talented professionals to take on a challenging role in a cutting-edge data exchange platform.Key ResponsibilitiesDesign, implement, and manage the data exchange process between systems, ensuring seamless integration and high performance.Develop and maintain...