Crawling Data Professional

7 days ago

Ellore, Andhra Pradesh, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

Job Overview

We are seeking a skilled professional to join our team as a Junior Web Crawling Engineer. This role involves building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.

About the Role:

  • Maintain and enhance existing web scraping and data crawling projects.
  • Develop and refine crawlers using Python-based tools and frameworks.
  • Utilize browser automation tools to handle dynamic content.
  • Clean, validate, and integrate extracted data into downstream storage systems.
  • Implement and manage solutions for anti-bot measures.
  • Optimize crawling efficiency and ensure compliance with web crawling best practices.
  • Collaborate with cross-functional teams to improve data acquisition strategies.

Key Skills and Qualifications

  • Proficiency in Python and 2 years of work experience in web scraping frameworks.
  • Strong knowledge of browser automation tools such as Playwright or Selenium.
  • Solid understanding of HTML, CSS, and selector languages.
  • Experience in handling anti-scraping challenges and ensuring robust data extraction.
  • Familiarity with distributed scraping techniques and data pipelines.
  • Ability to troubleshoot and optimize web crawlers for performance and reliability.
  • Strong analytical and problem-solving skills with attention to detail.

Requirements

  • A high-speed internet connection for video calls and efficient work.
  • A capable business-grade computer.
  • Headphones with clear audio quality.
  • A stable power connection and backups in case of internet/power failure.

  • Expert Data Pipeline Developer

    3 days ago

    Ellore, Andhra Pradesh, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity:Senior Backend EngineerWe are seeking a skilled professional to design and develop data pipelines, crawl/fetch data from external systems, and connect interfaces.Pipelines development using API-first approach with playwright/requestsData parsing/normalization, deduplication/delta logic, and embeddings/similarity searchIntegrations with...

  • AI Innovation Leader

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeArtificial Full time ₹ 50,000 - ₹ 70,000

    We are seeking a highly skilled Senior AI/ML Developer to design and build an intelligent system that can interact with websites, perform smart actions, and extract data automatically.Key Responsibilities:Create an AI-powered web automation system capable of interacting with websites intelligently.Develop web crawling, scraping, and automation workflows...

  • Data Professional

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeDataAnalysis Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Opportunity: Senior Data AnalystWe are seeking an accomplished data professional to join our team as a Senior Data Analyst.The ideal candidate will have extensive experience in both Java and Python programming, with a strong track record of delivering business insights through data extraction, transformation, analysis, and reporting.A key responsibility...

  • Senior Web Data Engineer

    3 days ago

    Ellore, Andhra Pradesh, India beBeeDataIngestion Full time ₹ 13,07,000 - ₹ 18,34,000

    High-Throughput Product Data Ingestion Pipeline EngineerWe're building a high-throughput product data ingestion pipeline across hundreds of domains. This involves designing an HTTP-first crawler with a Playwright fallback for JavaScript-heavy pages, implementing sitemap diffing and conditional GETs for incremental runs, and enforcing per-domain throttles and...

  • Data Insights Professional

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataInsights Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Insights ProfessionalAbout the RoleWe are seeking a skilled Data Insights Professional to join our team. As a key member of our analytics group, you will be responsible for extracting valuable insights from data to inform business decisions.Key Responsibilities:Analyse sales trends, customer behaviour, and market performance to identify...

  • Data Professional

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Your Data PotentialAt Lingaro, we're looking for a highly skilled professional to join our DS/AI Competency Center as a key member of the team. You will leverage data, analytics, and AI technologies to extract insights, build predictive models, and develop AI-powered solutions that drive business value.About the Role:Leverage exploratory data...

  • Data Engineering Professional

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalAbout the Role:We are seeking a skilled data engineer to build scalable and reliable data pipelines using modern cloud and big data platforms.

  • Data Architecture Professional

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataArchitecture Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Data Architecture ProfessionalWe are seeking an experienced Data Architecture Professional to join our team.About the Role:This is a senior-level position responsible for designing and implementing data architectures on the Amazon Web Services (AWS) platform.The ideal candidate will have extensive experience with AWS-native services such as Glue,...

  • Data and Analytics Professional

    4 days ago

    Ellore, Andhra Pradesh, India beBeeDataAnalytics Full time US$ 80,000 - US$ 1,50,000

    **Job Title:** Data and Analytics ProfessionalDescription:We are seeking a skilled Data and Analytics professional to develop StreamSets pipeline and drive data integrations of new AI tools in our hybrid cloud environment.About the Role:This is a remote position that requires strong analytical skills, experience with data pipelines, and knowledge of IBM...

  • Building Scalable Solutions

    21 hours ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Engineer to help build our technology platform from the ground up. As a key team member, you will shape our tech vision, architecture, and engineering culture while contributing to foundational development.This role is ideal for someone eager to own the entire tech stack and thrive in an early-stage environment. You will be...