Web Data Extraction Specialist

2 days ago

Erode, Tamil Nadu, India beBeeDataExtraction Full time ₹ 1,00,00,000 - ₹ 1,50,00,000
Job Description

We're looking for a skilled Web Data Extraction Specialist to join our team. In this role, you will design and implement an efficient web crawling system to extract structured data from multiple domains. Your primary goal will be to develop scalable and reliable software solutions to meet the demands of our high-throughput product data ingestion pipeline.



Required Skills and Qualifications

To succeed in this position, you'll need to possess:

  • Strong Python skills, with 4+ years of experience in building production web crawlers at scale.
  • Practical knowledge of Scrapy or aiohttp/asyncio and Playwright (or Puppeteer) in production environments.
  • Experience with proxy management, polite anti-bot tactics, and per-domain rate limiting.
  • Hands-on understanding of ETag/Last-Modified, retries, backoff, and HTTP caching.
  • Confident CSS/XPath, schema.org/JSON-LD, and HTML parsing skills.
  • Familiarity with APIs: consuming REST/GraphQL (auth, pagination, backoff) and building small internal services (FastAPI or similar).
  • Automation/Orchestration: Airflow/Temporal/Celery (or equivalent schedulers/queues) for scheduled runs and monitoring.
  • PDF handling (requests/HEAD, hashing, size limits) and file integrity checks.
  • Queues (Redis/Kafka), Docker, Linux basics; comfort with logs/metrics.


Benefits

This role offers competitive compensation. If you're passionate about web scraping and data extraction, we encourage you to apply with your resume and links to relevant projects or code samples. Please include concise notes on a crawler you've run at scale, how you handled rate limits/retries, and your approach to PDF discovery/deduplication.



How We Work

We value simple designs that are easy to operate at scale. Our development process emphasizes shipping in small, measurable increments and tracking coverage and freshness as north-star metrics.

  • Data Extraction Specialist

    1 week ago

    Erode, Tamil Nadu, India beBeeDataExtraction Full time ₹ 12,00,000 - ₹ 16,00,000

    Job Title: Data Extraction SpecialistA key role for a skilled professional with expertise in automating data extraction processes from web platforms.Key Responsibilities:Design and develop robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Utilize tools like Python, Selenium, BeautifulSoup, Scrapy, and...

  • Extract Specialist

    5 days ago

    Erode, Tamil Nadu, India beBeeextract Full time ₹ 20,00,000 - ₹ 25,00,000

    \Job Title: Extract Specialist\We are seeking a highly skilled professional with expertise in Oracle HCM Tech and functional knowledge of Compensation and Equity area.\Key Responsibilities:\Designing and implementing extract solutions using core expertise in HCM extract, API integration, and imports.Providing hands-on expertise with Oracle HCM tools such as...

  • Web Data Automation Specialist

    2 weeks ago

    Erode, Tamil Nadu, India beBeeDataExtractor Full time ₹ 10,00,000 - ₹ 15,00,000

    Expert Data Extractor Wanted for Long-Term ProjectWe're seeking a seasoned data automation specialist for an ongoing project requiring advanced technical skills, reliability, and creativity to bypass complex data access challenges.About the Mission:We're building a strategic data system involving extraction and structuring from various online sources with...

  • Senior Data Analyst Specialist

    4 days ago

    Erode, Tamil Nadu, India beBeeDataAnalyst Full time ₹ 90,00,000 - ₹ 1,20,00,000

    **Job Description:**We are seeking a skilled data analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems.**Key Responsibilities:**Designing, developing, and...

  • Senior Data Extraction Specialist

    2 weeks ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking a seasoned technical leader to spearhead our data scraping operations.The ideal candidate will have a strong background in IT scraping, with at least 4 years of experience and 2 years of leadership experience managing a team of 5+ developers.Design and develop scalable data scraping solutions using tools like Scrapy and Python...

  • Business Insights Specialist

    5 days ago

    Erode, Tamil Nadu, India beBeeDataAnalyst Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Title: Business Insights SpecialistAbout the Role:We are seeking an experienced and skilled business insights specialist with strong expertise in data analysis, Python programming, and hands-on experience in handling large datasets, data cleaning, transformation, and visualization. The ideal candidate should be capable of building efficient data...

  • Senior Data Scientist Position

    5 days ago

    Erode, Tamil Nadu, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Expert Data Extraction SolutionsWe are seeking a seasoned professional to craft innovative data extraction solutions. As a key player, you will design and optimize scalable scripts for web scraping and OCR.The ideal candidate will possess expert-level proficiency in Python programming and hands-on experience with web scraping frameworks (BeautifulSoup,...

  • Unlocking Data Insights

    7 days ago

    Erode, Tamil Nadu, India beBeeAnalytics Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Web Analytics Specialist Job SummaryWe are seeking an experienced Web Analytics Specialist to join our team. The successful candidate will lead the end-to-end tracking and analytics setup for our web platform.The ideal candidate will have a strong understanding of event-based analytics, conversion funnels, and A/B testing methodologies.A proven track record...

  • Web Development Specialist

    2 days ago

    Erode, Tamil Nadu, India beBeeSpecialist Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job OverviewWe are seeking a skilled Web Development Specialist to contribute to our team's success. As a Web Development Specialist, you will be responsible for building high-quality, reusable web modules that meet customer requirements.You will collaborate with cross-functional teams to ensure seamless integration and delivery of web applications.You will...

  • Web Crawling Developer Position

    5 days ago

    Erode, Tamil Nadu, India beBeeCrawler Full time US$ 80,000 - US$ 1,50,000

    We are seeking a Web Crawling Developer to join our team. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.About this role:Maintain and enhance existing web scraping and data crawling projects using Python-based tools and...