Senior Data Extraction Engineer

2 days ago

Alleppey, Kerala, India beBeeCrawling Full time ₹ 10,00,000 - ₹ 15,00,000
Job Opportunity

We are seeking a Web Crawling Specialist who will be responsible for developing and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality.

The ideal candidate will have strong programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms.

About Us

We are a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence.

Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly accurate firmographic and enterprise insights across numerous domains.

We enable businesses to automate workflows, reduce manual rework, and access high-quality data at scale.

Key Responsibilities:
  • Maintain and enhance existing web scraping projects.
  • Develop and refine crawlers using Python-based tools and frameworks.
  • Utilize browser automation tools (e.g., Playwright, Selenium) to handle dynamic content.
  • Clean, validate, and integrate extracted data into downstream storage systems.
  • Implement and manage solutions for anti-bot measures (CAPTCHAs, IP rotation, etc.).
  • Optimize crawling efficiency and ensure compliance with web crawling best practices.
Required Skills & Qualifications:
  • Proficiency in Python and 2 years of work experience of web scraping frameworks (especially Scrapy).
  • Strong knowledge of browser automation tools such as Playwright or Selenium.
  • Solid understanding of HTML, CSS, and selector languages (XPath/CSS).
  • Experience in handling anti-scraping challenges and ensuring robust data extraction.
  • Familiarity with distributed scraping techniques and data pipelines.
  • Ability to troubleshoot and optimize web crawlers for performance and reliability.
  • Strong analytical and problem-solving skills with attention to detail.
Infrastructure Requirements:

Able to work efficiently from home, you will require -

High-speed internet connectivity for video calls and efficient work.

Capable business-grade computer (e.g., modern processor, 8 GB+ of RAM).

Headphones with clear audio quality.

Stable power connection and backups in case of internet/power failure.

  • Senior Data Architect

    1 week ago

    Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Architect">About the Role:">As a senior data architect, you will be responsible for designing and building scalable data architectures to support business growth. Your focus will be on extracting every drop of value from powerful marketing platforms.">The Mission:">Your mission is to uncover hidden 90% of tool capabilities, from...

  • Strategic Data Architect

    5 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Key Data Engineer PositionAbout the Role:We are seeking a highly skilled and experienced Data Analyst to join our team as a Marketing Platform Specialist. This role requires someone who is passionate about extracting valuable insights from marketing platforms.The Mission:As a Senior Data Engineer, your primary focus will be on extracting every drop of value...

  • Senior Data Engineer

    2 hours ago

    Alleppey, Kerala, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong...

  • Data Engineering Expert

    2 days ago

    Alleppey, Kerala, India beBeeExpertise Full time ₹ 20,00,000 - ₹ 30,00,000

    Job OverviewA data engineering expert is sought to spearhead data extraction, analysis, and visualization efforts utilizing the Google Cloud stack.Key ResponsibilitiesData Extraction & Analysis: Collaborate with Google BigQuery/Google SQL to query and manipulate data. Develop Python, Go, or Perl scripts to extract, transform, and update...

  • Data Engineering Lead

    10 hours ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    About the RoleWe are seeking an experienced and skilled Data Engineer to lead our analytics team. This role is ideal for someone with a strong background in log-level data handling, cross-platform data engineering, and a solid command of modern business intelligence tools.This is a leadership position requiring at least 1–2 years of experience in data...

  • Data Engineer Expertise Wanted

    10 hours ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 16,50,000 - ₹ 25,17,500

    Key Data Engineer RoleWe are seeking a skilled Data Engineer to design and implement data pipelines from Oracle Symphony into Databricks Lakehouse.Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data.Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and...

  • Senior Data Automation Specialist

    1 week ago

    Alleppey, Kerala, India beBeeDataAutomation Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Opportunity:We are seeking a highly skilled technical expert to embark on an ambitious long-term project. This mission requires the ability to bypass complex data access challenges with advanced technical skills, reliability, and creativity.About the Project:The goal is to build a comprehensive data system involving extraction and structuring from...

  • Chief Data Engineer

    6 days ago

    Alleppey, Kerala, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Role:A seasoned Data Architect is required to design and develop cutting-edge ETL processes using Databricks PySpark. In this role, you will be responsible for creating scalable data pipelines that extract, transform, and load data from diverse sources into our data lake and warehouse.Key Responsibilities:Design and implement ETL workflows using...

  • Senior Oracle Demantra Consultant

    2 days ago

    Alleppey, Kerala, India beBeeOracleDemantraExpert Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Oracle Demantra ExpertWe are seeking a seasoned professional to lead the implementation and support of Oracle Demantra modules, including Demand Management, Predictive Trade Planning, and Deductions & Settlement Management (DSM).The ideal candidate will have extensive hands-on experience with Oracle Demantra and a strong understanding of forecasting...

  • Unlock the Power of Big Data as a Senior Data Engineer

    5 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to join our team.This is a full-time role for a highly experienced ETL Developer based in Bengaluru, working with one of our esteemed overseas clients. The role involves understanding requirements, designing, developing, and testing of ETL architecture, transformation jobs, and workflow...