Data Crawling Specialist

2 days ago

Gandhinagar, India beBeeCrawler Full time

Web Crawler Developer PositionWe are seeking a skilled Web Crawler Developer to join our team and contribute to the development of efficient data crawling systems.Maintain and enhance existing web scraping projects using Python-based tools and frameworksDesign and implement crawlers that can handle dynamic content using browser automation tools (e.g., Playwright, Selenium)Clean and validate extracted data for downstream storage systemsImplement solutions for anti-bot measures (CAPTCHAs, IP rotation, etc.)Orientate web crawler efficiency and ensure compliance with web crawling best practicesRequired Skills:Programming Skills: Proficient in Python programming language and familiar with popular libraries and frameworksWeb Scraping Knowledge: Experienced in web scraping techniques, including handling anti-scraping mechanismsBrowser Automation Tools: Skilled in utilizing browser automation tools like Playwright and SeleniumData Integration: Able to clean, validate, and integrate extracted data into downstream storage systemsProblem-Solving: Strong analytical and problem-solving skills to optimize crawling efficiency and address complex issuesCollaboration: Ability to work collaboratively with cross-functional teams to improve data acquisition strategies

  • Data Engineering Leader

    6 days ago

    Gandhinagar, India beBeeDataEngineering Full time

    Job OverviewAchieve success as a data engineering leader by overseeing the design, implementation, and optimization of scalable data pipelines.Lead cross-functional teams to drive innovation in web crawling technologies.Architect robust data systems using modern frameworks and tools.Establish process orchestration using Airflow or Celery.Develop and enforce...

  • Senior Web Data Analyst

    6 days ago

    gandhinagar, India beBeeDataExtractor Full time

    Job OverviewWe are seeking a seasoned Web Information Extractor to spearhead the development and maintenance of web crawling technologies, driving innovation in data extraction and quality assurance.Maintain and enhance existing web scraping projects leveraging Python-based tools and frameworks to optimize performance.Design and refine crawlers using...

  • Data Insights Specialist

    6 days ago

    Gandhinagar, India beBeeMarketing Full time

    Job Title: Data Insights SpecialistWe are seeking a skilled Data Insights Specialist to analyze Ads performance, build Looker dashboards, and drive business growth.Key Responsibilities:Review monthly performance data, extract valuable insights, and provide actionable recommendations to stakeholders.Conduct in-depth analysis projects with significant...

  • Data Migration Specialist

    3 days ago

    Gandhinagar, India beBeeMigration Full time

    Migrate SAP Data SeamlesslyThe role of SDT Specialist involves leading the migration from SAP ECC to S/4HANA. A seasoned specialist with hands-on experience in Shell Conversion is required.Main responsibilities include developing data transfer strategies, analyzing system landscapes, and executing technical migrations using SLT, DMO, and SLO tools.Close...

  • Cloud Data Specialist

    3 days ago

    Gandhinagar, India beBeeData Full time

    Cloud Data SpecialistOur organization is seeking a seasoned Cloud Data Specialist to spearhead the implementation of data engineering and analytics solutions.Minimum 5 years of experience in data engineering and analytics.Proficiency in Google Cloud Platform services such as Dataflow, Big Query, Storage Classes, and PySpark/Python.Expertise in Airflow for...

  • Software Design Expert

    2 days ago

    Gandhinagar, India beBeeSoftwareDesign Full time

    Job Title: Software Design ExpertA highly skilled software design expert is required to lead the development of cloud native technologies. The ideal candidate will have experience with data crawling, bot detection avoidance techniques, and the use of virtual private networks.Key Responsibilities:Data/Content Crawling from public InternetExpertise in data...

  • Data Ingestion Specialist

    7 days ago

    gandhinagar, India beBeeDatabricks Full time

    **Azure Databricks Developer Role**As a skilled Data Ingestion Specialist, you will be responsible for managing data pipelines using both batch and real-time processes. This role requires expertise in Microsoft Azure services, including Data Factory, Storage, Synapse, and Key Vault.Azure Service Expertise: Strong knowledge of Microsoft Azure services,...

  • AI Training Data Specialist

    9 hours ago

    Gandhinagar, India beBeeDataContent Full time

    Job Title: Data Content SpecialistOverview: As a Data Content Specialist, you will play a crucial role in ensuring the accuracy and consistency of online content. Your primary responsibility will be to review and label sensitive online content, providing valuable insights for AI innovation.Key Responsibilities:Review and label sensitive online content to...

  • Data Insights Specialist

    6 days ago

    Gandhinagar, India beBeeData Full time

    Job Title:Data Insights SpecialistAbout the Role:We are seeking a skilled Data Insights Specialist to join our team. The successful candidate will be responsible for collecting, analyzing, and interpreting complex datasets to provide actionable insights that drive business growth.Key Responsibilities:Reporting and Analysis:Develop detailed reports using data...

  • Data Architect Specialist

    6 days ago

    Gandhinagar, India beBeeData Full time

    Data Architect SpecialistAt our organization, we design, develop, and optimize large-scale data systems and cloud-based solutions.We are seeking a Data Architect Specialist to join our team who can leverage Python for data engineering tasks and has hands-on experience designing ETL/ELT pipelines.The ideal candidate will have expertise in AWS cloud services...