Web Scraping Specialist

6 days ago

Jaipur, Rajasthan, India beBeeDataMining Full time ₹ 90,00,000 - ₹ 1,20,00,000

Data Mining Analyst Job Summary:

We are seeking a highly skilled Data Mining Analyst to join our team. In this role, you will be responsible for designing and implementing efficient and scalable data scraping systems.

About the Role:

This is a challenging opportunity for an experienced Data Mining Analyst to work with large datasets and develop innovative solutions to extract valuable insights.

Main Responsibilities:

  • Design and develop robust web scraping solutions to extract structured and unstructured data from various websites and APIs.
  • Use Python, Selenium, BeautifulSoup, Scrapy, and Pandas for data scraping and processing.
  • Build and manage automated scripts to scrape dynamic websites, including handling JavaScript-driven content.
  • Optimize scraping workflows to ensure data extraction is efficient, accurate, and scalable.
  • Work with APIs to gather and integrate data, ensuring proper rate limits and authentication handling.
  • Clean, preprocess, and store extracted data in databases (SQL) or cloud-based systems.
  • Collaborate with data analysts and other stakeholders to provide required data for further analysis and reporting.
  • Debug and troubleshoot issues in scraping pipelines and scripts.
  • Ensure compliance with ethical data scraping standards, including legal considerations like website terms of use and robots.txt policies.

Requirements:

  • Experience: 2-3 years of hands-on experience in web scraping and data extraction.

Skills:

  • Strong proficiency in Python.
  • Experience with web scraping frameworks and libraries like Selenium, Scrapy, BeautifulSoup, and Requests.
  • Experience with data manipulation libraries like Pandas.
  • Familiarity with API integration (REST, GraphQL, etc.).
  • Proficiency in SQL for data querying, database design, and managing large datasets.
  • Knowledge of JavaScript and front-end technologies to work with dynamic web pages.
  • Experience with version control (Git) and collaborative development environments.

Nice to Have:

  • Experience with cloud-based scraping tools or services (e.g., AWS Lambda, Google Cloud Functions).
  • Familiarity with distributed scraping and data pipeline management.
  • Experience with large-scale data collection and storage systems.
  • Knowledge of ethical and legal issues related to web scraping.

  • Senior Web Scraping Solutions Developer

    1 week ago

    Jaipur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Scraping LeaderLocation: WFO / AhmedabadExperience Level: Senior (4+ years)Employment Type: Full-time OverviewThis is an opportunity to lead a team of developers in designing and developing scalable data scraping solutions.As a seasoned technologist, you will be responsible for managing project timelines, ensuring code quality, and...

  • Senior Web Scraping Python Developer

    2 weeks ago

    Jaipur, Rajasthan, India beBeeScraping Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Python Developer - Web ScrapingWe're seeking a skilled Senior Python Developer to design, develop, and maintain scalable web scraping frameworks using Scrapy.The ideal candidate will have 2+ years of experience in Python development with Scrapy expertise and proficiency with automation libraries such as Playwright or...

  • Web Crawler Specialist

    1 week ago

    Jaipur, Rajasthan, India beBeeWebCrawler Full time ₹ 90,00,000 - ₹ 1,20,00,000

    **Job Opportunity:** Web Crawler SpecialistWe are seeking a skilled and experienced Web Crawler Specialist to join our team. The ideal candidate will be responsible for designing, developing, and maintaining web crawlers to extract valuable insights from the web.Key Responsibilities:Design and develop web crawlers using Python-based tools and...

  • Data Insight Analyst

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDataMining Full time ₹ 9,00,000 - ₹ 12,00,000

    Unlock Data Insights: Data Mining SpecialistWe are seeking a highly skilled Data Mining Specialist to join our team. In this challenging role, you will be responsible for automating data extraction processes from web platforms.Main Responsibilities:Create and maintain robust web scraping solutions to extract structured and unstructured data from various...

  • Software Data Extractor

    1 week ago

    Jaipur, Rajasthan, India beBeeDataExtraction Full time ₹ 8,00,000 - ₹ 12,00,000

    Data Extraction Specialist">We are seeking an experienced professional with expertise in web scraping and Optical Character Recognition (OCR) to design and optimize data extraction solutions.">Develop and maintain scalable scripts for web scraping from structured and unstructured sources.Implement OCR solutions to extract text/data from scanned images, PDFs,...

  • Extracting Valuable Insights

    7 days ago

    Jaipur, Rajasthan, India beBeeDataInsights Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Data Insights SpecialistThis is a key role at our organization where we seek an experienced professional to work on automating data extraction processes from web platforms. The ideal candidate will have expertise in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems.The...

  • Web Specialist

    1 week ago

    Jaipur, Rajasthan, India 4iQ Institute Official Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company Description4iQ Institute Official provides opportunities to build careers in the IT & Tech sectors through a wide range of job-oriented courses. Our offerings include Ethical Hacking, Digital Marketing, Graphic Design, Video Editing, Software Development, E-Commerce, YouTube Mastery, WordPress Development, Web Development, and various programming...

  • Automated Sales Lead Generation Specialist

    2 weeks ago

    Jaipur, Rajasthan, India beBeeAutomation Full time ₹ 7,50,000 - ₹ 10,00,000

    Sales Automation Expert WantedWe are seeking a skilled n8n developer to build, test, and deploy an AI-powered sales and lead generation workflow. The goal is to automate the process from initial company identification to personalized email outreach.The ideal candidate will have experience with complex workflows in n8n and strong proficiency with REST APIs,...

  • Data Engineering Innovator

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Senior Data Engineering LeaderWe are seeking a seasoned professional to lead our data engineering efforts. As a Senior Data Engineering Leader, you will oversee the development and implementation of scalable data scraping solutions using cutting-edge tools like Scrapy and Python libraries.This is an exceptional opportunity to utilize your expertise in...

  • Web Application Specialist

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDeveloper Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title: Web Application SpecialistWe are seeking an experienced and skilled Web Application Specialist to join our team. In this role, you will be responsible for developing and maintaining user-facing features, ensuring the technical feasibility of UI/UX designs, optimizing applications for maximum speed and scalability, and collaborating with other team...