Senior Web Scraping Developer

14 hours ago

Ahmedabad, Gujarat, India beBeeDataMining Full time ₹ 7,50,000 - ₹ 12,50,000
Job Summary

We are seeking a skilled Data Scientist with expertise in automating data extraction processes from web platforms.

The ideal candidate will be experienced in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable data scraping systems.

Key Responsibilities:

  • Design, develop, and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs.
  • Use tools like Python, Selenium, BeautifulSoup, Scrapy, and Pandas for data scraping and processing.
  • Build and manage automated scripts to scrape dynamic websites, including handling JavaScript-driven content.
  • Optimize scraping workflows to ensure data extraction is efficient, accurate, and scalable.
  • Work with APIs to gather and integrate data, ensuring proper rate limits and authentication handling.
  • Clean, preprocess, and store extracted data in databases (SQL) or cloud-based systems.
  • Collaborate with data analysts and other stakeholders to provide required data for further analysis and reporting.
  • Debug and troubleshoot issues in scraping pipelines and scripts.
  • Ensure compliance with ethical data scraping standards, including legal considerations like website terms of use and robots.txt policies.
Required Skills & Qualifications
  • Experience: 1-3 years of hands-on experience in web scraping and data extraction.
  • Strong proficiency in Python.
  • Experience with web scraping frameworks and libraries like Selenium, Scrapy, BeautifulSoup, and Requests.
  • Experience with data manipulation libraries like Pandas.
  • Familiarity with API integration (REST, GraphQL, etc.).
  • Proficiency in SQL for data querying, database design, and managing large datasets.
  • Knowledge of JavaScript and front-end technologies to work with dynamic web pages.
  • Experience with version control (Git) and collaborative development environments.

  • Senior Python Web Scraping Specialist

    12 hours ago

    Ahmedabad, Gujarat, India beBeePython Full time ₹ 9,00,000 - ₹ 12,00,000

    About Our Job OpportunityWe are seeking a talented professional to fill a critical role in our organization.Job OverviewAs a Senior Python Developer, you will play a key part in designing and developing scalable web scraping frameworks using Scrapy. Your expertise in automation libraries such as Playwright or Selenium will be invaluable in achieving project...

  • Senior Software Developer

    5 days ago

    Ahmedabad, Gujarat, India beBeeDataScientist Full time US$ 70,000 - US$ 1,00,000

    We are seeking a skilled software developer to join our team. In this role, you will collaborate with individuals across various departments to shape and innovate new products and features for our platform, enhancing existing ones.This is a meritocratic environment where you will have a large degree of independence and trust. You won't be isolated; the...

  • Technical Lead

    2 weeks ago

    Ahmedabad, Gujarat, India Actowiz Solutions Full time

    We're Hiring – Tech Lead (Web Scraping)Company: Actowiz SolutionsLocation: Ahmedabad (Work from Office)Experience Required: 4+ years in IT scraping & 2+ years leading teams of 5+ developersWhy Join Us?At Actowiz Solutions, you'll lead talented developers, solve complex scraping challenges, and deliver high-impact, large-scale data solutions for clients...

  • Technical Lead

    3 weeks ago

    Ahmedabad, Gujarat, India Actowiz Solutions Full time

    We're Hiring – Tech Lead (Web Scraping)Company: Actowiz SolutionsLocation: Ahmedabad (Work from Office)Experience Required: 4+ years in IT scraping & 2+ years leading teams of 5+ developersWhy Join Us?At Actowiz Solutions, you'll lead talented developers, solve complex scraping challenges, and deliver high-impact, large-scale data solutions for clients...

  • Technical Lead

    3 weeks ago

    Ahmedabad, Gujarat, India Actowiz Solutions Full time

    We're Hiring – Tech Lead (Web Scraping) Company: Actowiz Solutions Location: Ahmedabad (Work from Office) Experience Required: 4+ years in IT scraping & 2+ years leading teams of 5+ developers Why Join Us? At Actowiz Solutions, you'll lead talented developers, solve complex scraping challenges, and deliver high-impact, large-scale data solutions...

  • Technical Lead

    2 weeks ago

    Ahmedabad, Gujarat, India Actowiz Solutions Full time

    We're Hiring – Tech Lead (Web Scraping) Company: Actowiz Solutions Location: Ahmedabad (Work from Office) Experience Required: 4+ years in IT scraping & 2+ years leading teams of 5+ developers Why Join Us? At Actowiz Solutions, you'll lead talented developers, solve complex scraping challenges, and deliver high-impact, large-scale data solutions...

  • Data Extraction Specialist

    1 day ago

    Ahmedabad, Gujarat, India beBeeScraping Full time ₹ 20,00,000 - ₹ 25,00,000

    Lead Data Scraping EngineerWe are seeking an experienced professional to join our team as a Lead Data Scraping Engineer. The ideal candidate will have at least 4 years of hands-on experience in IT scraping, with a minimum of 2 years leading a team of 5+ developers.Responsibilities include designing and developing scalable data scraping solutions using tools...

  • Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Alternative Path Full time

    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but...

  • Data Extraction Expert Wanted

    2 days ago

    Ahmedabad, Gujarat, India beBeeWebScraping Full time ₹ 8,00,000 - ₹ 10,00,000

    Experienced Web Scraping Specialist WantedWe are seeking a highly skilled and experienced freelancer to develop an advanced technical system for data extraction and structuring from various online sources.About the ProjectThe project involves building a strategic data system that requires extraction and structuring of dynamic content, custom headers, request...

  • Senior Web Development Specialist

    2 days ago

    Ahmedabad, Gujarat, India beBeeDevelopment Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title:Senior Web Development SpecialistAs a seasoned web development expert, you will be responsible for rebuilding custom Kentico components in ASP.NET Core MVC to ensure modern architecture and enhanced performance.Key Responsibilities:Rebuild custom Kentico components using ASP.NET Core MVC, ensuring modern architecture and enhanced performance.Create...