Senior Web Scraping Developer

1 day ago

Jamnagar, Gujarat, India beBeeDeveloper Full time ₹ 18,00,000 - ₹ 24,00,000

Job Overview:

We seek an experienced developer to design, develop, and optimize large-scale web scraping solutions that power data-driven decision-making.

The ideal candidate will possess expertise in Scrapy and strong skills in web scraping and automation. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology.

Role Responsibilities:

  • Design, develop, and maintain scalable web scraping frameworks using Scrapy (mandatory).
  • Work with additional libraries/tools such as BeautifulSoup, Selenium, Playwright, Requests, etc.
  • Implement robust error handling, data parsing, and data storage mechanisms (JSON, CSV, SQL/NoSQL databases).
  • Build and optimize asynchronous scraping workflows and handle multithreading/multiprocessing.
  • Collaborate with product managers, QA, and DevOps teams to ensure timely delivery.
  • Research and adopt new scraping technologies to improve performance, scalability, and efficiency.

Required Skills and Qualifications:

  • 2+ years of experience in Python development with Scrapy expertise (must-have).
  • Proficiency with automation libraries such as Playwright or Selenium.
  • Experience with REST APIs, asynchronous programming, and concurrency.
  • Familiarity with databases (SQL/NoSQL) and cloud-based data pipelines.
  • Strong problem-solving skills and ability to meet deadlines in an Agile environment.

Benefits:

  • Competitive salary
  • Flexible work environment
  • Opportunities for career growth and skill development

  • Expert Web Data Miner

    2 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Description:Data Mining SpecialistNuvoretail seeks a seasoned data mining professional to design, develop, and implement efficient web scraping solutions using Python, Selenium, Pandas, SQL, and APIs.Responsibilities:Design robust web scraping workflows to extract structured and unstructured data from various websites and APIs.Utilize Python libraries...

  • Web Scraping Expert

    2 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Extraction SpecialistWe are seeking a highly skilled and experienced Senior Data Extraction Specialist to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT data extraction, with at least 2 years leading a team of 5+ developers.This role requires deep technical knowledge in advanced data extraction...

  • AI Systems Developer

    21 hours ago

    Jamnagar, Gujarat, India beBeeAutomation Full time ₹ 50,000 - ₹ 70,000

    **Job Title:** Senior AI Developer Job Description:We are seeking a senior experienced AI/ML developer to design and build an intelligent system that can interact with websites, perform smart actions (clicking, downloading, form filling, navigation), and extract data automatically. The role involves combining AI techniques with web crawling/automation tools...

  • Senior Backend Engineer – High-Performance Web Crawling

    4 weeks ago

    Jamnagar, Gujarat, India Magma Consultancy Full time

    Location: [Remote / India]Job Type: [Full-time]Experience: 5+ years in web crawling/scraping, backend systems, and data extractionAbout ClientOur Client is a modern, meaning‑based web-search API designed specifically for AI applications—such as retrieval‑augmented generation (RAG). Unlike traditional keyword-based engines, they use embedding-based...

  • Senior Web Application Developer

    6 days ago

    Jamnagar, Gujarat, India beBeeDevelopment Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: WordPress DeveloperThis is a full-time remote role for a skilled web developer. The developer will be responsible for both back-end and front-end development, creating and customizing themes and plugins, and ensuring websites are responsive and visually appealing.Daily tasks include implementing designs, maintaining websites, troubleshooting...

  • Senior Web Application Developer

    2 days ago

    Jamnagar, Gujarat, India beBeeDevelopment Full time ₹ 6,00,000 - ₹ 12,00,000

    Software Development EngineerJob Overview:We are seeking a highly skilled and experienced Software Development Engineer to join our team. As a key member of our development team, you will play a critical role in designing, developing, testing, and deploying web applications that meet the needs of our customers.Key Responsibilities:Design and develop new web...

  • Digital Web Developer

    17 hours ago

    Jamnagar, Gujarat, India beBeeDeveloper Full time ₹ 36,00,000 - ₹ 48,00,000

    Job OpportunityWe are seeking a highly skilled web developer to join our team. As a senior developer, you will be responsible for managing and enhancing our websites.The ideal candidate will have a strong background in software development, with expertise in HTML, CSS, JavaScript, PHP, and MySQL.Key ResponsibilitiesDesign and develop new pages, landing...

  • Senior Web Development Expert

    22 hours ago

    Jamnagar, Gujarat, India beBeeDevelopment Full time ₹ 10,00,000 - ₹ 16,00,000

    Seeking a skilled Web Development Specialist to join our dynamic team. As a key member, you will be responsible for designing, coding, and maintaining responsive, user-friendly websites that meet client needs.The ideal candidate will possess advanced knowledge of front-end technologies such as HTML5, CSS3, and JavaScript, as well as experience with back-end...

  • Senior Web Developer Wanted

    21 hours ago

    Jamnagar, Gujarat, India beBeeDevelopment Full time ₹ 8,00,000 - ₹ 12,00,000

    Web Development OpportunityWe are seeking an experienced WordPress Developer to work on custom themes, plugins, and modern WordPress solutions.

  • Senior Web Development Manager

    1 day ago

    Jamnagar, Gujarat, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 26,10,000

    **Role Overview**The successful candidate will be responsible for leading the design and development of complex web applications using Node.js, MongoDB, and modern front-end frameworks.**Key Responsibilities**Own features end-to-end—from architecture and implementation to testing, deployment, and optimization.Drive technical decision-making across the...