Senior Web Scraping Developer

2 days ago

Anantapur, Andhra Pradesh, India beBeeWebScrapingDeveloper Full time ₹ 10,00,000 - ₹ 20,00,000

Job Summary:

We are seeking a seasoned Senior Web Scraping Developer to design and develop large-scale web scraping solutions using Scrapy. The ideal candidate will have strong skills in automation, data parsing, and storage mechanisms.

About the Role:

This is a key opportunity for an experienced Python developer to join our team and make a significant impact on our data-driven initiatives. You will work closely with cross-functional teams to ensure timely delivery of high-quality results.

Key Responsibilities:

  • Design and Develop Scalable Web Scraping Frameworks Using Scrapy (mandatory)
  • Work with Additional Libraries/Tools (BeautifulSoup, Selenium, Playwright, Requests, etc.)
  • Implement Robust Error Handling, Data Parsing, and Storage Mechanisms (JSON, CSV, SQL/NoSQL databases)
  • Build and Optimize Asynchronous Scraping Workflows (handle multithreading/multiprocessing)
  • Collaborate with Teams (Product managers, QA, and DevOps teams) to ensure timely delivery
  • Research and Adopt New Scraping Technologies to Improve Performance, Scalability, and Efficiency

Requirements:

The ideal candidate will possess:

  • 2+ years of experience in Python development with expertise in Scrapy (must-have)
  • Proficiency in automation libraries such as Playwright or Selenium
  • Experience with REST APIs, asynchronous programming, and concurrency
  • Familiarity with databases (SQL/NoSQL) and cloud-based data pipelines
  • Strong problem-solving skills and ability to meet deadlines in an Agile environment

Preferred Qualifications:

The following qualifications would be advantageous:

  • DevOps Tools: Knowledge of DevOps tools such as Docker, GitHub Actions, or CI/CD pipelines

Benefits:

This role offers a competitive salary, a flexible and collaborative work environment, and ample opportunities for career growth and skill development.

  • Senior Web Developer

    18 hours ago

    Anantapur, Andhra Pradesh, India beBeeDeveloper Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Senior Web DeveloperWe are seeking a highly skilled and experienced senior web developer to join our team.The ideal candidate will have 5+ years of experience in WordPress and WooCommerce development, with strong knowledge of Elementor for custom design and layouts.Mandatory Qualifications:Experience in WordPress and WooCommerce developmentStrong...

  • Unlocking Hidden Insights

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeDataMining Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Overview:We are seeking a skilled professional to join our team as a Data Mining Analyst. This role involves designing and implementing efficient data scraping systems using Python, Selenium, BeautifulSoup, Scrapy, and Pandas.The ideal candidate will have hands-on experience in web scraping and data extraction, with strong proficiency in Python and...

  • Chief Technology Officer

    3 days ago

    Anantapur, Andhra Pradesh, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 21,00,000

    Job Overview:We are seeking a highly skilled and experienced Senior Developer to spearhead data scraping initiatives.The ideal candidate will have a minimum of 4 years of hands-on experience in IT data extraction, with at least 2 years leading a team of 5+ developers.Key Responsibilities:Data Scraping Development: Design and develop scalable data scraping...

  • Senior Web Application Developer

    23 hours ago

    Anantapur, Andhra Pradesh, India beBeeFullStackEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Web Application DeveloperThe ideal candidate will be a senior-level software engineer with extensive experience in developing and maintaining web applications.This role requires a strong understanding of full-stack software development, including front-end and back-end technologies, as well as excellent problem-solving skills and the...

  • Ecommerce Data Scientist Position Open Now

    1 day ago

    Anantapur, Andhra Pradesh, India beBeeDataScienceProfessional Full time ₹ 9,00,000 - ₹ 12,00,000

    Role: Data Science ProfessionalWe are seeking a highly skilled Data Science professional to join our team.The ideal candidate will have expertise in data extraction, processing, and analysis using Python and relevant libraries.Key Responsibilities:Data Extraction: Design, develop, and maintain efficient web scraping solutions to extract structured and...

  • Senior .NET Technical Lead

    18 hours ago

    Anantapur, Andhra Pradesh, India beBeeC#Developer Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Summary:We are seeking a highly experienced and skilled IT leader to spearhead our .NET development efforts. The ideal candidate will have extensive technical expertise in .NET Framework/Core, C#, and ASP.NET MVC/Web API.Key Responsibilities:Design and implement robust web applications using .NET Framework/Core, C#, and ASP.NET MVC/Web API.Collaborate...

  • Senior Intelligent Automation Specialist

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeArtificial Full time ₹ 50,000 - ₹ 70,000

    Job Title: Senior AI DeveloperJob Overview:Design and develop an intelligent system that can interact with websites, perform smart actions (clicking, downloading, form filling, navigation), and extract data automatically.Combine AI techniques with web crawling/automation tools to create a scalable and efficient solution.Key Responsibilities:Role...

  • Senior Front-end Web Developer

    14 hours ago

    Anantapur, Andhra Pradesh, India beBeeFrontEndDeveloper Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Front-end Web DeveloperThis role involves designing, developing and maintaining web applications using modern front-end technologies to create engaging user experiences.As a senior front-end developer, you will work on a range of projects from small custom modules and themes to large-scale enterprise-level web applications. You will be...

  • Web Development Expert

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeFrontend Full time ₹ 8,00,000 - ₹ 15,00,000

    Senior Frontend DeveloperAs a key member of our development team, you will be responsible for implementing responsive web design and collaborating with other teams to ensure seamless software development.Key Qualifications:Proven experience in front-end development and responsive web designStrong problem-solving and analytical skillsExperience with...

  • Web Development Expert

    14 hours ago

    Anantapur, Andhra Pradesh, India beBeeSoftwareDeveloper Full time ₹ 15,00,000 - ₹ 30,00,000

    Are you a seasoned developer looking for a new challenge? We're seeking a skilled Senior Full Stack Engineer to join our team.The ideal candidate will have extensive hands-on experience in developing scalable web applications, with proficiency in both front-end and back-end technologies. They should be capable of leading projects, mentoring junior...