Senior Data Scraping Engineer

1 day ago

Davangere, Karnataka, India beBeeDataScraping Full time

Job Title: Senior Data Scraping Engineer

Location: Remote

Experience Level: Senior (4+ years)

Employment Type: Full-time

Overview

We are seeking a highly skilled and experienced Data Scraping Engineer to lead our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

Key Responsibilities

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Required Skills and Qualifications

Data Scraping:

  • Minimum 4 years in IT scraping industry

Leadership:

  • Minimum 2 years leading a team of 5+ developers

Scraping Tools:

  • Scrapy, Threading, requests, web automation

Technical Proficiency:

  • Advanced Python
  • Captcha solving and blocking handling
  • Source reverse engineering
  • Proxy management & IP rotation
  • App automation, SSL Unpin, Frida
  • API Management, Version Control Systems
  • Error Handling, SQL, MongoDB, Pandas

Benefits

This role offers the opportunity to work on challenging projects, collaborate with a talented team, and grow professionally. We prioritize employee development, providing opportunities for training, mentorship, and career advancement.

About Us

A leading technology company seeks an experienced Data Scraping Engineer to join its team. Our organization values innovation, teamwork, and customer satisfaction.

  • Senior Data Architect

    1 week ago

    Davangere, Karnataka, India beBeeDataExtraction Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly skilled and experienced Data Architect to lead our data extraction initiatives.The ideal candidate will have a minimum of 4 years of hands-on experience in data scraping, with at least 2 years managing a team of developers.This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and...

  • Senior Data Engineer

    2 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time US$ 80,000 - US$ 1,40,000

    High-quality data is a vital component of any successful organization.In this role, you will have the opportunity to work with large datasets and develop innovative solutions to extract valuable insights.The ideal candidate will be able to design, implement, and maintain web scrapers to obtain high-quality proprietary datasets.This individual will also be...

  • Data Strategist

    10 hours ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock Your Data PotentialWe are seeking an ambitious and driven professional to join our team as a Senior Data Engineer.This role is ideal for someone who thrives on early-stage challenges, loves building innovative, scalable solutions from day zero, and owns the entire tech stack.Web Scraping & Crawling:Develop automated scrapers to extract structured and...

  • Unlock Career Opportunities as a Data Extraction Professional

    8 hours ago

    Davangere, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Opportunity: Data Information SpecialistWe are seeking a skilled professional to oversee the extraction and processing of data from various web platforms.About the RoleDesign, develop, and maintain robust web scraping solutions to extract structured and unstructured data from websites and APIs.Utilize programming languages like Python, Selenium,...

  • Senior Data Extraction Specialist

    2 days ago

    Davangere, Karnataka, India beBeeDataExtraction Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Extraction Expert WantedWe are seeking an experienced data extraction specialist to join our team. The ideal candidate will have a strong background in Python programming and experience with web scraping, Optical Character Recognition (OCR), and data cleaning.Key Responsibilities:Develop and maintain Python scripts for data extraction from various...

  • Expert AI Software Engineer

    6 days ago

    Davangere, Karnataka, India beBeeSoftware Full time ₹ 50,000 - ₹ 70,000

    Job Title: Expert AI Software EngineerJob OverviewWe seek a seasoned expert in AI software development to design and build an intelligent web automation system.Key Responsibilities:Design and develop an AI-powered web automation system capable of interacting with websites intelligently, leveraging Python or similar programming languages.Implement web...

  • Senior Data Engineering Expert

    6 days ago

    Davangere, Karnataka, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,50,000

    Job Title:Senior Data Engineering Expert">About the Role:We are seeking a seasoned Senior Data Engineer to lead the design and implementation of high-quality, secure, and scalable data pipelines and systems.This role requires 4–5 years of experience in data engineering with expertise in designing complex data architectures and developing efficient data...

  • Senior Data Engineer

    12 hours ago

    Davangere, Karnataka, India beBeeDataModel Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewThe Senior Data Engineer will lead the development of data models to support business growth and innovation. Working closely with cross-functional teams, the successful candidate will analyze existing data systems, identify areas for improvement, and implement optimized data models.This role requires a deep understanding of data architecture,...

  • Senior Data Engineer

    11 hours ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Career Growth as a Senior Data EngineerYou will play a pivotal role in driving innovation and delivering cutting-edge data solutions that establish our IT department as a core competitive advantage.Key Responsibilities:Design, implement, and oversee the deployment of scalable, reliable, and secure data infrastructure, ensuring seamless integration...

  • Senior Cloud Data Engineer

    4 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering Leader As a senior data engineering professional, you will play a key role in driving the development of our innovative data warehouse offerings. Key Responsibilities:Lead a team of senior data engineers to design and develop cloud-native data-intensive applicationsCollaborate with cross-functional teams to architect and...