Senior Lead Data Scraping Specialist

1 day ago

Mangalore, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000
Job Title: Lead Data Scraping Engineer

Location: Remote or Office Based

Experience Level: Senior (4+ years)

Employment Type: Full-time

We are seeking a highly skilled and experienced Lead Data Scraping Engineer to drive our data scraping solutions.

Our ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
Required Skills and Qualifications:
  • Minimum 4 years in IT scraping industry
  • Minimum 2 years leading a team of 5+ developers
Key Technical Proficiencies:
  • Advanced Python
  • Captcha solving and blocking handling
  • Source reverse engineering
  • Proxy management & IP rotation
  • App automation, SSL Unpin, Frida
  • API Management, Version Control Systems
  • Error Handling, SQL, MongoDB, Pandas
Leadership Skills:
  • Basic project management
  • Moderate documentation
  • Team handling
  • Pressure management
  • Flexibility and adaptability
  • High accountability

  • Long-Term Freelance Web Scraping and Data Extraction Specialist

    22 hours ago

    Mangalore, Karnataka, India beBeeFreelance Full time

    Job Opportunity: Long-Term Freelance Web Scraping ExpertWe are looking for a skilled web scraping and data extraction specialist to collaborate with us on a long-term project.The ideal candidate will have extensive experience in designing and implementing advanced data collection systems, using techniques such as reverse-engineering front-end logic, handling...

  • Senior Data Retrieval Professional

    2 days ago

    Mangalore, Karnataka, India beBeeDataExtraction Full time ₹ 8,00,000 - ₹ 15,00,000

    Data Extraction Specialist">We are seeking an experienced data extraction specialist to design and optimize data retrieval solutions using web scraping and OCR techniques. Develop and maintain high-performance Python scripts for web scraping from structured and unstructured sources. Implement effective OCR solutions to extract text/data from scanned...

  • Senior Data Engineer

    3 days ago

    Mangalore, Karnataka, India UnifyCX Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Required Experience8+ Years for Senior Data EngineerPreferred SkillsetsVery Strong Python skills.Very efficient in SQL/Stored procedures.At least 8 years of Hands on Experience in AWS Step function, AWS Lambda, AWS S3, AWS ECS, AWS Cloud Watch, AWS Event Bridge, AWS Athena, AWS Glue.At least 8 years of Experience in TerraformAt least 8 years of Experience in...

  • Senior Data Miner

    7 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    We are seeking a skilled Data Analyst to join our team in designing, developing and maintaining robust data mining solutions. As a key member of the data team, you will be responsible for extracting structured and unstructured data from various websites and APIs.Responsibilities:Design and implement efficient and scalable data extraction systems using...

  • Data Driven Web Scraper

    7 days ago

    Mangalore, Karnataka, India beBeePython Full time ₹ 8,00,000 - ₹ 12,00,000

    About the RoleWe empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology. We seek an experienced Senior Python Developer who designs, develops, and optimizes large-scale web scraping solutions that power data-driven decision-making.

  • Senior Data Migration Specialist

    2 days ago

    Mangalore, Karnataka, India beBeeMigration Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Overview:The Senior Data Migration Specialist will lead full-cycle data migrations for ERP, HCM, or CRM implementation with proven success.Duties and Responsibilities:Lead the planning, execution, and delivery of complex data migration projects.Develop and implement data migration strategies to ensure seamless integration with ERP systems.Collaborate...

  • Highly Skilled Data Miner

    7 hours ago

    Mangalore, Karnataka, India beBeeDataMining Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:This role involves developing robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Data Extraction: Design, develop, and maintain automated scripts to extract data from dynamic websites, including handling JavaScript-driven content.Data Processing: Utilize tools like Python, Selenium,...

  • Senior Business Intelligence Specialist

    2 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 7,50,000 - ₹ 15,00,000

    Job Description:\We are seeking a skilled professional to fill the role of Data Analyst. The ideal candidate should possess strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.\The successful candidate will be responsible for building data pipelines, performing web scraping, and generating...

  • Senior Data Integration Specialist

    5 days ago

    Mangalore, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Integration SpecialistWe are seeking a highly skilled Senior Data Integration Specialist to lead the design, build, and maintenance of data pipelines across multiple sources and destinations.The ideal candidate will have strong hands-on expertise in data orchestration, transformations, and ETL/ELT processes to ensure smooth, scalable, and secure...

  • Lead Data Engineering Specialist

    2 days ago

    Mangalore, Karnataka, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Expert Big Data Professionals are in high demand as they play a critical role in driving business growth and innovation.We're seeking an experienced Senior Big Data Engineer to lead our data engineering efforts. As a key member of our organization, you will be responsible for overseeing data engineering teams and collaborating with architects, product...