Senior Data Scraping Engineer Lead

3 days ago


Dindigul, Tamil Nadu, India beBeeDataScraper Full time ₹ 12,00,000 - ₹ 15,00,000
Senior Data Scraping Engineer Lead

We are looking for a highly skilled and experienced Senior Data Scraping Engineer Lead to join our team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

The successful candidate will be responsible for designing and developing scalable data scraping solutions using tools like Scrapy and Python libraries. They will also lead and mentor a team of 5+ developers, managing project timelines and deliverables.

In addition, the candidate will implement advanced blocking and captcha-solving techniques to bypass scraping restrictions. They will conduct source code reverse engineering and automate web and app interactions. They will manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.

The ideal candidate will also maintain and improve API integrations and data pipelines. They will ensure code quality through effective version control, error handling, and documentation.

We are looking for a collaborative team player who can work closely with cross-functional teams for project planning and execution. The candidate will monitor performance and provide solutions under high-pressure environments.

Required Skills and Experience:
  • Data Scraping: Minimum 4 years in IT scraping industry
  • Leadership: Minimum 2 years leading a team of 5+ developers
  • Scraping Tools: Scrapy, Threading, requests, web automation
  • Technical Proficiency:
    • Advanced Python
    • Captcha solving and blocking handling
    • Source reverse engineering
    • Proxy management & IP rotation
    • App automation, SSL Unpin, Frida
    • API Management, Version Control Systems
    • Error Handling, SQL, MongoDB, Pandas
  • Leadership Skills:
    • Basic project management
    • Moderate documentation
    • Team handling
    • Pressure management
    • Flexibility and adaptability
    • High accountability
Preferred Skills:
  • Experience with Linux
  • Knowledge of Appium, Fiddler, Burp Suite


  • Dindigul, Tamil Nadu, India beBeeAutomation Full time ₹ 12,00,000 - ₹ 18,00,000

    About Actowiz SolutionsWe are a leading provider of data extraction, web scraping, and automation solutions. We empower businesses with actionable insights by delivering clean, structured, and scalable data through cutting-edge technology.Role OverviewWe are seeking an experienced Senior Python Developer with proven expertise in Scrapy and strong skills in...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    The role of Data Engineer is to collaborate with analysts to understand and anticipate requirements.Key responsibilities include designing, implementing, and maintaining web scrapers for a wide variety of alternative datasets.Data cleaning, exploration, transformation etc. of scraped data is also an essential part of the job.Cross-functional teams...


  • Dindigul, Tamil Nadu, India beBeeDataExtraction Full time ₹ 8,00,000 - ₹ 12,00,000

    We are seeking a highly skilled freelance web scraping expert to join our team on a long-term project.About the MissionThe goal of this project is to build a strategic data system that involves extracting and structuring data from various online sources with dynamic content, custom headers, request simulation, automation flows, and more.Key...


  • Dindigul, Tamil Nadu, India beBeeDataInsight Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Position: Data Insight SpecialistThis role involves working as a skilled professional with expertise in automating data extraction processes from web platforms.About the OpportunityWe are seeking a candidate with experience in Python, Selenium, Pandas, SQL, and APIs, who can design and implement efficient and scalable data scraping systems to enhance...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Test Engineering Lead/ManagerThis role involves overseeing the entire testing lifecycle, including developing test strategies and coordinating with various teams. The Senior Test Engineering Lead/Manager will be responsible for ensuring the quality of data solutions and leading a team of testers. Strong analytical and problem-solving abilities are...


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Senior Data Engineering SpecialistWe are seeking a seasoned professional to lead our data engineering initiatives.About Us:We are a boutique consulting firm specializing in data and AI. We have deep expertise in the Databricks ecosystem, helping clients build scalable data platforms and AI solutions that drive real business impact.Data...

  • Lead Data Engineer

    2 weeks ago


    Dindigul, Tamil Nadu, India Staffington Global Full time

    Dear Candidates,Hope you are doing wellWe are hiring for the Lead Data Engineer Role (Permanent Role). Kindly find the job details below:Mandatory Skill Set:MS Fabric (Hands-on of 6 months to 2 years of experience)**very mandatory for this roleAzure Stack – ADF, Data Lake, Lakehouse, Power BIAdditional Details:Total Experience: 8+ yearsWork Location:...


  • Dindigul, Tamil Nadu, India beBeeAutomation Full time ₹ 50,000 - ₹ 70,000

    Senior AI Automation SpecialistWe are seeking an experienced AI/ML developer with expertise in web automation to design and build an intelligent system that can interact with websites, perform smart actions, and extract data automatically.The role involves combining AI techniques with web crawling/automation tools to create a scalable and efficient solution....


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineer(Lead)We are seeking an exceptional Senior Data Engineer to lead our data engineering team and drive the design, development, and optimization of ETL/ELT data pipelines. This role involves leveraging Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory to build scalable ingestion and transformation workflows across...

  • Data Insights Lead

    1 day ago


    Dindigul, Tamil Nadu, India beBeeMachineLearning Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Insights StrategistWe are seeking an experienced Senior Data Insights Strategist to lead our data science efforts. This role involves extracting actionable insights from complex data using statistical analysis, machine learning, and data modeling to drive strategic decision-making.The ideal candidate will possess strong technical skills in...