Senior Lead Data Scraping Specialist

2 weeks ago

Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000
Senior Lead Data Engineer

Job Summary

We are seeking a highly skilled and experienced Senior Lead Data Engineer to lead our data scraping team. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of 5+ developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.

Required Skills and Qualifications

Senior Lead Data Engineer Requirements:

  • Minimum 4 years in IT scraping industry

Leadership Requirements:

  • Minimum 2 years leading a team of 5+ developers

Technical Proficiency:

  • Advanced Python programming skills
  • Captcha solving and blocking handling
  • Source code reverse engineering
  • Proxy management & IP rotation
  • App automation, SSL Unpin, Frida
  • API Management, Version Control Systems
  • Error Handling, SQL, MongoDB, Pandas

Leadership Skills:

  • Project management
  • Documentation
  • Team handling
  • Pressure management
  • Flexibility and adaptability
  • High accountability

Preferred (Good to Have)

  • Experience with Linux operating system
  • Knowledge of Appium, Fiddler, Burp Suite

  • Senior Data Scientist

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataMining Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Unlock Your Potential as a Data Mining AnalystWe are seeking an accomplished Data Mining Analyst to join our team. As a key member of our organization, you will be responsible for designing, developing, and maintaining robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Key Responsibilities:Design and...

  • Data Extraction Specialist

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataExtraction Full time ₹ 15,00,000 - ₹ 20,00,000

    This is a rare opportunity to work with our analytics and automation company. We are seeking an experienced Data Extraction Specialist with expertise in automating data extraction processes from web platforms.The ideal candidate will be highly skilled in Python, Selenium, Pandas, SQL, and APIs, with the ability to design and implement efficient and scalable...

  • Senior Data Science Specialist

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataScience Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Summary:We are seeking a highly skilled Senior Data Science Specialist to join our team. As a key member of our organization, you will be responsible for designing and implementing data-driven solutions to drive business growth.About the Role:The ideal candidate will have a strong background in data engineering, with expertise in Python and experience...

  • Senior Web Scraping Specialist

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking a highly skilled engineer to join our team as a Senior Web Scraping Specialist.This is a challenging project that requires strong problem-solving skills and attention to detail.The ideal candidate will have experience with Python, Scrapy or aiohttp, and Playwright, as well as practical knowledge of proxy management, polite...

  • Data Marketing Specialist

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeMarketing Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OverviewA senior executive role is available to lead our marketing and data efforts. The ideal candidate will have a strong background in email marketing, mass mailing, and data extraction.This is an excellent opportunity for individuals who want to make a significant impact in the industry by developing and executing effective marketing...

  • Senior Data Extraction Developer

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeePythonDeveloper Full time ₹ 10,00,000 - ₹ 15,00,000

    As a seasoned developer, you will play a key role in crafting innovative data extraction solutions that leverage web scraping and OCR expertise. Your primary focus will be on designing and optimizing scalable scripts to extract clean, structured data from various sources.Key Responsibilities:Develop and maintain Python scripts for web scraping from...

  • Senior Data Extraction Specialist

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeWebCrawler Full time ₹ 1,35,00,000 - ₹ 1,57,50,000

    High-Throughput Web Crawling EngineerWe're building a high-throughput product data ingestion pipeline across hundreds of domains. This role spans crawling (discovering & fetching pages via sitemaps/robots) and scraping (extracting structured specs, images, and PDFs into our schema).Key Responsibilities:Design an HTTP-first crawler with Playwright fallback...

  • Data Architect Lead

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataIntegration Full time ₹ 18,00,000 - ₹ 20,00,000

    Senior Data Integration SpecialistWe are seeking a highly skilled Senior Data Integration Specialist to join our team. This individual will be responsible for leading the design, development, and implementation of ETL processes across multiple data platforms.About the RoleLead the development and maintenance of ETL processes to ensure high-quality data...

  • Data Insights Specialist

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Overview:We are seeking a skilled professional to fill the role of Data Analyst.The ideal candidate will possess strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.Key Responsibilities:Develop, test, and maintain efficient Python scripts for data collection and transformation.Design and...

  • Senior AI Solutions Lead

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeArtificial Intelligence Specialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled and proactive AI Solutions Architect to oversee the maintenance, optimization, and ongoing performance of deployed AI/ML systems and solutions. In this role, you'll act as the bridge between innovation and operations, ensuring our AI solutions consistently deliver value and operate seamlessly in real-world...