Senior Data Scraping Manager

3 days ago

Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: Data Engineering Lead

We are seeking a highly skilled and experienced Senior Data Scraping Engineer to join our organization.

The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of developers. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

Key Responsibilities:

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of developers, managing project timelines and deliverables.
  • Implement advanced blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through effective version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.
Required Skills and Qualifications
  • Data Scraping:
    • Minimum 4 years in IT scraping industry
  • Leadership:
    • Minimum 2 years leading a team of developers
  • Scraping Tools:
    • Scrapy, Threading, requests, web automation
  • Technical Proficiency:
    • Advanced Python
    • Captcha solving and blocking handling
    • Source reverse engineering
    • Proxy management & IP rotation
    • App automation, SSL Unpin, Frida
    • API Management, Version Control Systems
    • Error Handling, SQL, MongoDB, Pandas
  • Leadership Skills
    • Basic project management
    • Moderate documentation
    • Team handling
    • Pressure management
    • Flexibility and adaptability
    • High accountability
    Bonus Skills
    • Experience with Linux
    • Knowledge of Appium, Fiddler, Burp Suite

  • Senior Web Scraping Automation Specialist

    1 week ago

    Lucknow, Uttar Pradesh, India beBeePython Full time ₹ 9,00,000 - ₹ 15,00,000

    Job Posting:We are seeking a seasoned Python Developer to lead web scraping initiatives and drive automation.Design, develop, and maintain large-scale web scraping frameworks using Scrapy.Collaborate with additional libraries/tools such as BeautifulSoup, Selenium, Playwright, Requests.Implement robust error handling, data parsing, and storage mechanisms...

  • Web Data Extraction Professional

    1 week ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title:Extraction SpecialistThis is a challenging role that requires expertise in automating data extraction processes from web platforms.Key Responsibilities:Design, develop and maintain robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Utilize tools like Python, Selenium, BeautifulSoup and Scrapy...

  • Python Data Specialist

    4 days ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Key Role: Python DeveloperWe are looking for an experienced Python developer to design and optimize solutions for extracting structured and unstructured data from various sources.This key role involves developing scalable Python scripts for web scraping, implementing Optical Character Recognition (OCR) solutions, and optimizing data extraction workflows for...

  • Senior Data Engineering Position

    1 day ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000

    Role Overview:As a skilled Data Engineer, you will play a pivotal role in building and maintaining our data infrastructure.Key Responsibilities include developing efficient Python scripts for data collection and transformation, designing web scraping solutions to extract structured and unstructured data, performing data cleaning, preprocessing, and analysis...

  • Advanced Data Extraction Solutions Engineer

    1 week ago

    Lucknow, Uttar Pradesh, India beBeeDataExtraction Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Extraction SpecialistWe are seeking a highly skilled and experienced data extraction specialist to drive our data scraping efforts. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills.The ideal candidate will have a minimum of 4 years of hands-on experience in IT...

  • Data Analyst Engineer

    7 days ago

    Lucknow, Uttar Pradesh, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 25,00,000

    Web Scraping is a key component of data analysis and engineering. At Alternative Path, we are seeking a skilled software developer to collaborate on client projects with an asset management firm.In this role, you will work closely with individuals across various company departments to shape and innovate new products and features for our platform, enhancing...

  • Data Research Analyst

    5 days ago

    Lucknow, Uttar Pradesh, India Digital360Shop Private Limited Full time ₹ 85,000 per year

    Data Research & Lead Generation Executive (Contact Information Scraper) Location: Remote / Work from Home (Preference to candidates based in Lucknow) Job Type: Full-time About Us: Digital360Shop is a fast-growing digital marketing and media consulting agency based in India and the USA. We work with top publishers and private brands to help them grow...

  • Senior Data Engineering Manager

    19 hours ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: Senior Data Engineering ManagerOur company is looking for an experienced and skilled Data Engineering Manager to lead our team of data engineers.Key Responsibilities:Develop and implement data integration solutions using ETL tools and databases.Design and maintain data warehouses using Oracle, Netezza, Snowflake, Azure SQL, and Hive.Collaborate...

  • Senior Data Management Lead

    1 week ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OverviewAs a senior leader, you will be responsible for overseeing the end-to-end delivery of data management services.The ideal candidate will have a proven track record of delivering high-quality results through well-defined methodologies and standardized practices.Main Responsibilities:Define and implement best practices and standards for data project...

  • Data Management Lead

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeClinical Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Clinical Data Manager RoleWe are seeking a seasoned Senior Clinical Data Manager to lead our clinical data management team.Manage and oversee the clinical data management process, ensuring timely and accurate delivery of data to stakeholders.Lead a team of clinical data managers and supervisors, providing guidance and mentorship to ensure their...