Data Scraping Team Lead

22 hours ago

Vijayawada, Andhra Pradesh, India beBeeLeader Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Technical Leadership RoleThis position requires a highly skilled and experienced individual to lead our data scraping team.The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.This role involves designing and developing scalable data scraping solutions using tools like Scrapy and Python libraries.The selected candidate will also be responsible for implementing advanced blocking and captcha-solving techniques to bypass scraping restrictions.Additionally, they will conduct source code reverse engineering and automate web and app interactions.They must manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.Moreover, they will maintain and improve API integrations and data pipelines.They are expected to ensure code quality through effective version control, error handling, and documentation.Furthermore, they will collaborate with cross-functional teams for project planning and execution.Ultimately, they will monitor performance and provide solutions under high-pressure environments.Required Skills and Qualifications
  • Data Scraping: Minimum 4 years in IT scraping industry
  • Leadership: Minimum 2 years leading a team of 5+ developers
  • Scraping Tools: Scrapy, Threading, requests, web automation
  • Technical Proficiency:
    • Advanced Python
    • Captcha solving and blocking handling
    • Source reverse engineering
    • Proxy management & IP rotation
    • App automation, SSL Unpin, Frida
    • API Management, Version Control Systems
    • Error Handling, SQL, MongoDB, Pandas
  • Leadership Skills:
    • Basic project management
    • Moderate documentation
    • Team handling
    • Pressure management
    • Flexibility and adaptability
    • High accountability
Benefits

Working in a fast-paced environment with opportunities to learn and grow.

Collaborating with a talented team of professionals.

Others

Experience with Linux is preferred but not required.

Knowledge of Appium, Fiddler, Burp Suite is also a plus.

  • Senior Python Developer

    4 hours ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 5,00,000 - ₹ 10,00,000

    Senior Python Developer - Data Extraction Specialist\We are seeking a seasoned Python developer to join our team as a Senior Python Developer specializing in data extraction and web scraping solutions. As a key member of our technology team, you will design, develop, and maintain scalable web scraping frameworks using Scrapy.\Your primary responsibilities...

  • Extraction Specialist

    1 hour ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 16,00,000

    We're seeking a seasoned Data Extraction Specialist to join our team. This key role involves designing, developing, and maintaining robust data scraping solutions to extract structured and unstructured data from various websites and APIs.The ideal candidate will have expertise in Python, Selenium, Pandas, SQL, and APIs, with a proven track record of...

  • Data Scientist/ML Engineer

    4 days ago

    Vijayawada, Andhra Pradesh, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Leading Data Strategist

    4 hours ago

    Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    As a leading Data Strategist, you will spearhead advanced analytics initiatives to drive business value.Key Responsibilities:Develop and optimize complex data pipelines using AI and ML technologies.Leverage knowledge graph databases like Neo4j for scalable data analysis.Collaborate with cross-functional teams to deliver actionable insights through...

  • Team Lead – Campaigns

    4 weeks ago

    Vijayawada, Andhra Pradesh, India FLICKZILLA ENTERTAINMENT Full time

    Job Title:Team Lead – CampaignsLocation:Remote (India)Agency: Flickzilla EntertainmentReporting to: Co-founder (until a Manager is hired)About Flickzilla Entertainment:Flickzilla Entertainment is a fast-growing influencer marketing and talent management agency working with leading brands in the personal care, education, FMCG, wellness, and lifestyle...

  • Transformative Data Engineer

    1 day ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,50,000

    About the RoleWe are seeking a highly skilled and motivated Data Engineer to play a pivotal role in crafting data infrastructure that drives real business growth.This position is ideal for someone who is relentless in pursuit of knowledge, detail-obsessed, and self-directed, with a passion for extracting every possible byte of data from marketing...

  • Backend Engineering Team Lead

    1 day ago

    Vijayawada, Andhra Pradesh, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Technical Lead Position OverviewThe ideal candidate will lead a small engineering team in developing and maintaining scalable backend systems. Key responsibilities include mentoring junior engineers, establishing best practices, and implementing API integrations with external partners.About the Role:This role requires an experienced engineer to design and...

  • Operations Team Lead

    1 hour ago

    Vijayawada, Andhra Pradesh, India beBeeCluster Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job OpportunityWe are seeking a skilled Cluster Operations Manager to lead our cluster's training and operations efforts.A graduate or postgraduate degree in any discipline is required, with a strong background in operations and team management skills.The ideal candidate will have at least 7+ years of experience in the skilling sector, focusing on...

  • Enterprise Data Governance Lead

    22 hours ago

    Vijayawada, Andhra Pradesh, India beBeeDataGovernance Full time ₹ 1,30,00,000 - ₹ 2,59,00,000

    Job OverviewWe are seeking a highly skilled Data Governance Lead to join our organization.About the roleThis pivotal position empowers global, regional, and business leaders to analyze, document, optimize, and orchestrate enterprise data for marketing and consumer engagement.Main Responsibilities:Support the execution of an integrated Data & AI stewardship...

  • Lead Data Engineering Position

    1 day ago

    Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a Lead Data Engineer to drive our data strategy.This is a senior technical role with high expectations. The ideal candidate must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.The key responsibilities include designing, developing, and optimizing data...