Senior Web Scraping Solutions Architect

3 days ago

Hyderabad, Telangana, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

Job Title: Advanced Data Engineer

Location: Remote Work Option

Experience Level: Senior (4+ years)

Employment Type: Full-time

Job Summary

As a seasoned Lead Data Scraping Engineer, you will design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.

You will lead and mentor a team of 5+ developers, managing project timelines and deliverables. Your expertise in advanced scraping techniques, reverse engineering, automation, and leadership skills will drive the team towards success.

Key Responsibilities:
  • Develop complex data extraction pipelines using Python libraries.
  • Lead cross-functional teams to implement data scraping solutions.
  • Design and implement advanced blocking and captcha-solving techniques.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning for effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through version control, error handling, and documentation.
Required Skills and Qualifications:
  • Minimum 4 years of experience in IT scraping industry.
  • 2+ years of experience leading a team of 5+ developers.
  • Expertise in Scrapy, Threading, requests, and web automation.
Benefits:

Opportunity to work with cutting-edge technologies and contribute to the development of innovative data solutions.

Chance to collaborate with experienced professionals in the field.

Leadership Skills:
  • Effective communication and teamwork skills.
  • Strong project management and time management skills.

  • Senior Web Scraping Developer

    1 week ago

    Hyderabad, Telangana, India beBeeWebScraper Full time ₹ 8,00,000 - ₹ 15,00,000

    Job DescriptionWe are seeking a skilled and experienced web scraping professional to join our team.Key ResponsibilitiesDesign, develop and maintain scalable web scraping frameworks using Scrapy (mandatory).Work with additional libraries/tools such as BeautifulSoup, Selenium, Playwright, Requests, etc.Implement robust error handling, data parsing, and data...

  • Sr Developer(Web Scraping)

    1 day ago

    Hyderabad, Telangana, India Interaslabs Full time ₹ 28,00,000 - ₹ 30,00,000 per year

    Job Title: Senior Developer-Javascript Web ScrapingLocation: HyderabadType: Full-timeExperience: 10+ yearsAbout the Role:This role involves building and maintaining large-scale, data-heavy applications that process terabytes of data daily. You will be responsible for designing scalable backend solutions and working on real-time data processing, API...

  • Senior Web Automation Specialist

    1 week ago

    Hyderabad, Telangana, India beBeeWebAutomation Full time ₹ 50,000 - ₹ 70,000

    Senior Web Automation EngineerWe are seeking an experienced Senior Web Automation Engineer to join our team. The ideal candidate will have strong expertise in web automation and a solid understanding of AI/ML techniques.Key Responsibilities:Design and develop intelligent web automation systems that can interact with websites and perform smart...

  • Senior Web Architect

    1 day ago

    Hyderabad, Telangana, India beBeeFullStack Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opportunity: Senior Web ArchitectWe are seeking a seasoned senior web architect to lead the development of our dynamic web presence. This full-time role requires a professional with 8+ years of comprehensive experience in designing, developing, and maintaining scalable web applications.

  • Software Systems Architect

    6 days ago

    Hyderabad, Telangana, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Backend Developer PositionThis is an exciting opportunity for a skilled Senior Backend Developer to join our team.The ideal candidate will have a strong background in backend development, with expertise in Python and experience with building and managing RESTful APIs using FastAPI. They will also be proficient in web development and automation,...

  • Ecommerce Web Data Analyst

    18 hours ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Web Data ScientistWe are seeking a highly skilled Web Data Scientist to join our team. As a Web Data Scientist, you will be responsible for designing, developing, and maintaining robust web scraping solutions to extract structured and unstructured data from various websites and APIs.Job Description:The ideal candidate will have expertise in Python, Selenium,...

  • Data Extraction Expert

    1 week ago

    Hyderabad, Telangana, India beBeeWebScraping Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Web Scraping SpecialistWe are seeking an accomplished and resourceful Senior Web Scraping Specialist to spearhead the development of scalable data scraping solutions. The ideal candidate will have a minimum of 4 years of hands-on experience in IT scraping, with at least 2 years leading a team of 5+ developers.Key Responsibilities:Design and develop...

  • Solution/Software Architect

    4 days ago

    Hyderabad, Telangana, India Appit Software Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Solution/Software ArchitectJob TitleSolution/Software ArchitectReports ToProject ManagerJob OverviewLooking for a highly skilled solution/software architect to lead our development team in creating robust, secure, and scalable software solutions that meet project needs. You will be responsible for communicating with clients to determine their requirements,...

  • Unique Junior Web Data Extraction Expert

    4 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job OpportunityWe are seeking a skilled professional to join our team as a Junior Web Crawling Engineer.About the RoleThe ideal candidate will be responsible for designing, developing, and maintaining web crawlers to extract valuable insights from the web. The selected individual will have strong technical skills in Python programming, web scraping...

  • Senior Solution Architect

    7 days ago

    Hyderabad, Telangana, India beBeeSolution Full time ₹ 1,50,00,000 - ₹ 3,00,00,000

    Job Title: Senior Solution ArchitectWe are seeking a highly skilled and experienced Senior Solution Architect to lead the design and implementation of our organization's technology solutions.