Senior Web Data Solutions Engineer

9 hours ago

Vellore, Tamil Nadu, India beBeeWeb Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Web Data Solutions Architect

Overview: We are seeking an experienced and skilled Lead Data Scraping Engineer to join our team. This role requires deep technical knowledge in advanced scraping techniques, reverse engineering, automation, and leadership skills to drive the team towards success.

Key Responsibilities:

  • Design and develop scalable data scraping solutions using tools like Scrapy and Python libraries.
  • Lead and mentor a team of developers, managing project timelines and deliverables.
  • Implement blocking and captcha-solving techniques to bypass scraping restrictions.
  • Conduct source code reverse engineering and automate web and app interactions.
  • Manage proxies, IP rotation, and SSL unpinning to ensure effective scraping.
  • Maintain and improve API integrations and data pipelines.
  • Ensure code quality through version control, error handling, and documentation.
  • Collaborate with cross-functional teams for project planning and execution.
  • Monitor performance and provide solutions under high-pressure environments.

Requirements:

  • Data Scraping: 4+ years in IT scraping industry.
  • Leadership: 2+ years leading a team of developers.
  • Scraping Tools: Scrapy, Threading, requests, web automation.
  • Technical Proficiency: Advanced Python, Captcha solving, Source reverse engineering, Proxy management, App automation, SSL Unpin, Frida, API Management, Version Control Systems, Error Handling, SQL, MongoDB, Pandas.
  • Leadership Skills: Basic project management, Moderate documentation, Team handling, Pressure management, Flexibility and adaptability, High accountability.

Nice to Have:

  • Experience with Linux.
  • Knowledge of Appium, Fiddler, Burp Suite.

  • Data Engineer

    4 weeks ago

    Vellore, Tamil Nadu, India Marktine Technology Solutions Pvt Ltd Full time

    Position: Senior Data EngineerExp: 12-15 YearsLocation: RemoteWe are seeking a Senior Data Engineer. The ideal candidate will be based in India and work remotely. This role requires a blend of design and implementation expertise.Key Responsibilities:Design and bootstrap data solutions, including setting up Snowflake for a large, complex conglomerate.Utilize...

  • Chief Data Engineer

    2 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Architect PositionWe are seeking an experienced Senior Data Architect to lead our team of senior data engineers in designing and implementing a scalable, secure, and efficient data architecture.This role requires strong technical expertise in data engineering, cloud-native technologies, and big data platforms. The ideal candidate will have...

  • Freelance Data Engineer – Cloud Solutions

    4 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Freelance Data EngineerWe are seeking an experienced data engineer with expertise in Python and AWS services to design, develop, and optimize data pipelines.The ideal candidate will have a strong background in cloud security, web and mobile security testing, and DevSecOps services.Responsibilities include designing and developing data pipelines...

  • Senior Web Engineer Position

    13 hours ago

    Vellore, Tamil Nadu, India beBeeSoftware Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Senior Web Engineer PositionAbout The Role:We are seeking a skilled and accomplished web engineer to join our team and play a key role in building and scaling our SaaS-based healthcare platform.This is a full-stack position with a strong emphasis on the front end, where you will be instrumental in creating secure, intuitive, and user-friendly...

  • Senior Cloud Data Solutions Architect

    4 days ago

    Vellore, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,61,00,000 - ₹ 2,51,00,000

    Data Architect LeadAs a senior data architect, you will be responsible for designing and implementing robust data architectures that meet business requirements.The ideal candidate will have 8-12 years of experience in data architecture or a similar role and proven expertise in designing and implementing data solutions on at least one major cloud platform.Key...

  • Senior Web Applications Developer

    4 days ago

    Vellore, Tamil Nadu, India beBeeDeveloper Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Web Applications DeveloperWe are seeking an experienced Senior Web Applications Developer to join our team. The successful candidate will be responsible for designing, developing and maintaining web applications using cutting-edge technologies.About the Role:This is a challenging role that requires strong technical skills, excellent...

  • Senior Web Data Extraction Specialist

    12 hours ago

    Vellore, Tamil Nadu, India beBeeDataExtractor Full time ₹ 12,00,000 - ₹ 18,00,000

    Job Description:Seeking a detail-driven web data extractor who will be responsible for developing and maintaining efficient web crawlers, ensuring high-quality data extraction, and optimizing crawling efficiency.About this role: Develop and refine crawlers using Python-based tools and frameworks.Utilize browser automation tools (e.g., Playwright, Selenium)...

  • Senior Cloud Data Engineer

    5 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000

    Job Title: Senior Cloud Data EngineerDescriptionWe are seeking an experienced Senior Cloud Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and deploying end-to-end data pipelines on AWS cloud infrastructure.The successful candidate will have hands-on experience with Amazon S3, AWS Glue, AWS Lambda,...

  • Senior Software Engineer

    4 days ago

    Vellore, Tamil Nadu, India beBeeSoftware Full time ₹ 8,00,000 - ₹ 12,00,000

    Key Job Responsibilities">We are seeking an accomplished software engineer to assist our team in the creation of robust web applications.The ideal candidate will have extensive experience with back-end development, strong Python programming skills, and a thorough understanding of object-relational mapping.Develop scalable software solutions using...

  • Senior Web Scraping Specialist

    4 days ago

    Vellore, Tamil Nadu, India beBeeDataAutomation Full time ₹ 8,00,000 - ₹ 12,00,000

    High-Level Data Automation Expert WantedWe are seeking a skilled professional to develop and implement a sophisticated data extraction system. The ideal candidate will have expertise in web scraping technologies, including Playwright, Selenium, Puppeteer, BeautifulSoup, and Scrapy.About the ProjectThe project requires extracting and structuring data from...