Senior Web Data Collection Specialist

5 days ago

Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000
Web Data Engineer Position

We're looking for a skilled and innovative Web Data Engineer to help us design and develop cutting-edge data collection systems.

Main Responsibilities:
  • Design and implement automated web scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
  • Create scalable scraping systems capable of handling high-volume data collection without interruptions.
  • NORMALIZE AND CLEAN scraped data, remove noise, and ensure consistency before passing it to data pipelines.
  • Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
  • Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
  • Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
  • Keep scrapers updated when websites change, and document scraping logic for reproducibility.

About You:

You will be a great fit for this role if you have:

Required Skills:

  • Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
  • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
  • Experience in handling large-scale scraping with proxy management and rate-limiting.
  • Basic knowledge of ETL processes and integration with data pipelines.
  • Exposure to graph databases (Neo4j) is a plus.

Soft Skills:

  • Detail-oriented, ensuring accuracy and reliability of collected data.
  • Strong problem-solving skills, particularly in adapting scrapers to evolving web structures.
  • Curious mindset with a drive to discover new data sources.
  • Comfortable working in a fast-paced environment.

About Us:

We are dedicated to leveraging innovative technology and deep domain expertise to solve complex business challenges. Our culture and values:

We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.

  • Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter.
  • Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of our organization.
  • Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
  • Continuous Learning: Our field evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

  • Senior Web Data Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeWebData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Web Data SpecialistWe are seeking an experienced web data specialist to spearhead a long-term project involving strategic data extraction and structuring. This ambitious undertaking requires advanced technical expertise, creativity, and reliability in navigating complex data access challenges.The project involves building a sophisticated...

  • Data Engineering Specialist

    3 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 8,00,000

    Job Title: Data Engineering Specialist We are seeking an exceptional Data Engineering Specialist to join our team. As a key member of our organization, you will play a crucial role in shaping our technology vision and architecture.This position is ideal for a highly motivated individual who thrives on early-stage challenges and loves building innovative,...

  • Expert Collections Professional

    1 week ago

    Vizag, Andhra Pradesh, India beBeeaccountsreceivable Full time ₹ 8,00,000 - ₹ 12,00,000

    Accounts Receivable Specialist RoleWe are seeking a seasoned Accounts Receivable Specialist to oversee the collection process, ensuring timely payments from customers.The ideal candidate will develop effective debt collection strategies, monitor accounts for overdue payments, and determine necessary actions.Negotiate payment plans and resolve customer...

  • Senior Web Security Architect

    2 weeks ago

    Vizag, Andhra Pradesh, India beBeeSecurity Full time ₹ 1,00,00,000 - ₹ 1,56,80,000

    Our organization is seeking a skilled Network Security Specialist to join our Web Application Firewall team.The successful candidate will assist in deploying and maintaining the Firm's internet facing web application security controls, expanding our Web Application Firewall (WAF), Bot Management, CVA protection and API Security Controls capabilities.This...

  • Web Affiliate Marketing Specialist

    7 days ago

    Vizag, Andhra Pradesh, India beBeeAffiliate Full time ₹ 8,00,000 - ₹ 12,00,000

    Expert Web Acquisition Specialist WantedWe are seeking a highly skilled professional to manage and optimize our web-based affiliate network.The ideal candidate will be responsible for:Identifying and recruiting high-performing web affiliates and publishers.Building and maintaining strong relationships with affiliate partners, networks, and...

  • Senior Web Developer

    3 weeks ago

    Vizag, Andhra Pradesh, India BRIDGING FX LIMITED Full time

    Company DescriptionBRIDGING FX LIMITED is a leading turnkey trading solutions provider for Forex brokerages and Cryptocurrency exchanges. The company specializes in developing custom plug-ins and applications for brokers to suit their unique needs. The team is composed of veterans from banking, trading, risk management & consulting backgrounds, coupled with...

  • Senior Data Analyst

    7 days ago

    Vizag, Andhra Pradesh, India beBeeDataAnalyst Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Senior Data Analyst    We are seeking an experienced Senior Data Analyst to join our team. In this role, you will be responsible for collecting, analyzing, and interpreting complex data to inform business decisions and improve operations.You will use statistical methods to collect and organize large datasets, leveraging your problem-solving...

  • Senior Data Integration Specialist

    7 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 17,50,000 - ₹ 22,50,000

    Senior Data Integration SpecialistWe are seeking a seasoned data integration specialist to join our team.Develop scalable data integration solutions utilizing Matillion ELT and Snowflake.Work closely with cross-functional teams to understand data requirements and deliver robust solutions.Collaborate on the research and implementation of new technologies to...

  • Senior Data Development Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Development SpecialistThe Role:We are seeking a skilled data development specialist to play a key role in analyzing business requirements and designing data models to support informed decision-making.Key Responsibilities:Analyze business needs to identify data requirements and design effective data models.Design and model robust data...

  • Senior Web Development Specialist

    1 week ago

    Vizag, Andhra Pradesh, India beBeeAdobe Full time ₹ 15,00,000 - ₹ 25,00,000

    Frontend Web Developer SpecialistWe are seeking a highly skilled Adobe Experience Manager (AEM) Frontend Web Developer to join our digital solutions team.The ideal candidate will have extensive experience in building and maintaining responsive, dynamic web applications using AEM along with modern JavaScript frameworks like React or Angular. You will...