Building Scalable Data Solutions

4 days ago

Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

We are seeking a highly motivated and entrepreneurial professional to join our organization as we build our technology platform from the ground up. You will have the unique opportunity to shape our technology vision, architecture, and engineering culture.

This role is ideal for someone who thrives on early-stage challenges and loves building innovative, scalable solutions.

Key Responsibilities
  • Web Scraping & Crawling: Design and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
    • Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
      • Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
        • Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
          • Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
            • Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
              • Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
      Requirements
      • 2+ years of experience in web scraping, crawling, or data collection.
      • Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
      • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
      • Experience in handling large-scale scraping with proxy management and rate-limiting.
      • Basic knowledge of ETL processes and integration with data pipelines.
      • Exposure to graph databases (Neo4j) is a plus.
      Culture and Values
      • Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter.
      • Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future.
      • Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
      • Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

If you're excited by the opportunity to leverage technology in the fight against fraud, and you're ready to build something impactful, we want to hear from you.

  • Building Scalable Data Architectures

    6 days ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking an experienced and skilled Senior Data Engineer to join our team. As a key member of the data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Microsoft Fabric and Azure Synapse.Key Responsibilities:Design and implement scalable data...

  • Building Scalable Data Pipelines

    2 weeks ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking an experienced data architect to lead the design and implementation of our data pipelines using Snowflake, AWS Lambda, Glue, and SQL.Key Responsibilities:Design and implement scalable data pipelines that integrate with multiple internal and external sources.Develop ETL/ELT pipelines using AWS Glue, Lambda, and DBT for...

  • Data Architect for Scalable Cloud Solutions

    3 days ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 3,00,00,000

    About the RoleWe are seeking a skilled Data Architect to design and implement scalable data solutions on the cloud.Location: BangaloreWork Model: HybridExperience: 5-7 yearsJob Description:The successful candidate will be responsible for building and optimizing data pipelines, warehouses, and data lakes on the cloud. This includes designing scalable data...

  • Scalable Data Solutions Developer

    2 weeks ago

    Nellore, Andhra Pradesh, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,50,000

    Data Engineering OpportunityWe are looking for a skilled and detail-oriented Data Engineer with expertise in Azure, SQL Server, and Databricks to design, build, and manage scalable data pipelines and enterprise data solutions.This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering high-quality, reliable,...

  • Building Scalable Financial Infrastructure as a Backend Developer

    1 week ago

    Nellore, Andhra Pradesh, India beBeeDevelopment Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Backend Software Engineer PositionWe are building the next-generation financial infrastructure for global education.We help students from emerging markets access study-abroad opportunities through intelligent lending, automation, and full-stack support.As a backend software engineer in this role, you will:Design scalable systems using Golang, Python, and...

  • Scalable Machine Learning Solutions for Food Safety

    1 week ago

    Nellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Biotech Data Scientist OpportunityWe're seeking a skilled Biotech Data Scientist to join our team and design, build, and deploy scalable machine learning models that power our cutting-edge food safety platform.As a Biotech Data Scientist, you'll work closely with data scientists, engineers, and domain experts to translate requirements into production-ready...

  • Lead Data Solutions Architect

    1 week ago

    Nellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Join Our Data Engineering TeamWe are seeking a skilled Data Engineer to design, build, and optimize scalable data solutions using Google Cloud Platform (GCP) and AtScale.Key Responsibilities:Work with AtScale and GCP services (BigQuery, etc.) to create robust data analytics solutions that meet business needs.Design, develop, and deploy scalable data...

  • Building Scalable Backend Systems

    2 days ago

    Nellore, Andhra Pradesh, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Backend Software EngineerWe're developing an innovative workspace that leverages AI to drive growth and success.This high-growth environment is seeking a seasoned backend software engineer to join our development team.What You'll Do:Design, build, and scale backend systems that power our AI-driven workspace.Develop APIs and services to support real-time...

  • Chief Data Solutions Architect

    2 days ago

    Nellore, Andhra Pradesh, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Migration SpecialistWe are seeking a seasoned professional to lead the development and deployment of cloud-based data solutions. This role involves overseeing the technical direction of projects, mentoring team members, and delivering scalable and efficient systems using cloud and big data technologies.Key Responsibilities:Design, develop, and...

  • Data Engineer

    1 week ago

    Nellore, Andhra Pradesh, India aQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable PostgreSQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...