Data Architecture Specialist

1 week ago

Kannur, Kerala, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

Shape the technology vision and architecture of our platform from scratch, pioneering a robust data foundation.

This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero.

Your Key Responsibilities
  • We're seeking a highly skilled individual to build and maintain automated web scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
  • The successful candidate will develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
  • Normalization of scraped data, removal of noise, and ensuring consistency before passing to data pipelines is crucial.
  • Implementing proxy rotation, captcha solving, and request throttling techniques is necessary to handle scraping restrictions.
  • Clean, structured datasets must be delivered into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
  • Data accuracy, deduplication of records, and maintaining a trust scoring system for data confidence are essential.
  • Scrapers must be updated when websites change, and documentation of scraping logic for reproducibility is required.
Your Skills and Qualifications
  • A minimum of 2 years of experience in web scraping, crawling, or data collection.
  • Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
  • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
  • Experience in handling large-scale scraping with proxy management and rate-limiting.
  • Basic knowledge of ETL processes and integration with data pipelines.
  • Exposure to graph databases (Neo4j) is a plus.
About Us

We're a cutting-edge startup dedicated to solving one of the most pressing business challenges - fraud detection and prevention. Our real-time products empower consumers and businesses to stay ahead of fraudsters.

We value transparency, collaboration, and individual ownership, creating an environment where talented people can thrive.

  • Data Architectural Specialist

    4 days ago

    Kannur, Kerala, India beBeeCloudComputing Full time ₹ 45,00,000 - ₹ 85,00,000

    Job DescriptionWe are seeking a highly skilled and experienced Senior Software Engineer/Technical Specialist to join our team.The successful candidate will be responsible for developing and optimizing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics. They will also design and implement scalable data architectures following...

  • Senior Data Architectural Specialist

    6 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Architecture and Modeling PositionWe are seeking an experienced professional to join our team as a Data Architecture and Modeling Analyst.This role requires designing and implementing data architectures that meet business needs. The ideal candidate will possess strong technical skills, including experience with Microsoft SQL Server 2019, Databricks, and...

  • Senior Data Architecture Specialist

    2 weeks ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:As a seasoned data engineer, you will be responsible for maintaining architecture principles, guidelines, and standards for data warehousing and big data solutions. Your expertise in designing and implementing solutions using Google Cloud Platform services such as Big Query, Bigtable, Cloud SQL, Data Proc, Data Flow, and Data Fusion will be...

  • Data Protection Specialist

    1 week ago

    Kannur, Kerala, India beBeePaymentSecurity Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    Payment Security and Data Architecture SpecialistWe are seeking a highly skilled Payment Security and Data Architecture Specialist to join our team. The ideal candidate will have a strong background in payment security, data architecture, and tech risk management.This role will be responsible for providing independent oversight and expert guidance on payment...

  • Data Architectural Specialist

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Senior Data Engineer Opportunity**We are seeking an experienced Senior Data Engineer to join our team.The successful candidate will be responsible for designing and building robust, scalable, and high-quality data pipelines that support analytics and reporting needs.This role requires a deep understanding of data engineering principles, cloud platforms,...

  • Chief Data Architecture Specialist

    1 week ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionData Engineering Leadership RoleWe are seeking a seasoned Data Engineering Lead to spearhead our data pipeline initiatives, driving the development of high-quality data ingestion and validation processes.This role is responsible for building scalable data pipelines using Python, Alteryx, and integration into reporting tools, ensuring data...

  • Civil Engineering and Architecture Recruitment Specialist

    7 days ago

    Kannur, Kerala, India beBeeEngineering Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Civil Engineering and Architecture Recruitment SpecialistWe are seeking a motivated and experienced recruitment specialist to join our team in the US.The ideal candidate will have strong knowledge of civil engineering and architectural roles, excellent sourcing and screening skills, and the ability to work night shifts to align with US business hours.Source,...

  • Cloud Architecture Specialist

    2 weeks ago

    Kannur, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: AWS Data ArchitectWe are seeking an experienced AWS Data Architect to join our team. The successful candidate will be responsible for designing and implementing data architectures using AWS-native services.Design End-to-End Data Architectures: Using AWS-native services such as Glue, Redshift, Athena, EMR, S3, Lambda, Kinesis, DynamoDB, and...

  • Enterprise Architecture Specialist

    1 week ago

    Kannur, Kerala, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewThe ideal candidate will define and evolve the platform architecture, ensuring alignment with organizational priorities.Define and evolve the platform architecture to align with organizational priorities.Lead workshops and discovery sessions to align platform modernization with organizational priorities.Key ResponsibilitiesThe successful...

  • Chief Data Architecture Officer

    1 week ago

    Kannur, Kerala, India beBeeDataSystems Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Systems Architect">Job Description: We are seeking an experienced Senior Data Systems Architect to lead the design and implementation of high-performance, scalable data solutions. As a key member of our team, you will be responsible for architecting and overseeing the deployment of advanced data systems, ensuring compliance with non-functional...