Chief Data Architect

2 weeks ago

Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000
Data Engineer Job Description

We're seeking a skilled Data Engineer to build scalable, innovative solutions from scratch.

This exciting opportunity is for someone passionate about web scraping and crawling, with experience in handling large-scale data collection using proxy management and rate-limiting.

Key Responsibilities:
  1. Scalable Scraping Systems: Design and implement multi-threaded, distributed crawlers that can handle high-volume data collection without interruptions.
  2. Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
  3. Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
  4. Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
  5. Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
  6. Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.
Requirements:
  • 2+ years of experience in web scraping, crawling, or data collection.
  • Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
  • Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
  • Experience in handling large-scale scraping with proxy management and rate-limiting.
  • Basic knowledge of ETL processes and integration with data pipelines.
  • Exposure to graph databases (Neo4j) is a plus.
About Us:

We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.

  • Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter for our customers.
  • Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of Gala Intelligence.
  • Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
  • Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

  • Chief Cloud Data Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About this RoleData Architect – Snowflake & MatillionKey Responsibilities:Data Architecture Design: Develop data architecture and modeling solutions using Snowflake and Matillion for data ingestion, transformation, and storage.Data Modeling Standards: Define and maintain data modeling standards, data flows, and architecture best practices (dimensional,...

  • Data Solution Architect

    2 weeks ago

    Kottayam, Kerala, India JK Lucent Full time

    Data Solution ArchitectLocation: Sydney,Type: Initial 3-Month Contract (Work from Office)Possible ExtensionAbout UsAt JK Lucent, we deliver intelligent IT solutions powered by innovation, automation, and deep industry knowledge. With a strong presence in Australia and an operations centre in one of India's largest IT parks, we are known for building agile...

  • Data Architect

    2 weeks ago

    Kottayam, Kerala, India Pixeldust Technologies Full time

    Role Overview:We are seeking a highly skilled Data Architect - GCP with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP). The ideal candidate will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration, with proven expertise in...

  • Leading Data Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time ₹ 45,00,000 - ₹ 60,00,000

    Senior Data Architect PositionWe are seeking a highly skilled Senior Data Architect to join our team.About the Role:The Senior Data Architect will be responsible for designing and implementing data strategy in finance space, including controllership, FP&A, and GPO. This role requires strong technical expertise, as well as excellent communication and project...

  • Chief Data Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering RoleA company seeks a skilled Data Engineer to join their analytics division. The ideal candidate will conceptualize and build out problem-solving data marts for consumption by data science and BI teams, evaluating design and operational tradeoffs within systems.Key Responsibilities:Create robust data pipelines and ETL processes using data...

  • Data Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time ₹ 35,00,000 - ₹ 55,00,000

    Job Description">We are seeking a skilled Data Architect to collaborate with our team and contribute to the development of a robust data infrastructure that powers insights and analytics for slot games. You will design, develop, and maintain scalable data pipelines ensuring high-quality reliable data for player behavior analysis, game performance, and...

  • Data Architect

    2 weeks ago

    Kottayam, Kerala, India InfoBeans Full time

    About the JobJob Title: Data Architect – Snowflake & Matillion Skills: Snowflake, Matillion, Data Modeling, SQL, Python/Bash, Cloud Platforms (AWS/Azure) Experience Required: 5+ Years Location: Remote Notice Period: Immediate to 15 days preferredJob DescriptionWe are seeking an experienced Data Architect to lead data architecture and modeling with a focus...

  • Chief Information Security Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeInformation Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Key to our team's success is an Information Security Strategist who will develop and implement comprehensive information security strategies, policies, standards, and procedures aligned with industry best practices and regulatory standards. Working closely with the Chief Information Security Officer (CISO), this individual ensures all information assets are...

  • Senior Data Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:We are seeking a seasoned Senior Data Architect to lead the design and implementation of our data infrastructure. This role requires a strong foundation in computer science, data engineering, and experience in working with various technologies.Key Responsibilities:Develop and maintain robust data pipelines for both structured and unstructured...

  • Senior Financial Data Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeDataDriven Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Drive Innovation in Financial Data ArchitectureWe are seeking an experienced professional to lead the modernization of our finance data platform. As a key member of our team, you will play a pivotal role in shaping next-generation financial data architecture.Snowflake Solutions Architect: Design and implement enterprise-grade data warehouse solutions...