Data Architecture Specialist

6 days ago

Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

We are seeking an accomplished Data Engineer to play a pivotal role in shaping our technology vision and architecture. With the opportunity to build our platform from scratch, you will have the freedom to drive innovation and spearhead the development of scalable web scraping systems.

Key Responsibilities
  • Design and implement large-scale data collection frameworks using Python libraries like BeautifulSoup, Scrapy, Selenium, and Playwright.
  • Extract structured and unstructured data from websites, APIs, and public datasets with efficient handling of high-volume data collection.
  • Develop multi-threaded crawlers capable of handling massive scraping tasks with proxy management and rate-limiting.
  • Implement anti-bot and evasion tactics such as proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
  • Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
Requirements
  • 2+ years of experience in web scraping, crawling, or data collection.
  • Strong proficiency in Python, familiarity with NoSQL databases, and data serialization formats.
  • Experience in handling large-scale scraping with proxy management and rate-limiting.
  • Basic knowledge of ETL processes and integration with data pipelines.
  • Familiarity with graph databases is a plus.
Culture and Values
  • Problem-Driven Innovation: We're committed to solving real challenges that genuinely matter for our customers.
  • Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of our organization.
  • Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
  • Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

  • Data Pipeline Architectural Specialist

    1 week ago

    Kota, Rajasthan, India beBeeDataDriven Full time ₹ 10,00,000 - ₹ 15,00,000

    **Data Pipeline Architectural Specialist**Create and maintain scalable data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.Design and develop efficient relational databases with a preference for Aurora Postgres.Develop complex SQL queries and stored procedures to drive business insights.Troubleshoot and resolve data quality issues...

  • Data Architecture Specialist

    1 week ago

    Kota, Rajasthan, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Azure Data Engineer RoleSeeking an experienced Azure Data Engineer to lead our data engineering efforts. As a key member of our team, you will design, develop, and maintain large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and implement scalable data architectures on AzureDevelop and deploy data pipelines using Azure services...

  • Data Architectural Expert

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Architectural ExpertiseAs a seasoned data architectural expert, you will be responsible for maintaining architecture principles, guidelines and standards for data engineering.Maintaining and implementing data architecture principles to guide the development of scalable data systems.Expertise in designing and developing robust data warehouses, big data...

  • Big Data Specialist

    2 weeks ago

    Kota, Rajasthan, India beBeeData Full time ₹ 12,00,000 - ₹ 24,00,000

    Job OverviewWe're seeking a highly skilled Big Data Specialist to join our team.About the RoleThis is a unique opportunity to work with large-scale data processing for LLM development. As a Big Data Specialist, you will design, build, and operate scalable, fault-tolerant data infrastructure to support distributed computing and data orchestration for LLM...

  • Data Architecture Leader

    1 week ago

    Kota, Rajasthan, India beBeeCloudData Full time ₹ 18,00,000 - ₹ 30,00,000

    Our cloud data architecture team is at the core of our organization's skillset.Years of Experience: 12-16 yearsJob Description:We are seeking a seasoned professional to lead projects involving AWS Databricks and Python.AWS Native data Architecture and services like S3, Lambda, Glue, and EMR are a must-have.Databricks Spark, experience with handling AWS Cloud...

  • Data Architecture Expert

    2 weeks ago

    Kota, Rajasthan, India beBeeDataExpert Full time ₹ 18,00,000 - ₹ 22,00,000

    Nurturing a Strong Data Ecosystem is a vital role for any organization.Key Responsibilities:Developing robust data warehouse models using BigQuery and SnowflakeDesigning and implementing effective visualizations for actionable insightsRequirements:Advanced SQL skills with experience in data warehousesAt least 2 years of experience with data warehouse...

  • Data Engineering Specialist

    1 week ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Join a dynamic team of data experts as a Data Engineering Specialist. This role involves the design, development, and maintenance of large-scale data systems. Your strong programming skills and experience with data architecture will be key to delivering efficient and scalable solutions.Key Responsibilities:Develop robust data pipelines using various tools...

  • Data Architecture Specialist

    2 weeks ago

    Kota, Rajasthan, India beBeeArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About UsWe partner with innovative brands to empower businesses through integrated customer experience and cutting-edge digital solutions.Our expertise spans digital transformation, AI-driven consulting, IT lifecycle management, and more – delivered with secure infrastructure, value-driven pricing, and exceptional service.Achieving Data Maturity: Shaping...

  • AWS Cloud Data Infrastructure Specialist

    2 weeks ago

    Kota, Rajasthan, India beBeeDataExpert Full time ₹ 2,00,00,000 - ₹ 2,25,00,000

    Key Data Architect RoleA seasoned expert in AWS data architecture is required to oversee the development and implementation of scalable, performant, and cost-optimized data solutions using AWS-native services.Architecture Expertise: Leverage expertise in designing data lakes, data warehouses, ETL/ELT pipelines using Glue, Redshift, Athena, EMR, S3, Lambda,...

  • Data Systems Specialist

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 24,00,000

    Job Title: Data Systems SpecialistA top candidate for this role will be able to effectively integrate and process channel activity data from multiple sources.Job Description:We are looking for a highly skilled Data Systems Specialist with expertise in digital channel activities, data engineering, and cloud technologies. The ideal candidate will possess...