Data Architect and Automation Specialist

7 days ago

Bengaluru, Karnataka, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title:
Data Architect and Automation Specialist
We are seeking an experienced data architect and automation specialist to join our team. This is a unique opportunity to leverage your technical expertise in designing and implementing high-volume scraping pipelines, distributed crawlers, and resilient APIs that power our next-generation AI products. About the RoleIn this role, you will be responsible for leading the design and implementation of large-scale data ingestion systems using modern frameworks. You will work closely with frontend, ML, and product teams to define requirements and ship new capabilities. Additionally, you will mentor junior engineers and set coding standards and best practices.As a data architect and automation specialist, you will have expertise in database design, caching, and networking fundamentals. You will also have solid experience with REST/gRPC APIs, microservice architecture, and CI/CD pipelines.Some of the key responsibilities of this role include:
  • Architect and maintain distributed web crawlers capable of operating at scale while handling rate limits, rotating proxies, CAPTCHAs, and other anti-bot measures.
  • Design strategies to adapt to frequent changes in website structures and anti-automation tactics.
  • Design, build, and optimize high-performance microservices/APIs using modern frameworks.
  • Implement resilient job queues, caching, and message brokers for large-scale data ingestion.
  • Create pipelines for structured/unstructured data cleaning, transformation, and storage.
  • Ensure consistency, high availability, and horizontal scalability.
  • Apply strong security practices (network isolation, credential management, encryption, IaaC with SST).
  • Ensure compliance with applicable data-use and privacy regulations.
If you are a motivated and experienced professional with a passion for building scalable data-extraction systems and robust automation services, we encourage you to apply for this exciting opportunity. RequirementsTo be successful in this role, you should have:
  • 2+ years of backend engineering experience.
  • Proven experience in reverse engineering, web scraping, browser automation, and/or bot evasion techniques.
  • Proficiency in at least one major backend language.
  • Strong experience with REST/gRPC APIs, microservice architecture, and CI/CD pipelines.
  • Expertise in database design and caching.
  • Solid understanding of networking fundamentals.
We offer a dynamic and challenging work environment that encourages innovation and collaboration. If you are passionate about building cutting-edge technology solutions and want to grow your career with a forward-thinking organization, please submit your application today.

  • Enterprise Architect

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Enterprise Architect - Applications Presales - India Remote Enterprise Architect - Applications Presales - India Remote Position Overview What is the nature of the position and its services provided to the client We are currently seeking a Technical Solutions Architect Specialist Advisor to join our team in Bengaluru India Remote As...

  • Data Architect Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,40,000 - ₹ 28,00,000

    **Data Architect Specialist**">In this exciting role, you will be responsible for designing and implementing data pipelines to support the training and fine-tuning of our knowledge base and user data. Your focus will be on ensuring high-quality, scalable, and efficient data integration.">Key Responsibilities:

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India Vortunix Data Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Lead and mentor a team of data scientists, ML engineers, and research scientists.Drive AI/ML strategy aligned with business goals.Architect scalable ML, NLP, and Generative AI solutions.

  • Automation Architect

    2 weeks ago

    Bengaluru, Karnataka, India Test Yantra Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Description - Automation ArchitectAbout Fireflink :Fireflink is a AI & SaaS based product company. We develop AI software products for Automation, RPA & Cloud. We empower global enterprises with cutting-edge platforms and an innovation-first culture.Role : Automation ArchitectLocation : BangaloreExperience : 6-10 years in Test AutomationEmployment Type :...

  • Automation Architect

    2 weeks ago

    Bengaluru, Karnataka, India Test Yantra Software Soultions Full time

    Job Description - Automation ArchitectAbout Fireflink :Fireflink is a AI & SaaS based product company. We develop AI software products for Automation, RPA & Cloud. We empower global enterprises with cutting-edge platforms and an innovation-first culture.Role : Automation ArchitectLocation : BangaloreExperience : 6-10 years in Test Automation Employment Type...

  • Automation Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeAutomation Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Summary:We are seeking a skilled Automation Specialist to join our team. This role involves designing, building, and maintaining automation workflows using no-code and low-code tools such as Make.com, n8n, Zapier.The ideal candidate will have strong hands-on experience with these tools, a solid understanding of API integrations, webhooks, and data...

  • Data Architect Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title:">Lead data architects play a key role in designing and implementing data architectures to achieve optimum value from data. They are the technical leaders within data delivery teams, responsible for modelling data for optimal reuse, interoperability, security, and accessibility.The lead data architect is responsible for overseeing the entire data...

  • Automation System Architect

    5 days ago

    Bengaluru, Karnataka, India beBeeAutomation Full time ₹ 18,00,000 - ₹ 21,00,000

    Automation Control SpecialistAs a highly skilled Automation Control Specialist, you will be responsible for leading the development and delivery of our Cognitive AI Platform. This role involves overseeing a coordinated set of projects to ensure they collectively achieve strategic business objectives.Key Responsibilities:Drive Strategic AlignmentProvide...

  • Data Architect Position

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Data Architect SpecialistWe are seeking a skilled and motivated data architect to design, develop, and maintain scalable data systems that process and transform large volumes of structured and unstructured data.

  • Automation Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeAutomation Full time ₹ 1,86,00,000 - ₹ 2,51,00,000

    Automation SpecialistThis role will focus on building scalable automation workflows, approval systems, analytics dashboards, and intelligent notification platforms.Key Responsibilities:Design and develop Python-based automation systems for workflow orchestration, approval pipelines, and task management.Build reusable modules for notifications, approvals, and...