Senior Python Platform Architect

2 weeks ago

Thoothukudi, Tamil Nadu, India beBeePythonEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

About this role:

We are seeking an experienced software engineer to lead the development of our Python-based platform.

Main Responsibilities:

  • Design and build a shared component library/SDK for data pipelines: ingestion, parsing/extraction, validation, enrichment, publishing.
  • Define patterns/templates for Apache Beam pipelines and Databricks jobs; standardize configuration, packaging, versioning, CI/CD, and documentation.
  • Create pluggable interfaces so multiple teams can swap extractors (Regex/LLM), OCR providers, and EMR publishers without code rewrites.
  • Define repository strategy - shared/child repositories for each use case
  • Performance and Reliability:
    • Own end-to-end profiling and tuning: profiling tools, memory analysis.
    • Instrument services with APM and correlate traces/metrics with logs; build dashboards and runbooks.
    • Implement concurrency best practices: asyncio for I/O-bound, threading for CPU-bound, batching, rate limiting, retries, etc.
    • Implement robust API rate limiting/governance: enforce provider limits and concurrency caps, request queueing/token budgeting, and emit metrics with alerts.
    • Establish SLAs/alerts for throughput, latency, error rates; set up dead letter queues and recovery patterns.
  • Team Enablement:
    • Mentor developers, lead design reviews, codify best practices, write clear documentation and examples.
    • Partner with ML engineers on the future LLM/SLM path (evaluation harness, safety/PII).

Required Skills and Qualifications:

  • 7+ years experience in Python with strong depth in performance and concurrency (asyncio, threading), profiling and memory tuning.
  • Observability expertise: APM instrumentation and dashboarding; logging and correlation; OpenTelemetry familiarity.
  • Must have implemented LLM based solutions and supported them in production
  • API engineering for high-throughput integrations (REST, OAuth2), resilience patterns, and secure handling of sensitive data.
  • Strong architecture/design skills: clean interfaces, packaging shared libraries, versioning, CI/CD, testing.
  • 3+ years building large-scale data pipelines with Apache Beam and/or Spark, including hands-on Databricks experience (Jobs, Delta Lake, cluster tuning).
  • Document processing: OCR (Tesseract, AWS Textract, Azure Form Recognizer), PDF parsing, text normalization.
  • LLM/SLM integration experience (e.g., OpenAI/Azure AI), prompt/eval frameworks, PII redaction/guardrails.
  • Cloud and tooling: AWS/Azure/GCP, Dataflow/Flink, Terraform, Docker; cost/performance tuning on Databricks.
  • Security/compliance mindset (HIPAA), secrets management, least-privilege access.

  • Chief Platform Architect

    5 days ago

    Thoothukudi, Tamil Nadu, India beBeePlatform Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleSeeking a visionary technical leader to spearhead platform development and drive technology strategy.Key Responsibilities:Design and architecture of robust, scalable platform modules, aligning with business objectives and technical standards.Implementation of platform solutions, collaborating closely with cross-functional teams to achieve...

  • AI Platform Architect

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeAI Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    At the forefront of innovation, we're revolutionizing the recruitment industry with our cutting-edge AI platform.As a key member of our project initiative, you'll play a pivotal role in transitioning from a service model to a technology-driven platform.This is a unique opportunity to join a pioneering startup as a foundational architect, creating a new...

  • Senior Cloud Data Architect

    1 week ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Architect RoleJob Description:Design and develop scalable data warehouse architecture using AWS, Spark, Pyspark, Python, SQL, and Databricks.Architect and implement workflow management systems using Airflow.Develop high-quality features, manage tasks to a high standard, and lead a team of senior engineers.Propose and implement architecture...

  • Senior Cloud Data Specialist

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Architect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an accomplished data architect to spearhead the development of scalable data solutions. The ideal candidate will have a strong background in cloud-based data platforms, Python programming, and modern data warehousing practices. This role involves designing, building, and maintaining reliable data pipelines on AWS, ensuring smooth...

  • Senior AI Platform Architect

    1 week ago

    Thoothukudi, Tamil Nadu, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role:We are seeking an experienced architect to design, develop and maintain cutting-edge build and test environments for critical GenAI workloads running on foundational cloud infrastructure.This position involves partnering with architects to design and implement highly robust and scalable systems, while providing crucial development support to...

  • Senior Platform Engineer

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeEngineering Full time ₹ 1,96,00,000 - ₹ 2,61,50,000

    Job Title: Senior Engineering LeaderWe are seeking a highly experienced and visionary Senior Engineering Leader to join our team. As a key member of the engineering organization, you will be responsible for driving the strategy and execution of the platform organization.The ideal candidate will have a deep understanding of software development principles,...

  • Chief Data Platform Architect

    5 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Key Challenges Facing the Ideal CandidateThe ideal candidate will have a strong background in building scalable, secure, and compliant cloud-native platforms. They will be responsible for developing and communicating a clear platform vision to enable business growth and operational efficiency.The job requires a highly skilled professional who can partner...

  • Senior Python Developer for Hx Platform Projects

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeePythonDeveloper Full time US$ 1,00,000 - US$ 1,20,000

    About This RoleWe are seeking a highly skilled Python Developer with expertise in the Hx Platform to join our team.

  • Python Lead/Architect – Scalable AI Solutions

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeai Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Job Title: AI Architect – Scalable SolutionsWe are seeking an experienced Python architect to lead the development of cutting-edge generative AI solutions. The ideal candidate will have a strong foundation in backend engineering and recent production experience in Generative AI.The role involves designing and implementing Python-based microservices...

  • SaaS Platform Architect

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeVisionary Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Chief Technology Officer Job Description**We're on a mission to create the future of B2B SaaS marketplaces & event platforms. Our vision is to connect SaaS companies with decision-makers through virtual events, product demos, and curated lead-generation experiences.With 10,000+ key executives already in our ecosystem, the next step is building a scalable...