Python Platform Architect

4 days ago

Chennai, Tamil Nadu, India beBeePlatform Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Python Platform Architect
We are seeking an experienced Python Platform Architect to lead the design and implementation of our data pipelines using Apache Beam and Databricks. The successful candidate will have a strong background in performance and concurrency, as well as expertise in observability, API engineering, and cloud technologies.
Key Responsibilities:
  • Architecture and Reuse:
    • Design and implement a shared component library/SDK for pipelines, including ingestion, parsing, extraction, validation, enrichment, and publishing.
    • Define patterns/templates for Apache Beam pipelines and Databricks jobs, standardizing configuration, packaging, versioning, CI/CD, and documentation.
    • Create pluggable interfaces so multiple teams can swap extractors, OCR providers, and EMR publishers without code rewrites.
    • Develop a repository strategy - shared/child repositories for each use case.
  • Performance and Reliability:
    • Own end-to-end profiling and tuning, including cProfile, py-spy, line_profiler, memory (tracemalloc), CPU vs I/O analysis.
    • Instrument services with Elastic APM and correlate traces/metrics with Splunk logs, building dashboards and runbooks.
    • Implement concurrency best practices: asyncio for I/O-bound, ThreadPool/ProcessPool for CPU-bound, batching, rate limiting, retries, etc.
    • Implement robust LLM API rate limiting/governance, enforcing provider TPM and concurrency caps, request queueing/token budgeting, and emitting APM/Splunk metrics with alerts.
    • Establish service level objectives/alerts for throughput, latency, error rates; set up dead-letter queues and recovery patterns.
  • Team Enablement:
    • Mentor developers, lead design reviews, codify best practices, write clear documentation and examples.
    • Partner with machine learning engineers on the future LLM/SLM path (evaluation harness, safety/PII, cost/perf).
    Required Skills and Qualifications:
    • 7+ years of Python experience with strong depth in performance and concurrency (asyncio, concurrent.futures, multiprocessing), profiling, and memory tuning.
    • Observability expertise: Elastic APM instrumentation and dashboarding; Splunk for logs and correlation; OpenTelemetry familiarity.
    • Must have implemented large language model-based solutions and supported them in production.
    • API engineering for high-throughput integrations (REST, OAuth2), resilience patterns, and secure handling of sensitive data.
    • Strong architecture/design skills: clean interfaces, packaging shared libraries, versioning, CI/CD (GitHub Actions/Azure DevOps), testing.
    • 3+ years of building large-scale data pipelines with Apache Beam and/or Spark, including hands-on Databricks experience (Jobs, Delta Lake, cluster tuning).
    • Document processing: OCR (Tesseract, AWS Textract, Azure Form Recognizer), PDF parsing, text normalization.
    • LLM/SLM integration experience (e.g., OpenAI/Azure AI, local SLMs), prompt/eval frameworks, PII redaction/guardrails.
    • Cloud and tooling: AWS/Azure/GCP, Dataflow/Flink, Terraform, Docker; cost/performance tuning on Databricks.
    • Security/compliance mindset (HIPAA), secrets management, least-privilege access.
    Benefits:

Competitive salary and benefits package, culture focused on talent development, opportunities to work with cutting-edge technologies, employee engagement initiatives, annual health check-ups, and insurance coverage.

Persistent Systems fosters diversity and inclusion in the workplace, supporting hybrid work and flexible hours. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

  • Python Cloud Architect

    3 days ago

    Chennai, Tamil Nadu, India beBeeTechnicalLead Full time ₹ 1,50,00,000 - ₹ 2,02,50,000

    Technical Leadership OpportunityAs a Senior Technical Lead, you will be responsible for guiding and overseeing a team of developers in designing, developing, testing, and deploying Python-based solutions on cloud platforms using microservices architecture.Key Responsibilities:Guide and mentor a team of developers in designing, developing, testing, and...

  • Senior Python Developer

    1 day ago

    Chennai, Tamil Nadu, India beBeePython Full time US$ 1,50,000 - US$ 2,00,000

    Job DescriptionWe are seeking an experienced Python professional with a passion for architecting robust solutions and leading dynamic teams to join our organization in Chennai. The ideal candidate will have a strong background in the financial technology sector, excellent coding skills, and a proven track record in both leadership and architectural...

  • BPM Architect with Java/Python hands-on

    2 days ago

    Chennai, Tamil Nadu, India Saaki, Argus & Averil Consulting Full time

    About the Client:A leading global BPM company providing technology-driven solutions and outsourcing services across industriesRole: BPM Architect with Java / PythonExperience: 10+ yearsLocation: Anywhere in India (Remote)Role Summary: We are looking for an experienced BPM Architect with strong Java/Python hands-on experience who is eager to transition into...

  • Platform Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India ESDS Software Solution Limited Full time

    At ESDS Software Solutions Ltd., we are pioneering innovative, scalable, and secure platform solutions that power mission-critical products and services. We are looking for an experienced Platform Developer who can design, develop, and maintain the core software platforms that form the backbone of our Autonomous Cloud ecosystem.Key Responsibilities-Platform...

  • Senior Python Architect for GenAI Integration

    2 days ago

    Chennai, Tamil Nadu, India beBeeArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewThis role is responsible for leading the end-to-end architecture and design of Python-based applications integrated with GenAI capabilities. The ideal candidate will translate business and product requirements into modular, scalable, and maintainable technical solutions.Key ResponsibilitiesDesign and implement robust Python-based backend systems...

  • Platform Payments Architect

    2 days ago

    Chennai, Tamil Nadu, India beBeePayments Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Platform Payments ArchitectAs a seasoned and accomplished Platform Payments Architect, you will lead the development of scalable and secure payment systems. This is an exciting opportunity to work with cutting-edge technologies and drive innovation in the payments industry.Key Responsibilities:Design, develop, and deploy payment systems that meet...

  • Python Data Architect

    23 hours ago

    Chennai, Tamil Nadu, India Wipro Full time US$ 1,50,000 - US$ 2,00,000 per year

    Core Qualifications12+ years in software/data architecture with hands on experience.Agentic AI & AWS Bedrock (MustHave): Demonstrated handson design, deployment, and operational experience with Agentic AI solutions leveraging AWS Bedrock and AWS Bedrock Agents.Deep expertise in cloud-native architectures on AWS (compute, storage, networking, security).Proven...

  • Platform Engineer

    4 days ago

    Chennai, Tamil Nadu, India ESDS Software Solution Limited Full time

    At ESDS Software Solutions Ltd., we are pioneering innovative, scalable, and secure platform solutions that power mission-critical products and services. We are looking for an experienced Platform Developer who can design, develop, and maintain the core software platforms that form the backbone of our Autonomous Cloud ecosystem. Key Responsibilities-...

  • Platform Engineer

    9 hours ago

    Chennai, Tamil Nadu, India ESDS Software Solution Limited Full time

    At ESDS Software Solutions Ltd., we are pioneering innovative, scalable, and secure platform solutions that power mission-critical products and services. We are looking for an experienced Platform Developer who can design, develop, and maintain the core software platforms that form the backbone of our Autonomous Cloud ecosystem.Key Responsibilities-Platform...

  • Data Platform Architect

    2 days ago

    Chennai, Tamil Nadu, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:AI and Data Engineering SpecialistJob Description:We are seeking a highly skilled AI and Data Engineering Specialist to join our growing team. As a specialist in this field, you will be responsible for designing and developing cutting-edge data platforms that drive meaningful business outcomes.You will work closely with cross-functional teams to...