Lead Python Platform Engineer

2 days ago

Pune, Maharashtra, India Persistent Systems Full time
We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc.,

Role: Lead Python Platform Engineer – Architecture & Performance

Experience: 3 to 7 Years

Job Type: Full Time Employment

Design and build a shared component library/SDK for pipelines: ingestion, parsing/OCR, extraction (RegEx now, LLM/SLM later), validation, enrichment, publishing.

standardize configuration, packaging, versioning, CI/CD, and documentation.

Create pluggable interfaces so multiple teams can swap extractors (Regex/LLM), OCR providers, and EMR publishers without code rewrites.

Define repo strategy - shared/child repos for each use case

~ Performance and reliability:

Own end-to-end profiling and tuning: cProfile/py-spy/line_profiler, memory (tracemalloc), CPU vs I/O analysis.

Instrument services with Elastic APM and correlate traces/metrics with Splunk logs; Implement robust LLM API rate limiting/governance: enforce provider TPM and concurrency caps, request queueing/token budgeting, and emit APM/Splunk metrics (throttle rate, queue depth, cost per job) with alerts.

Mentor devs, lead design reviews, codify best practices, write clear docs and examples.

Partner with ML engineers on the future LLM/SLM path (evaluation harness, safety/PII, cost/perf).

7+ years Python with strong depth in performance and concurrency (asyncio, concurrent.Splunk for logs and correlation; Must have implemented LLM based solutions and supported them in production

~ API engineering for high-throughput integrations (REST, OAuth2), resilience patterns, and secure handling of sensitive data.

~ Strong architecture/design skills: clean interfaces, packaging shared libs, versioning, CI/CD (GitHub Actions/Azure DevOps), testing.

~3+ years building large-scale data pipelines with Apache Beam and/or Spark, including hands-on Databricks experience (Jobs, Delta Lake, cluster tuning).

~ OCR (Tesseract, AWS Textract, Azure Form Recognizer), PDF parsing, text normalization.

~ LLM/SLM integration experience (e.g., OpenAI/Azure AI, local SLMs), prompt/eval frameworks, PII redaction/guardrails.

~ Cloud and tooling: AWS/Azure/GCP, Dataflow/Flink, Terraform, Docker; cost/performance tuning on Databricks.

~ Security/compliance mindset (HIPAA), secrets management, least-privilege access.

Competitive salary and benefits package

Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.

  • Lead Python Platform Engineer

    6 days ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc., Role: Lead Python Platform Engineer – Architecture & Performance Location: All PSL Locations Experience: 3 to 7 Years Job Type: Full Time Employment What You'll Do: Architecture and reuse: Design and build a shared component...

  • Lead Python Platform Engineer

    2 days ago

    Pune, Maharashtra, India Persistent Systems Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    About Position:We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc.,Role: Lead Python Platform Engineer – Architecture & PerformanceLocation: All PSL LocationsExperience: 3 to 7 YearsJob Type: Full Time EmploymentWhat You'll Do:Architecture and reuse:Design and build a shared component library/SDK for pipelines:...

  • Lead Python Engineer

    5 days ago

    Pune, Maharashtra, India 91HR Full time

    Job Description :We are seeking a highly skilled and experienced Python Lead to join our team. The ideal candidate will have strong expertise in Python coding and development, along with good-to-have skills in cloud technologies, SQL, and data analysis.Key Responsibilities :- Lead the development of high-quality, scalable, and robust Python applications.-...

  • Python Engineering Lead

    7 days ago

    Pune, Maharashtra, India beBeeGenerative Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Python Architect - Generative AIWe are seeking a skilled Python Architect with a strong background in backend engineering and recent experience in Generative AI. The ideal candidate will have 8–10 years of core Python development experience, along with 2–2.5 years of focused engineering work in GenAI and microservices.Design and implement...

  • Tech Lead – Python

    4 days ago

    Pune, Maharashtra, India Seekify Global Full time ₹ 20,00,000 per year

    We're looking for a hands-on Technical Lead with expertise in Python, Generative AI, LLMs, and RAG to lead innovative AI projects from scratch. This role is ideal for someone who thrives in building state-of-the-art AI systems and mentoring high-performing teams.Key ResponsibilitiesLead and mentor a development team on Generative AI projects.Architect,...

  • Platform Engineer

    5 days ago

    Pune, Maharashtra, India Techno Wise Full time

    Platform EngineerLocation : Pune (Hybrid)Experience : 47 YearsAbout the Role :We are hiring a Platform Engineer to design, build, and maintain secure, scalable, and reliable platforms across Linux, Hadoop, and AWS environments. You will work on automation, monitoring, and cloud infrastructure to ensure production systems run efficiently, reliably, and at...

  • AAP Platform Lead

    4 days ago

    Pune, Maharashtra, India HSBC Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...

  • Senior Data Platform Engineer

    7 days ago

    Pune, Maharashtra, India Zywave Full time

    Job Title: Senior Data Platform Engineer Location: Pune, India Work Mode: Work From Office (WFO), 5 Days a Week Shift Timing: 12:00 PM – 9:00 PM IST Zywave is a leading provider of InsurTech solutions, empowering insurance brokers and agencies with innovative software tools to grow and manage their business. We are building a modern data platform to...

  • Senior Data Platform Engineer

    4 days ago

    Pune, Maharashtra, India Zywave, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data Platform EngineerLocation: Pune, IndiaWork Mode: Work From Office (WFO), 5 Days a WeekShift Timing: 12:00 PM – 9:00 PM ISTAbout ZywaveZywave is a leading provider of InsurTech solutions, empowering insurance brokers and agencies with innovative software tools to grow and manage their business. We are building a modern data platform...

  • Platform Engineer

    4 days ago

    Pune, Maharashtra, India The Lubrizol Corporation Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job SummaryWe are seeking a highly skilled and innovativePlatform Engineerto implement end-to-end data and analytics solutions using the Microsoft Fabric platform. This role is ideal for someone with technical expertise in Microsoft's data ecosystem who thrives in identifying platform limitations and proactively building custom solutions to bridge functional...