Principal Python Architecture Specialist

1 day ago

Pune, Maharashtra, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Lead Python Engineer Job Description

We are seeking an experienced Lead Python engineer with hands-on expertise in Apache Beam and Databricks to lead our team's architecture and performance efforts.

Key Responsibilities:
  • Design and develop a shared component library/SDK for pipelines: ingestion, parsing/extraction, validation, enrichment, publishing.
  • Define patterns/templates for Apache Beam pipelines and Databricks jobs; standardize configuration, packaging, versioning, CI/CD, and documentation.
  • Create pluggable interfaces so multiple teams can swap extractors (Regex/LLM), OCR providers, and EMR publishers without code rewrites.
  • Own end-to-end profiling and tuning: cProfile/py-spy/line_profiler, memory (tracemalloc), CPU vs I/O analysis.
  • Instrument services with Elastic APM and correlate traces/metrics with Splunk logs; build dashboards and runbooks.
  • Implement concurrency best practices: asyncio for I/O-bound, ThreadPool/ProcessPool for CPU-bound, batching, rate limiting, retries, etc.
  • Implement robust LLM API rate limiting/governance: enforce provider TPM and concurrency caps, request queueing/token budgeting, and emit APM/Splunk metrics (throttle rate, queue depth, cost per job) with alerts.
  • Establish Service Level Objectives (SLOs)/alerts for throughput, latency, error rates; set up Dead Letter Queues (DLQs) and recovery patterns.
  • Mentor developers, lead design reviews, codify best practices, write clear documentation and examples.
  • Partner with Machine Learning engineers on the future Large Language Model (LLM)/Small Language Model (SLM) path (evaluation harness, safety/PII, cost/perf).

  • Highly Skilled Architecture Specialist

    8 hours ago

    Pune, Maharashtra, India beBeeArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a skilled Product Architect to craft and implement a fully self-hosted, distributed architecture that runs on VMs, bare-metal, or private Kubernetes/OpenShift clusters data-plane to UI.About the Role:The ideal candidate will have 8-12 years of experience building large, scalable on-prem or hybrid dev-tool products, with 3+ years...

  • Senior Software Engineer

    4 days ago

    Pune, Maharashtra, India Principal Global Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Responsibilities Indicative years of experience: 5+years   Role Description: Develop, test and maintain applications with established processes while building holistic understanding of the underlying applications and domain   Reporting relationship: This role will report to Delivery Manager / Senior Delivery Manager   Technical Skill:The candidate must...

  • Python Automation Specialist

    2 days ago

    Pune, Maharashtra, India beBeeAutomation Full time ₹ 10,00,000 - ₹ 20,00,000

    Technical Specialist for Python AutomationWe are seeking a skilled Technical Specialist to join our team and drive the development of innovative automation solutions. The ideal candidate will have expertise in Python programming and experience with UI-driven test automation frameworks such as Selenium and Playwright.About the Role:This is an exciting...

  • Data Architecture Specialist

    7 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Architecture SpecialistThe ideal candidate will design and develop complex data systems, focusing on scalability, reliability, and performance.Main responsibilities include:Developing optimized SQL queries and ETL processes for big data platformsImplementing robust data security measures to protect sensitive informationMaintaining and...

  • Principal Python Software Engineer

    8 hours ago

    Pune, Maharashtra, India beBeePythonDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking a highly skilled Python Developer to join our team for an exciting project that leverages AI/ML technology.The ideal candidate will have strong experience in Python development, leading organizational-wide initiatives and creating scalable solutions for various applications.Build back-end applications and services for...

  • Senior Consultant

    7 days ago

    Pune, Maharashtra, India Principal Global Services Full time

    Responsibilities Technical coach to design develop coordinate conduct and monitor large or medium-scale coaching and mentoring programs required for individuals and teams engineering transformation Job involves getting deeper to understand team challenges and influence change thru various interventions including coaching mentoring and training ...

  • Senior Python Automation Specialist

    6 days ago

    Pune, Maharashtra, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title:Senior Python Automation SpecialistWe are seeking a highly skilled Senior Python Automation Specialist to join our team. As a specialist, you will be responsible for designing, developing, and maintaining automation solutions using Python.Key Responsibilities:Design and develop automation solutions using Python programming languageMaintain and...

  • Principal Software Engineer

    7 days ago

    Pune, Maharashtra, India Mastercard Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Senior Python Automation Specialist

    6 hours ago

    Pune, Maharashtra, India beBeePythonAutomation Full time ₹ 12,00,000 - ₹ 18,00,000

    Job Title: Senior Python Automation Specialist">Overview:", "We are seeking a seasoned expert in automation to develop, maintain and execute automated test scripts using Python. The ideal candidate should have hands-on experience with API testing and BDD frameworks.", "",

  • Principal Python Developer

    1 day ago

    Pune, Maharashtra, India Salt Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Overview:We are looking for an experienced and enthusiastic Python Developer with a strong background in Artificial Intelligence (AI) and Machine Learning (ML) to join our growing team. The ideal candidate will be responsible for developing, deploying, and optimizing intelligent applications and solutions using Python and ML frameworks.Key...