Senior Python Engineer

3 days ago

Kozhikode, Kerala, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Summary

We are seeking a seasoned expert to lead our Python engineering efforts.

This role involves designing and implementing high-performance data pipelines using Apache Beam, Databricks, and other technologies.

The successful candidate will have hands-on experience with performance optimization, concurrency, and observability.

About the Role

In this position, you will be responsible for:

  • Designing and building a shared component library/SDK for data pipelines: ingestion, parsing/OCR, extraction, validation, enrichment, publishing
  • Defining patterns/templates for Apache Beam pipelines and Databricks jobs; standardizing configuration, packaging, versioning, CI/CD, and documentation
  • Create pluggable interfaces so multiple teams can swap extractors (Regex/LLM), OCR providers, and EMR publishers without code rewrites
  • Define repo strategy - shared/child repos for each use case
  • Own end-to-end profiling and tuning: cProfile/py-spy/line_profiler, memory (tracemalloc), CPU vs I/O analysis
  • Instrument services with Elastic APM and correlate traces/metrics with Splunk logs; build dashboards and runbooks
  • Implement concurrency best practices: asyncio for I/O-bound, ThreadPool/ProcessPool for CPU-bound, batching, rate limiting, retries, etc.
  • Implement robust LLM API rate limiting/governance: enforce provider TPM and concurrency caps, request queueing/token budgeting, and emit APM/Splunk metrics (throttle rate, queue depth, cost per job) with alerts
  • Establish SLOs/alerts for throughput, latency, error rates; set up DLQs and recovery patterns
About You

To be successful in this role, you should have:

  • 7+ years of experience with Python, with strong depth in performance and concurrency (asyncio, concurrent.futures, multiprocessing), profiling and memory tuning
  • Observability expertise: Elastic APM instrumentation and dashboarding; Splunk for logs and correlation; OpenTelemetry familiarity
  • Experience implementing LLM based solutions and supporting them in production
  • API engineering for high-throughput integrations (REST, OAuth2), resilience patterns, and secure handling of sensitive data
  • Strong architecture/design skills: clean interfaces, packaging shared libs, versioning, CI/CD (GitHub Actions/Azure DevOps), testing
  • 3+ years of experience building large-scale data pipelines with Apache Beam and/or Spark, including hands-on Databricks experience (Jobs, Delta Lake, cluster tuning)
  • Document processing: OCR (Tesseract, AWS Textract, Azure Form Recognizer), PDF parsing, text normalization
  • LLM/SLM integration experience (e.g., OpenAI/Azure AI, local SLMs), prompt/eval frameworks, PII redaction/guardrails
  • Cloud and tooling: AWS/Azure/GCP, Dataflow/Flink, Terraform, Docker; cost/performance tuning on Databricks
  • Security/compliance mindset (HIPAA), secrets management, least-privilege access
What We Offer

We offer a competitive compensation package, excellent benefits, and opportunities for professional growth and development.

You will work with a talented team of engineers and be part of a fast-paced and dynamic environment.

We value diversity, equity, and inclusion and strive to create an inclusive workplace culture.

How to Apply

If you are a motivated and experienced engineer looking for a new challenge, please submit your resume and cover letter.

  • Senior Backend Python Engineer

    2 days ago

    Kozhikode, Kerala, India beBeePythonDeveloper Full time ₹ 10,00,000 - ₹ 15,00,000

    Job DescriptionWe are seeking a skilled professional to develop efficient, reusable, and reliable python code for our team in Bengaluru.The ideal candidate will be responsible for:Developing back-end componentsEnhancing server-side logicIntegrating user-facing elements developed by front-end developersCollaborating with cross-functional teamsOptimizing...

  • Highly Skilled Python Engineer

    2 days ago

    Kozhikode, Kerala, India beBeePythonDeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Geektrust is a leading global retail and e-commerce organization serving millions of guests daily through a vast network of physical stores and a cutting-edge digital platform.About the RoleWe are seeking a highly skilled Lead Python Developer to design, develop, and automate scalable ETL workflows using Python and Pandas.Key ResponsibilitiesDesign and...

  • Senior Python Developer

    28 minutes ago

    Kozhikode, Kerala, India novi indus Full time US$ 90,000 - US$ 1,20,000 per year

    Job DescriptionWe are looking for a highly skilled Senior Python Developer (Team Lead) with expertise in Django and database systems (SQL, PostgreSQL, SQLite, MongoDB). You will lead a team of developers, drive backend architecture decisions, and ensure the delivery of high-quality, scalable web applications.Key Responsibilities:Lead the backend development...

  • Senior Python Large Language Model Developer

    2 days ago

    Kozhikode, Kerala, India beBeePython Full time ₹ 18,00,000 - ₹ 24,00,000

    **Job Opportunity:** Senior Python LLM DeveloperWe are seeking a highly skilled Senior Python LLM Developer to join our team. In this role, you will be responsible for designing, developing, and maintaining efficient, high-quality Python code to train and optimize AI models.

  • Senior Backend Software Engineer

    7 days ago

    Kozhikode, Kerala, India beBeeBackend Full time ₹ 1,80,00,000 - ₹ 3,00,00,000

    Job Opportunity: Senior Backend Software EngineerAbout the Position:We are seeking an experienced software developer with expertise in Python, Azure, and APIs to support our healthcare project.

  • Python Software Engineer Opportunity

    2 days ago

    Kozhikode, Kerala, India beBeebackend Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Backend Development OpportunitiesWe are seeking a skilled software engineer to create high-performance backend systems using Python and related technologies.Key Responsibilities:Create and optimize batch APIs and cron jobs using Python and FastAPI.Work with large-scale databases, including complex queries and performance tuning.Analyze and manipulate large...

  • Python Machine Learning Engineer

    2 days ago

    Kozhikode, Kerala, India beBeeMachineLearning Full time ₹ 30,00,000 - ₹ 36,00,000

    Job Overview:We are seeking a skilled Python Developer with expertise in Machine Learning Engineering to join our team.This is an exciting opportunity for a talented individual to work on cutting-edge AI-powered projects and contribute to the development of innovative solutions.Key Responsibilities:Collaborate with AI scientists and machine learning...

  • Python Developer

    2 days ago

    Kozhikode, Kerala, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **About the Role**We are seeking a skilled Python Developer to join our solutions engineering team. You will be working closely with customers to deploy software solutions across global customer deployments.The ideal candidate will have 1+ years of experience in Python and DevOps, as well as a solid understanding of architecture, design, and data flow of...

  • Python Software Engineer

    2 days ago

    Kozhikode, Kerala, India beBeeSoftwareDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Job SummaryWe are seeking an experienced software developer to create dynamic applications for clients. In this role, you will design and develop scalable software solutions, collaborate with development teams, and integrate user-facing elements with back-end components.Key ResponsibilitiesCollaborate with cross-functional teams to determine application...

  • Senior Software Engineer

    10 hours ago

    Kozhikode, Kerala, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced software developer to take on a challenging role within our organization.As a senior software engineer, you will be responsible for designing and developing high-quality software solutions.Design and develop scalable and efficient software systems.Implement APIs using Django/Django Rest Framework/Flask.Handle...