Python & PySpark Developer

2 weeks ago


Bengaluru, Karnataka, India Phygital Insights Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Full time

|

Work From Office

This Position is Currently Open

Department / Category:

DEVELOPER

Listed on Nov 13, 2025

Work Location:

BANGALORE

Job Descritpion of Python & PySpark Developer

10+ Years of Relevant Experience

We are seeking an experienced Python and PySpark Developer (Azure Data Engineer) with a strong background in data solution design, Azure Databricks, and ETL pipeline development. The ideal candidate will have hands-on experience with Medallion Architecture, Atlas Framework, and the ability to design and maintain scalable, high-performance data solutions in a cloud environment.

Key Responsibilities

  • Design, develop, and maintain data pipelines and data products using Azure Databricks and PySpark.
  • Build scalable and efficient ETL workflows integrating data from diverse sources such as Azure Storage Account, SFTP, and Fabric.
  • Apply the Medallion Architecture principles to structure and optimize data layers (Bronze, Silver, Gold).
  • Ensure data quality, accuracy, and completeness through validation, checks, and automation.
  • Collaborate closely with data owners, business analysts, and stakeholders to translate requirements into technical solutions.
  • Implement monitoring and alerting mechanisms to proactively detect and resolve data pipeline issues.
  • Contribute to solution design and architecture discussions for domain-specific data sets and products.

Required Skills & Qualifications

  • 10+ years of relevant experience in data engineering and data pipeline development.
  • Strong expertise in Azure Databricks, Apache Spark, PySpark, and ETL frameworks.
  • Proven experience with the Atlas Framework and Medallion Architecture.
  • Solid programming skills in Python (Scala knowledge is a plus).
  • Proficiency in SQL and data transformation logic.
  • Hands-on experience with Azure Cloud Platform and its data services.
  • Familiarity with Unity Catalog and Databricks-specific tools.
  • Strong analytical, problem-solving, and communication skills.
  • Ability to work in a collaborative and fast-paced environment.

Why Join Us

  • Opportunity to work on cutting-edge cloud data technologies.
  • Collaborative team environment with continuous learning opportunities.
  • Be part of data modernization initiatives driving business innovation.
Required Skills for Python & PySpark Developer Job

Databricks

Python

Pyspark

Sql & ETL

Our Hiring Process
  • Screening (HR Round)
  • Technical Round 1
  • Technical Round 2
  • Final HR Round


  • Bengaluru, Karnataka, India Overture Rede Full time

    Key Responsibilities:Designing and developing robust PySpark applications for large-scale data processingBuilding and optimizing data ingestion, transformation, and storage processesImplementing efficient algorithms and data structures for distributed computingCollaborating with cross-functional teams to integrate data-driven solutions into business...

  • PySpark developer

    2 weeks ago


    Bengaluru, Karnataka, India Preferable - Crafting Careers Full time ₹ 10,50,000 - ₹ 13,00,000 per year

    A PySpark programmer with 4 years of experience develops scalable big data solutions using Python and Apache Spark's PySpark API, focusing on data pipelines, ETL processes, and performance optimization in distributed computing environments.Key Responsibilities• Design, build, and maintain data pipelines with PySpark for processing large datasets, including...

  • Pyspark Developer

    21 hours ago


    Bengaluru, Karnataka, India Allime Tech Solutions Full time

    Title:Pyspark DeveloperSkills:Pyspark, Python, Cloud, ETL.Experience:6+ yrsQualification:Any DegreeNotice Period:Immediate JoinerLocation:Chennai, Bangalore, Hyderabad, Pune, Thane.Job DescriptionMust Have Technical Functional SkillsHands on experience in Python and PySpark development.Proven expertise in big data technologies and frameworks.Strong...


  • Bengaluru, Karnataka, India MongoDB Full time

    MongoDB is growing and gaining adoption rapidly across the globe with the most demanding and innovative companies and development teams in enterprise software. Application Modernization Platform ("AMP") is a MongoDB offering that modernizes our customers' legacy relational applications to a modern architecture, platform, and stack underpinned by MongoDB...


  • Bengaluru, Karnataka, India MongoDB Full time

    MongoDB is growing and gaining adoption rapidly across the globe with the most demanding and innovative companies and development teams in enterprise software.MongoDB's mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and...

  • Python Developer

    2 weeks ago


    Bengaluru, Karnataka, India BROWNROOF Full time ₹ 13,00,000 per year

    About the RoleWe are hiring experienced Python Developers with strong hands-on expertise in PySpark and AWS Databricks for an enterprise-scale project within Oracle's Finergy division. This role involves designing, developing, and optimizing high-performance data pipelines on cloud-native platforms supporting BFSI use cases.This is a hybrid role, and...

  • Python Developer

    3 days ago


    Bengaluru, Karnataka, India Ubique Systems Full time

    Hiring: #PythonDevelopers – Face-to-Face Drive in Bangalore Location: Bangalore (Work from Office) Drive Date: Saturday, 8th November 2025 Experience: 3–5 Years Qualification: B.E / BTech / MCA / MTech (Preferred)Must Have Skills Python SQL PandasGood to Have FastAPI / Flask PySpark / ETL Apache Airflow AWS / AzureKey ResponsibilitiesDevelop, optimize,...


  • Bengaluru, Karnataka, India Luxoft Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Project descriptionSupport one of the top Australian banks as they seek to modernise their data and analytics platform.You will be working directly with IT and business stakeholders in Data and Platform team to implement banks data strategy to become the best AI bank of the world.ResponsibilitiesWe are looking for a Software Engineer with strong experience...


  • Bengaluru, Karnataka, India Datastride Analytics Full time

    Python Developer skilled in AI-integrated backend systems on Azure, using Python, FastAPI, and PySpark. Proficient in NoSQL (MongoDB, Neo4j), Docker, and CI/CD. Integrates LLMs (LangChain, OpenAI) and RAG for intelligent workflows.Annual bonus

  • Python Developer

    2 weeks ago


    Bengaluru, Karnataka, India ALIQAN Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Python DeveloperExperience: 5+ YearsJob Type: 6 Months Contract + ext Location: Bangalore (Hybrid)Notice Period: Immediate Joiner OnlyJob Description:Python development, backend experience.Strong knowledge of AWS services (Glue, Lambda, DynamoDB, S3, PySpark).Excellent debugging skills to resolve production issues.Experience with MySQL, NoSQL...