Python & PySpark Developer

2 days ago

Bengaluru, Karnataka, India Phygital Insights Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Full time

|

Work From Office

This Position is Currently Open

Department / Category:

DEVELOPER

Listed on Nov 13, 2025

Work Location:

BANGALORE

Job Descritpion of Python & PySpark Developer

10+ Years of Relevant Experience

We are seeking an experienced Python and PySpark Developer (Azure Data Engineer) with a strong background in data solution design, Azure Databricks, and ETL pipeline development. The ideal candidate will have hands-on experience with Medallion Architecture, Atlas Framework, and the ability to design and maintain scalable, high-performance data solutions in a cloud environment.

Key Responsibilities

  • Design, develop, and maintain data pipelines and data products using Azure Databricks and PySpark.
  • Build scalable and efficient ETL workflows integrating data from diverse sources such as Azure Storage Account, SFTP, and Fabric.
  • Apply the Medallion Architecture principles to structure and optimize data layers (Bronze, Silver, Gold).
  • Ensure data quality, accuracy, and completeness through validation, checks, and automation.
  • Collaborate closely with data owners, business analysts, and stakeholders to translate requirements into technical solutions.
  • Implement monitoring and alerting mechanisms to proactively detect and resolve data pipeline issues.
  • Contribute to solution design and architecture discussions for domain-specific data sets and products.

Required Skills & Qualifications

  • 10+ years of relevant experience in data engineering and data pipeline development.
  • Strong expertise in Azure Databricks, Apache Spark, PySpark, and ETL frameworks.
  • Proven experience with the Atlas Framework and Medallion Architecture.
  • Solid programming skills in Python (Scala knowledge is a plus).
  • Proficiency in SQL and data transformation logic.
  • Hands-on experience with Azure Cloud Platform and its data services.
  • Familiarity with Unity Catalog and Databricks-specific tools.
  • Strong analytical, problem-solving, and communication skills.
  • Ability to work in a collaborative and fast-paced environment.

Why Join Us

  • Opportunity to work on cutting-edge cloud data technologies.
  • Collaborative team environment with continuous learning opportunities.
  • Be part of data modernization initiatives driving business innovation.
Required Skills for Python & PySpark Developer Job

Databricks

Python

Pyspark

Sql & ETL

Our Hiring Process
  • Screening (HR Round)
  • Technical Round 1
  • Technical Round 2
  • Final HR Round

  • Developer (Python | PySpark)

    1 week ago

    Bengaluru, Karnataka, India ONOC Full time ₹ 1,00,00,000 - ₹ 1,40,00,000 per year

    We're Hiring – Developer (Python | PySpark)Location: Chennai / BangaloreCTC: ₹13 – 14 LPAExperience: 8 – 10 YearsNotice Period: Max 20 DaysKey Responsibilities:Design, develop & maintain scalable data pipelines using PySpark on cloud (AWS / Azure / GCP)Write complex, optimized SQL queries for data extraction, transformation & analysisBuild automation...

  • Python Pyspark

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Greetings from Tata Consultancy Services (TCS)Location : Chennai, Bangalore, Pune, DelhiExperience : 5-10 YearsRole: Python Pyspark DeveloperRequired Skill set Python, Pyspark, Scala, SparkMust HaveStrong analytical skills in conducting sophisticated statistical analysis using bureau/vendor data, customer performances.Working experience in languages PySpark...

  • Pyspark developer

    1 week ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description:In the role of Data Engineer you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and DesignYou will play an important role in creating the high level design artifactsYou will also...

  • Pyspark Developer

    1 week ago

    Bengaluru, Karnataka, India Allime Tech Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Title:Pyspark DeveloperSkills:Pyspark, Python, Cloud, ETL.Experience:6+ yrsQualification:Any DegreeNotice Period:Immediate JoinerLocation:Chennai, Bangalore, Hyderabad, Pune, Thane.Job DescriptionMust Have Technical Functional SkillsHands on experience in Python and PySpark development.Proven expertise in big data technologies and frameworks.Strong...

  • Python + Pyspark + SQL

    2 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Our Client is a professional services firm, is the Indian member firm affiliated with International and wasestablished in September 1993. Our professionals leverage the global network of firms, providing detailedknowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad,Bengaluru, Chandigarh, Chennai,...

  • Data Engineer- 1

    1 week ago

    Bengaluru, Karnataka, India Databricks PySpark Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Position: Senior Data Engineer We are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems. In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions. You will also contribute to...

  • Azure Developer-Python, PySpark, and Azure Fabric.-4+ Yrs

    1 week ago

    Bengaluru, Karnataka, India Cortex Consultants Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: Azure Developer Location: Bangalore Experience: 4-6 Years Company Overview: We are an innovative technology company committed to delivering exceptional solutions and services across various industries. We are looking for an experienced Azure Developer with expertise in data platforms within the Azure ecosystem. If you're passionate about building...

  • PySpark Python Consultant

    1 week ago

    Bengaluru, Karnataka, India IQVIA Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Support ongoing recurring deliverables in PL/SQL, PySpark, SAS, Python and BDF technologiesContribute to adhoc projects and POCs planned as part of US AA support TeamEnhance and share APLD and healthcare domain expertise from project learningsGood communication (both verbal and written) and analytical skillsLogical thinking and reasoning capabilitiesAbility...

  • PySpark Python Consultant

    1 week ago

    Bengaluru, Karnataka, India IQVIA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    • Support ongoing recurring deliverables in PL/SQL, PySpark, SAS, Python and BDF technologies• Contribute to adhoc projects and POCs planned as part of US AA support Team• Enhance and share APLD and healthcare domain expertise from project learnings• Good communication (both verbal and written) and analytical skills• Logical thinking and reasoning...

  • Pyspark Professional

    4 days ago

    Bengaluru, Karnataka, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Immediate Openings onPyspark Experience : 5+ Skill:-Pyspark Location :- Bangalore Notice Period :- Immediate. PysparkExperience in Cloud platform, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, ScalaPerformance Turing Optimize SQL, PySpark for performanceAirflow workflow scheduling tool for...