PySpark developer

2 weeks ago


Bengaluru, Karnataka, India Preferable - Crafting Careers Full time ₹ 10,50,000 - ₹ 13,00,000 per year

A PySpark programmer with 4 years of experience develops scalable big data solutions using Python and Apache Spark's PySpark API, focusing on data pipelines, ETL processes, and performance optimization in distributed computing environments.

Key Responsibilities


• Design, build, and maintain data pipelines with PySpark for processing large datasets, including ETL (extract, transform, load) operations.


• Optimize Spark applications for performance, troubleshoot issues, and ensure data quality and integrity.


• Collaborate with data engineers and scientists on requirements, code reviews, and integrating data from various sources like Hadoop, Hive, or cloud platforms.

Required Qualifications


• Bachelor's degree in Computer Science or related field, with 4+ years in Python development and PySpark expertise.


• Proficiency in SQL, distributed computing, big data frameworks (Spark, Kafka), and data warehousing.


• Strong problem-solving, debugging skills, and familiarity with cloud services (AWS, GCP, Azure).

Essential Skills


• Python, PySpark, Apache Spark, ETL processes.


• Java/Scala (optional but beneficial), SQL, big data tools.


• Experience in fast-paced environments handling multiple projects.


  • Pyspark Developer

    19 hours ago


    Bengaluru, Karnataka, India Allime Tech Solutions Full time

    Title:Pyspark DeveloperSkills:Pyspark, Python, Cloud, ETL.Experience:6+ yrsQualification:Any DegreeNotice Period:Immediate JoinerLocation:Chennai, Bangalore, Hyderabad, Pune, Thane.Job DescriptionMust Have Technical Functional SkillsHands on experience in Python and PySpark development.Proven expertise in big data technologies and frameworks.Strong...


  • Bengaluru, Karnataka, India Phygital Insights Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Full time|Work From OfficeThis Position is Currently OpenDepartment / Category:DEVELOPERListed on Nov 13, 2025Work Location:BANGALOREJob Descritpion of Python & PySpark Developer10+ Years of Relevant ExperienceWe are seeking an experienced Python and PySpark Developer (Azure Data Engineer) with a strong background in data solution design, Azure Databricks,...

  • Pyspark Developer

    7 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time

    Must-Have** · Hands-on experience of PySpark, Spark, Hive, Hadoop Big Data Eco System Tools. · Strong SQL experience. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of object-oriented programming and HDFS concepts.Good-to-Have · Preferable to have good DWH/ Data Lake knowledge. · The candidate...


  • Bengaluru, Karnataka, India Overture Rede Full time

    Key Responsibilities:Designing and developing robust PySpark applications for large-scale data processingBuilding and optimizing data ingestion, transformation, and storage processesImplementing efficient algorithms and data structures for distributed computingCollaborating with cross-functional teams to integrate data-driven solutions into business...

  • Pyspark Architect

    3 days ago


    Bengaluru, Karnataka, India Talent Worx Full time

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...


  • Bengaluru, Karnataka, India Peoplelogic Full time

    Mandatory Key skills: Primary skill required for the data engineer role is hands-on experience withSpark, particularly PySpark. Candidates must have experience in coding data pipelines in Spark andshould be comfortable with Python for automation. Other skills like Azure, Airflow, and Databricks are good to have but notmandatory. 1 Coding...


  • Bengaluru, Karnataka, India Infosys Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Infosys Hiring PYSPARK ARCHITECT with experience range 5 to 8 YearsResponsibilities:A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology...

  • Pyspark Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role: Data Engineer with Mandatory Pyspark KnowledgeRequired Technical Skill Set: Python , Pyspark, BigQueryDesired Experience Range: 5+ yrsDesired Experience: 0-60 DaysLocation: Bangalore, Pune, Chennai, GurugramDesired Competencies (Technical/Behavioral Competency)Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based...


  • Bengaluru, Karnataka, India RBS Full time

    Join us as a Software Engineer, Tableau And PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutionsIt's a chance to hone your existing technical skills and advance your career while...

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role : Data Engineer(Pyspark & Palantir)Location: BangaloreExperience range: 5 to 10yrsNotice period: 0-30/45 days or Immediate joiners are preferredMode of Interview: VirtualDate of Interview: 18th Dec,25(Thursday)Time of Interview: 10am to 2pmEx-TCSers are not allowed and experience range less than 5yrs will not be consideredKey Responsibilities:Design,...