PySpark Developer

5 days ago


Hyderabad, Telangana, India Algoleap Technologies Pvt Ltd Full time

Job Summary

We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.

Key Responsibilities


• Develop and optimize scalable PySpark applications on Databricks.


• Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing.


• Integrate streaming and batch data sources, especially using Kafka.


• Tune Spark jobs for performance, memory, and compute efficiency.


• Collaborate with DevOps, product, and analytics teams on delivery and deployment.


• Ensure data governance, lineage, and quality compliance across all pipelines.

Required Skills


• –6 years of hands-on development in PySpark.


• Experience with Databricks and performance tuning using Spark UI.


• Strong understanding of AWS services, Kafka, and distributed data processing.


• Proficient in partitioning, caching, join optimization, and resource configuration.


• Familiarity with data formats like Parquet, Avro, and OyC.


• Exposure to orchestration tools (Airflow, Databricks Workflows).


• Scala experience is a strong plus.


  • Pyspark Developer

    2 days ago


    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Summary:We are seeking an experienced Pyspark Developer to join our team. As a Pyspark Developer, you will be responsible for designing, developing, and implementing data processing and analytics solutions using Pyspark, Big Data, and AWS technologies.Responsibilities:Develop and maintain data processing and analytics solutions using Pyspark, Spark, and...

  • PySpark Developer

    3 days ago


    Hyderabad, Telangana, India Algoleap Technologies Full time

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...


  • Hyderabad, Telangana, India Cognizant Full time

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...

  • PySpark

    6 days ago


    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    TCS Hiring for PysparkExperience Range : 06 To 10 years (mandatory)Job Location : Chennai, Hyderabad, KolkataNotice Period: 0-30 days (preferred)JOB DESCRIPTIONKey Responsibilities:Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster.Writing...


  • Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full time

    Role: Senior PySpark EngineerExperience Required: Minimum 8+ YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 15 Days maxMode of Interview: VirtualWe are seeking a highly skilled PySpark Data Engineer to design, build, and optimize large-scale data pipelines and distributed...


  • Hyderabad, Telangana, India Wipro Full time

    Job DescriptionJob Title: Pyspark Lead DeveloperCity: HyderabadState/Province: TelanganaPosting Start Date: 12/16/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic...


  • Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark Data EngineerExperience: 6+ YearsLocation: Hyderabad/ PuneEmployment Type: Full-TimeJob Summary:We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 6+ years of experience in designing and implementing data pipelines using PySpark, AWS Glue,...


  • Hyderabad, Telangana, India EverestDX Inc Full time

    DescriptionJob Summary :We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark/Spark, and SQL, along with the ability to guide a small team on...

  • Databricks Developer

    2 weeks ago


    Hyderabad, Telangana, India Tezo Full time US$ 6,00,000 - US$ 18,00,000 per year

    Position: Databricks DeveloperLocation: HyderabadExperience: 5–11 YearsNotice Period: Immediate Joiners PreferredAbout the RoleWe are looking for an experienced Databricks Developer with strong expertise in building scalable data pipelines using Apache Spark, Delta Lake, and cloud-native data platforms. The ideal candidate must have hands-on experience in...


  • Hyderabad, Telangana, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...