PySpark Developer

6 days ago


Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

SUMMARY

Job Summary

We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.

Key Responsibilities

Develop and optimize scalable PySpark applications on Databricks.

Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing.

Integrate streaming and batch data sources, especially using Kafka.

Tune Spark jobs for performance, memory, and compute efficiency.

Collaborate with DevOps, product, and analytics teams on delivery and deployment.

Ensure data governance, lineage, and quality compliance across all pipelines.

Required Skills

3 6 years of hands-on development in PySpark.

Experience with Databricks and performance tuning using Spark UI.

Strong understanding of AWS services, Kafka, and distributed data processing.

Proficient in partitioning, caching, join optimization, and resource configuration.

Familiarity with data formats like Parquet, Avro, and OyC.

Exposure to orchestration tools (Airflow, Databricks Workflows).

Scala experience is a strong plus.


  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Pyspark Developer

    1 week ago


    Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...

  • PySpark Developer

    6 days ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...

  • Pyspark Developer

    1 week ago


    Hyderabad, Telangana, India Infosys Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Educational RequirementsBachelor of EngineeringService LineData & Analytics UnitResponsibilitiesA day in the life of an Infoscion- As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.- You will understand requirements, create and review...


  • Hyderabad, Telangana, India MatchPoint Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Type: PermanentLocation: Hyderabad (5 Days Onsite)Experience RequiredJob Description:We are seeking a skilledData Engineerwith strong expertise inPySpark Quries, Python programming, and Data Structures & Algorithms (DSA). The ideal candidate will design and optimize large-scale data pipelines, write efficient and scalable code, and solve complex data...


  • Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About The Role :We are seeking a highly skilled and experienced Senior PySpark/Python Developer to play a critical role in building a robust and reliable system for managing and disseminating customer notifications regarding PG&E's Planned Power Outages (PPOs). This is an exciting opportunity to tackle complex data challenges within a dynamic environment and...


  • Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full time

    Professional & Technical Skills:- Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language).- Strong understanding of data processing and analysis which includes relational database- Experience in designing and implementing scalable applications.- Proficient in troubleshooting and problem-solving in application...


  • Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Looking to onboard a skilled professional with 6-8 years of experience in Pyspark, SQL, and AWS Glue. The ideal candidate will have a strong background in these technologies and excellent problem-solving skills. This position is located across Pan India.Roles and ResponsibilityDesign, develop, and implement data processing pipelines using Pyspark and AWS...


  • Hyderabad, Telangana, India Matrix Global Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Summary:We are seeking a highly skilled ETL Developer with strong expertise in SQL and Python or PySpark to join our data engineering team within a leading financial institution. The ideal candidate will have at least 5 years of experience in the banking sector, with a solid understanding of Anti-Money Laundering (AML) processes and compliance...


  • Hyderabad, Telangana, India Disa Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    2 rounds of coding sessions is must for every candidate.Position: Pyspark, Python, SQL, Palantir Data EngineerLocation: Hyderabad, India. Onsite from Day1. Need local Hyderabad, India or close by locations candidatesResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and...