PySpark Developer
5 days ago
Job Summary
We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.
Key Responsibilities
• Develop and optimize scalable PySpark applications on Databricks.
• Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing.
• Integrate streaming and batch data sources, especially using Kafka.
• Tune Spark jobs for performance, memory, and compute efficiency.
• Collaborate with DevOps, product, and analytics teams on delivery and deployment.
• Ensure data governance, lineage, and quality compliance across all pipelines.
Required Skills
• –6 years of hands-on development in PySpark.
• Experience with Databricks and performance tuning using Spark UI.
• Strong understanding of AWS services, Kafka, and distributed data processing.
• Proficient in partitioning, caching, join optimization, and resource configuration.
• Familiarity with data formats like Parquet, Avro, and OyC.
• Exposure to orchestration tools (Airflow, Databricks Workflows).
• Scala experience is a strong plus.
-
Pyspark Developer
2 days ago
Hyderabad, Telangana, India Risk Resources LLP Full timeJob Summary:We are seeking an experienced Pyspark Developer to join our team. As a Pyspark Developer, you will be responsible for designing, developing, and implementing data processing and analytics solutions using Pyspark, Big Data, and AWS technologies.Responsibilities:Develop and maintain data processing and analytics solutions using Pyspark, Spark, and...
-
PySpark Developer
3 days ago
Hyderabad, Telangana, India Algoleap Technologies Full timeSUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
Databricks + Pyspark
7 days ago
Hyderabad, Telangana, India Cognizant Full timeSkills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...
-
PySpark
6 days ago
Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full timeTCS Hiring for PysparkExperience Range : 06 To 10 years (mandatory)Job Location : Chennai, Hyderabad, KolkataNotice Period: 0-30 days (preferred)JOB DESCRIPTIONKey Responsibilities:Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster.Writing...
-
Senior PySpark Engineer
2 days ago
Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full timeRole: Senior PySpark EngineerExperience Required: Minimum 8+ YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 15 Days maxMode of Interview: VirtualWe are seeking a highly skilled PySpark Data Engineer to design, build, and optimize large-scale data pipelines and distributed...
-
Pyspark Lead Developer
2 days ago
Hyderabad, Telangana, India Wipro Full timeJob DescriptionJob Title: Pyspark Lead DeveloperCity: HyderabadState/Province: TelanganaPosting Start Date: 12/16/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic...
-
Lead/ Sr. Pyspark Data Engineer
2 days ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: PySpark Data EngineerExperience: 6+ YearsLocation: Hyderabad/ PuneEmployment Type: Full-TimeJob Summary:We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 6+ years of experience in designing and implementing data pipelines using PySpark, AWS Glue,...
-
Hyderabad, Telangana, India EverestDX Inc Full timeDescriptionJob Summary :We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark/Spark, and SQL, along with the ability to guide a small team on...
-
Databricks Developer
2 weeks ago
Hyderabad, Telangana, India Tezo Full time US$ 6,00,000 - US$ 18,00,000 per yearPosition: Databricks DeveloperLocation: HyderabadExperience: 5–11 YearsNotice Period: Immediate Joiners PreferredAbout the RoleWe are looking for an experienced Databricks Developer with strong expertise in building scalable data pipelines using Apache Spark, Delta Lake, and cloud-native data platforms. The ideal candidate must have hands-on experience in...
-
ETL,Pyspark/Senior Software Engineer
2 weeks ago
Hyderabad, Telangana, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...