
PySpark Developer
4 days ago
SUMMARY
Job Summary
We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.
Key Responsibilities
Develop and optimize scalable PySpark applications on Databricks.
Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing.
Integrate streaming and batch data sources, especially using Kafka.
Tune Spark jobs for performance, memory, and compute efficiency.
Collaborate with DevOps, product, and analytics teams on delivery and deployment.
Ensure data governance, lineage, and quality compliance across all pipelines.
Required Skills
3 6 years of hands-on development in PySpark.
Experience with Databricks and performance tuning using Spark UI.
Strong understanding of AWS services, Kafka, and distributed data processing.
Proficient in partitioning, caching, join optimization, and resource configuration.
Familiarity with data formats like Parquet, Avro, and OyC.
Exposure to orchestration tools (Airflow, Databricks Workflows).
Scala experience is a strong plus.
-
Pyspark Developer
7 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJob Title : PySpark SMEJob Location – HyderabadExperience: 4-8 Years of experience in IT industry with exposure to Python, Python , PySpark , Delta Lake , DataStage , Terada ( Bteq ,)Strong in Pyspark and SQL Requirement:Strong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience...
-
PySpark Developer
3 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per yearJob Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...
-
Pyspark Developer
7 days ago
Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...
-
eSoftLabs - PySpark Developer
1 week ago
Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full timeJob Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, DatabricksSkills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...
-
Pyspark Developer
7 days ago
Hyderabad, Telangana, India Infosys Full time ₹ 1,04,000 - ₹ 1,30,878 per yearEducational RequirementsBachelor of EngineeringService LineData & Analytics UnitResponsibilitiesA day in the life of an Infoscion- As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.- You will understand requirements, create and review...
-
Pyspark Solutions Architect
5 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Opportunity:We are seeking a seasoned Data Engineer Architect to join our team.About the Role:You will be responsible for designing and implementing scalable data engineering solutions using PySpark. Your expertise in AWS, Python, and cloud technologies such as Google and Azure will play a crucial role in driving business growth.Key...
-
Pyspark Data Engineer
7 days ago
Hyderabad, Telangana, India DATAECONOMY Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Title: PySpark Data Engineer Experience: 5 – 8 Years Location: Hyderabad Employment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 5–8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue,...
-
Data Engineer Architect- Pyspark
2 weeks ago
Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full timeProfessional & Technical Skills:- Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language).- Strong understanding of data processing and analysis which includes relational database- Experience in designing and implementing scalable applications.- Proficient in troubleshooting and problem-solving in application...
-
Python Pyspark
7 days ago
Hyderabad, Telangana, India Capgemini Full time US$ 80,000 - US$ 1,20,000 per yearJob DescriptionChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of...
-
Python Pyspark
2 weeks ago
Hyderabad, Telangana, India Capgemini Full time US$ 80,000 - US$ 1,20,000 per yearJob Description Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of...