Current jobs related to Pyspark Developer - Hyderabad, Telangana - KloudPortal Technology Solutions PVT. LTD
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per yearJob Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per yearSUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
eSoftLabs - PySpark Developer
2 weeks ago
Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full timeJob Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, DatabricksSkills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...
-
Pyspark Solutions Architect
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Opportunity:We are seeking a seasoned Data Engineer Architect to join our team.About the Role:You will be responsible for designing and implementing scalable data engineering solutions using PySpark. Your expertise in AWS, Python, and cloud technologies such as Google and Azure will play a crucial role in driving business growth.Key...
-
Date Engineer(Python, Pyspark and AWS)
3 days ago
Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...
-
Data Engineer Architect- Pyspark
3 weeks ago
Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full timeProfessional & Technical Skills: - Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language). - Strong understanding of data processing and analysis which includes relational database - Experience in designing and implementing scalable applications. - Proficient in troubleshooting and problem-solving in application...
-
Data Engineer Architect- Pyspark
7 days ago
Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full timeProfessional & Technical Skills:- Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language).- Strong understanding of data processing and analysis which includes relational database- Experience in designing and implementing scalable applications.- Proficient in troubleshooting and problem-solving in application...
-
Senior Data Processing Specialist
2 weeks ago
Hyderabad, Telangana, India beBeePySparkDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About This RoleThis is a highly technical position that requires a deep understanding of data processing and analysis. The ideal candidate will have experience in designing and implementing scalable applications using PySpark, AWS, and Python.Key responsibilities include:Designing and implementing data pipelines using PySparkDeveloping and maintaining...
-
Pyspark Lead Developer
3 days ago
Hyderabad, Telangana, India Wipro Full time US$ 80,000 - US$ 1,20,000 per yearRole Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists.*Do*Oversee and support process by reviewing daily transactions on performance parametersReview performance dashboard and the scores...
-
Senior Data Architect and Engineer
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking a skilled Data Architect and Engineer to join our team. As a key member of our data engineering team, you will design, develop, and implement scalable data architectures using PySpark.
Pyspark Developer
2 weeks ago
Job Description
Job Summary
We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.
Key Responsibilities
- Develop and optimise scalable PySpark applications on Databricks.
- Work with AWS services (S3, EMR, Glue, Lambda) for data processing.
- Integrate streaming and batch data sources using Kafka.
- Tune Spark jobs for performance and cost efficiency.
- Collaborate with DevOps, product, and analytics teams.
- Ensure data governance, lineage, and quality compliance.
Required Skills
- 3-7 years of strong PySpark development experience.
- Hands-on Databricks (Spark UI, performance tuning).
- Good understanding of AWS services (S3, EMR, Glue, Lambda).
- Experience with Kafka for streaming/batch processing.
- Spark optimisation (partitioning, caching, joins).
- Data formats: Parquet, Avro, ORC.
- Orchestration: Airflow / Databricks Workflows.
- Scala is a strong plus.
Qualifications
- Bachelors or Master's in Computer Science / IT.
