
eSoftLabs - PySpark Developer
3 days ago
Job Title : Pyspark Developer
Location : Hyderabad
Experience Required : 4- 8
Keywords : AWS, Pyspark, Databricks
Skills and experiences required :
- 3- 6 years of hands-on development in PySpark.
- Experience with Databricks and performance tuning using Spark UI.
- Strong understanding of AWS services, Kafka, and distributed data processing.
- Proficient in partitioning, caching, join optimization, and resource configuration.
- Familiarity with data formats like Parquet, Avro, and OyC.
- Exposure to orchestration tools (Airflow, Databricks Workflows).
- Scala experience is a strong plus
Key Roles and Responsibilities :
- Develop and maintain large-scale data pipelines using PySpark and Databricks.
- Optimize and troubleshoot Spark applications using Spark UI and performance tuning techniques.
- Work with large datasets and implement best practices for partitioning, caching, join optimization, and cluster resource management.
- Build efficient data ingestion, transformation, and aggregation logic from multiple sources using Kafka and other streaming technologies.
- Leverage AWS services such as S3, EMR, Lambda, Glue, Redshift, etc., for cloud-based data processing and orchestration.
- Implement workflows using tools such as Airflow or Databricks Workflows.
(ref:hirist.tech)-
eSoftLabs - PySpark Developer
2 weeks ago
Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full timeJob Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, DatabricksSkills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...
-
Hyderabad, India Enterprise Softlabs Pvt Ltd Full timeAbout eSoftLabs :eSoftLabs was established with a clear mission - to deliver high-impact IT solutions through a lean operational model that prioritizes talent and performance over overhead. We specialize in project-based staffing and IT consulting, offering clients highly capable resources at competitive rates. Our unique approach also benefits our...
-
Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJob Title : PySpark SMEJob Location – HyderabadExperience: 4-8 Years of experience in IT industry with exposure to Python, Python , PySpark , Delta Lake , DataStage , Terada ( Bteq ,)Strong in Pyspark and SQL Requirement:Strong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience...
-
PySpark Developer
1 week ago
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per yearJob Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...
-
PySpark Developer
13 hours ago
Hyderabad, India Tata Consultancy Services Full timeJob Title: PySpark Developer Experience: 6 to 8 Years Location: Hyderabad ( Onsite ) Job Description Must-Have Strong knowledge of Pyspark and SQL 2 + years of experience in PySpark. 4+Years of experience in DataStage, Terada. 6+ Years of experience in Python. Experience in GCP cloud Services Delta Lake Good-to-Have Pyspark GCP Google Cloud / Google...
-
Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...
-
PySpark Developer
1 week ago
Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per yearSUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
PySpark Developer
15 hours ago
Hyderabad, India Algoleap Technologies Full timeSUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key...
-
Pyspark Developer
14 hours ago
Hyderabad, India KloudPortal Technology Solutions PVT. LTD Full timeJob Description Job SummaryWe are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams. Key Responsibilities Develop and optimise...
-
PySpark Developer
3 days ago
Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full timeJob Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...