
eSoftLabs - PySpark Developer
2 weeks ago
Job Title : Pyspark Developer
Location : Hyderabad
Experience Required : 4- 8
Keywords : AWS, Pyspark, Databricks
Skills and experiences required :
- 3- 6 years of hands-on development in PySpark.
- Experience with Databricks and performance tuning using Spark UI.
- Strong understanding of AWS services, Kafka, and distributed data processing.
- Proficient in partitioning, caching, join optimization, and resource configuration.
- Familiarity with data formats like Parquet, Avro, and OyC.
- Exposure to orchestration tools (Airflow, Databricks Workflows).
- Scala experience is a strong plus
Key Roles and Responsibilities :
- Develop and maintain large-scale data pipelines using PySpark and Databricks.
- Optimize and troubleshoot Spark applications using Spark UI and performance tuning techniques.
- Work with large datasets and implement best practices for partitioning, caching, join optimization, and cluster resource management.
- Build efficient data ingestion, transformation, and aggregation logic from multiple sources using Kafka and other streaming technologies.
- Leverage AWS services such as S3, EMR, Lambda, Glue, Redshift, etc., for cloud-based data processing and orchestration.
- Implement workflows using tools such as Airflow or Databricks Workflows.
(ref:hirist.tech)-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per yearJob Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...
-
PySpark Developer
2 weeks ago
Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per yearSUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
Pyspark Solutions Architect
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Opportunity:We are seeking a seasoned Data Engineer Architect to join our team.About the Role:You will be responsible for designing and implementing scalable data engineering solutions using PySpark. Your expertise in AWS, Python, and cloud technologies such as Google and Azure will play a crucial role in driving business growth.Key...
-
Date Engineer(Python, Pyspark and AWS)
2 days ago
Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...
-
Data Engineer Architect- Pyspark
3 weeks ago
Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full timeProfessional & Technical Skills: - Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language). - Strong understanding of data processing and analysis which includes relational database - Experience in designing and implementing scalable applications. - Proficient in troubleshooting and problem-solving in application...
-
Data Engineer Architect- Pyspark
7 days ago
Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full timeProfessional & Technical Skills:- Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language).- Strong understanding of data processing and analysis which includes relational database- Experience in designing and implementing scalable applications.- Proficient in troubleshooting and problem-solving in application...
-
Senior Data Processing Specialist
2 weeks ago
Hyderabad, Telangana, India beBeePySparkDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About This RoleThis is a highly technical position that requires a deep understanding of data processing and analysis. The ideal candidate will have experience in designing and implementing scalable applications using PySpark, AWS, and Python.Key responsibilities include:Designing and implementing data pipelines using PySparkDeveloping and maintaining...
-
Pyspark Lead Developer
2 days ago
Hyderabad, Telangana, India Wipro Full time US$ 80,000 - US$ 1,20,000 per yearRole Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists.*Do*Oversee and support process by reviewing daily transactions on performance parametersReview performance dashboard and the scores...
-
Senior Data Architect and Engineer
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking a skilled Data Architect and Engineer to join our team. As a key member of our data engineering team, you will design, develop, and implement scalable data architectures using PySpark.
-
eSoftLabs - UI Developer - AngularJS
2 weeks ago
Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full timeJob Title : Ui : Required : 4- 8Keywords : UI Developer, Angular 15+, javascriptSkills and experiences required :- Experience developing componentized user interface micro apps with focus on first time right and quality- Angular Experience (Angular 5+) (AngularJS experience is a plus)- NodeJS and strong NPM Experience- Strong Javascript Skills- Strong...