eSoftLabs - PySpark Developer

2 weeks ago


Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

Job Title : Pyspark Developer

Location : Hyderabad

Experience Required : 4- 8

Keywords : AWS, Pyspark, Databricks

Skills and experiences required :

- 3- 6 years of hands-on development in PySpark.

- Experience with Databricks and performance tuning using Spark UI.

- Strong understanding of AWS services, Kafka, and distributed data processing.

- Proficient in partitioning, caching, join optimization, and resource configuration.

- Familiarity with data formats like Parquet, Avro, and OyC.

- Exposure to orchestration tools (Airflow, Databricks Workflows).

- Scala experience is a strong plus

Key Roles and Responsibilities :

- Develop and maintain large-scale data pipelines using PySpark and Databricks.

- Optimize and troubleshoot Spark applications using Spark UI and performance tuning techniques.

- Work with large datasets and implement best practices for partitioning, caching, join optimization, and cluster resource management.

- Build efficient data ingestion, transformation, and aggregation logic from multiple sources using Kafka and other streaming technologies.

- Leverage AWS services such as S3, EMR, Lambda, Glue, Redshift, etc., for cloud-based data processing and orchestration.

- Implement workflows using tools such as Airflow or Databricks Workflows.

(ref:hirist.tech)
  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...

  • PySpark Developer

    2 weeks ago


    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity:We are seeking a seasoned Data Engineer Architect to join our team.About the Role:You will be responsible for designing and implementing scalable data engineering solutions using PySpark. Your expertise in AWS, Python, and cloud technologies such as Google and Azure will play a crucial role in driving business growth.Key...


  • Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...


  • Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full time

    Professional & Technical Skills: - Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language). - Strong understanding of data processing and analysis which includes relational database - Experience in designing and implementing scalable applications. - Proficient in troubleshooting and problem-solving in application...


  • Hyderabad, Telangana, India Mount Talent Consulting Pvt Ltd. Full time

    Professional & Technical Skills:- Must To Have Skills: Proficiency in PySpark, Amazon Web Services (AWS), Python (Programming Language).- Strong understanding of data processing and analysis which includes relational database- Experience in designing and implementing scalable applications.- Proficient in troubleshooting and problem-solving in application...


  • Hyderabad, Telangana, India beBeePySparkDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About This RoleThis is a highly technical position that requires a deep understanding of data processing and analysis. The ideal candidate will have experience in designing and implementing scalable applications using PySpark, AWS, and Python.Key responsibilities include:Designing and implementing data pipelines using PySparkDeveloping and maintaining...


  • Hyderabad, Telangana, India Wipro Full time US$ 80,000 - US$ 1,20,000 per year

    Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists.*Do*Oversee and support process by reviewing daily transactions on performance parametersReview performance dashboard and the scores...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a skilled Data Architect and Engineer to join our team. As a key member of our data engineering team, you will design, develop, and implement scalable data architectures using PySpark.


  • Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

    Job Title : Ui : Required : 4- 8Keywords : UI Developer, Angular 15+, javascriptSkills and experiences required :- Experience developing componentized user interface micro apps with focus on first time right and quality- Angular Experience (Angular 5+) (AngularJS experience is a plus)- NodeJS and strong NPM Experience- Strong Javascript Skills- Strong...