eSoftLabs - PySpark Developer

3 days ago


Hyderabad, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

Job Title : Pyspark Developer


Location : Hyderabad


Experience Required : 4- 8


Keywords : AWS, Pyspark, Databricks


Skills and experiences required :


- 3- 6 years of hands-on development in PySpark.


- Experience with Databricks and performance tuning using Spark UI.


- Strong understanding of AWS services, Kafka, and distributed data processing.


- Proficient in partitioning, caching, join optimization, and resource configuration.


- Familiarity with data formats like Parquet, Avro, and OyC.


- Exposure to orchestration tools (Airflow, Databricks Workflows).


- Scala experience is a strong plus


Key Roles and Responsibilities :


- Develop and maintain large-scale data pipelines using PySpark and Databricks.


- Optimize and troubleshoot Spark applications using Spark UI and performance tuning techniques.


- Work with large datasets and implement best practices for partitioning, caching, join optimization, and cluster resource management.


- Build efficient data ingestion, transformation, and aggregation logic from multiple sources using Kafka and other streaming technologies.


- Leverage AWS services such as S3, EMR, Lambda, Glue, Redshift, etc., for cloud-based data processing and orchestration.


- Implement workflows using tools such as Airflow or Databricks Workflows.

(ref:hirist.tech)

  • Hyderabad, Telangana, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

    Job Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, DatabricksSkills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...


  • Hyderabad, India Enterprise Softlabs Pvt Ltd Full time

    About eSoftLabs :eSoftLabs was established with a clear mission - to deliver high-impact IT solutions through a lean operational model that prioritizes talent and performance over overhead. We specialize in project-based staffing and IT consulting, offering clients highly capable resources at competitive rates. Our unique approach also benefits our...

  • Pyspark Developer

    2 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title : PySpark SMEJob Location – HyderabadExperience: 4-8 Years of experience in IT industry with exposure to Python, Python , PySpark , Delta Lake , DataStage , Terada ( Bteq ,)Strong in Pyspark and SQL Requirement:Strong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience...

  • PySpark Developer

    1 week ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...

  • PySpark Developer

    13 hours ago


    Hyderabad, India Tata Consultancy Services Full time

    Job Title: PySpark Developer Experience: 6 to 8 Years Location: Hyderabad ( Onsite ) Job Description Must-Have Strong knowledge of Pyspark and SQL 2 + years of experience in PySpark. 4+Years of experience in DataStage, Terada. 6+ Years of experience in Python. Experience in GCP cloud Services Delta Lake Good-to-Have Pyspark GCP Google Cloud / Google...

  • Pyspark Developer

    2 weeks ago


    Hyderabad, Telangana, India KloudPortal Technology Solutions PVT. LTD Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionJob Summary We are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams.Key ResponsibilitiesDevelop and optimise...

  • PySpark Developer

    1 week ago


    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Developer

    15 hours ago


    Hyderabad, India Algoleap Technologies Full time

    SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key...

  • Pyspark Developer

    14 hours ago


    Hyderabad, India KloudPortal Technology Solutions PVT. LTD Full time

    Job Description Job SummaryWe are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams. Key Responsibilities Develop and optimise...

  • PySpark Developer

    3 days ago


    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...