Senior PySpark Developer

7 days ago

Pune Bengaluru Bangalore Hyderabad Secunderabad Telangana, India beBeePySpark Full time ₹ 15,00,000 - ₹ 28,00,000

Job Overview

As a seasoned PySpark professional, you will be responsible for designing, developing, testing, deploying, and maintaining large-scale data processing pipelines. This role requires strong technical expertise in Spark's APIs, including Dataframe, Dataset, and Hive queries.

Key Responsibilities

  • Design, develop, test, deploy, and maintain large-scale data processing pipelines using PySpark.
  • Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  • Develop high-quality code in Python using Spark's APIs (e.g., Dataframe, Dataset) and Hive queries.
  • Troubleshoot complex issues related to data processing, query performance, and system errors.

Desired Candidate Profile

  • 4-8 years of experience working with PySpark/Hive technologies.

What We Offer

  • A dynamic work environment with opportunities for growth and development.

How to Apply

We are looking for talented individuals who can contribute to our team's success. If you have the skills and passion for this role, please submit your application.

  • Databricks PySpark Developer

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeePySpark Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Databricks PySpark DeveloperAbout the JobWe are seeking a skilled Databricks PySpark developer to join our team. The ideal candidate will have extensive experience in developing and optimizing data processing jobs using PySpark, as well as designing and implementing robust data pipelines on the AWS platform.Key ResponsibilitiesDevelop and optimize...

  • PySpark Development Expert

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000

    Senior Data Engineer PositionJob Description:We are seeking a skilled Senior Data Engineer to join our team.This is an exciting opportunity to work on cutting-edge data engineering projects and contribute to the growth of our organization.Required Skills and Qualifications:- 5 years of hands-on experience with PySpark and Python.- Experience working with AWS...

  • PySpark Developer

    2 weeks ago

    Hyderabad, Telangana, India Algoleap Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Developer

    2 days ago

    Hyderabad, India Algoleap Technologies Full time

    SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key...

  • Pyspark Developer

    2 days ago

    Hyderabad, India KloudPortal Technology Solutions PVT. LTD Full time

    Job Description Job SummaryWe are hiring a Senior PySpark Developer with 4-7 years of experience in building and optimising data pipelines using PySpark on Databricks, within AWS cloud environments. This role involves modernising legacy systems, integrating with Kafka, and collaborating across cross-functional teams. Key Responsibilities Develop and optimise...

  • Pyspark

    2 weeks ago

    Bengaluru, India Riverforest Connections Full time

    Position Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...

  • Pyspark- Hyderabad

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 4 to 16 years **Location**: Hyderabad **Walkin date**: 8th Feb 25 - **Design, develop, maintain efficient and scalable solutions using PySpark** - **Ensure data quality and integrity by implementing robust testing, validation and cleansing processes** - **Integrate data from various sources, including databases, APIs,...

  • Pyspark Developer

    4 days ago

    Chennai, Hyderabad, Pune, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    TCS is Hiring Location :Bangalore, Chennai, Kolkata, Hyderabad, PuneExp : 4-8 YrsFunctional Skills: Experience in Credit Risk/Regulatory risk domainTechnical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scriptingGood to Have Skills: Exposure to Machine Learning TechniquesJob Description:4+ Years of experience with Developing/Fine tuning...

  • PySpark Developer

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title: PySpark DeveloperExperience: 6 to 8 YearsLocation: Hyderabad ( Onsite )Job DescriptionMust-HaveStrong knowledge of Pyspark and SQL2 + years of experience in PySpark.4+Years of experience in DataStage, Terada.6+ Years of experience in Python.Experience in GCP cloud ServicesDelta LakeGood-to-HavePysparkGCPGoogle Cloud / Google...

  • PySpark Developer

    2 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title: PySpark Developer Experience: 6 to 8 Years Location: Hyderabad ( Onsite ) Job Description Must-Have Strong knowledge of Pyspark and SQL 2 + years of experience in PySpark. 4+Years of experience in DataStage, Terada. 6+ Years of experience in Python. Experience in GCP cloud Services Delta Lake Good-to-Have Pyspark GCP Google Cloud / Google...