PySpark

6 days ago

Hyderabad Telangana India, Telangana Tata Consultancy Services Full time

TCS Hiring for Pyspark


Experience Range : 06 To 10 years (mandatory)

Job Location : Chennai, Hyderabad, Kolkata

Notice Period: 0-30 days (preferred)



JOB DESCRIPTION


Key Responsibilities:


  • Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster.
  • Writing complex queries as per the business rules and data extraction logic
  • Query tuning and Performance optimization of various components as and when required.
  • Work with development leads, System Architects and other teams (as needed) to manage dependencies, risks and issues.
  • Contributing in all phases of the development lifecycle
  • Support testers and defect resolution
  • Update status/risks/issues/impediments in daily scrum calls to the customer and track it to closure.
  • Writing testable, scalable and efficient code
  • Working on the necessary documentations as needed


Technical Skills:


  • Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL.
  • Experience in design, build and deployment of Python based applications.
  • Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or Oracle
  • Experience in version control system like Git and CI/CD pipeline is a must.
  • Experience in Delta lake APIs is a plus
  • Experience in Docker and Kubernetes is a plus
  • Knowledge of AWS services like S3, Athena, Glue, Lambda, Redshift or Cloud platform is a plus



Minimum Qualification:

15 years of full-time education

  • PySpark

    1 week ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    TCS Hiring !! Pyspark 13TH December 2025 Virtual DriveRole*Pyspark4-7 YearsPlease read Job description before ApplyingNOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details:Name:Contact Number:Email ID:Highest Qualification in: (Eg....

  • Pyspark Developer

    2 days ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Summary:We are seeking an experienced Pyspark Developer to join our team. As a Pyspark Developer, you will be responsible for designing, developing, and implementing data processing and analytics solutions using Pyspark, Big Data, and AWS technologies.Responsibilities:Develop and maintain data processing and analytics solutions using Pyspark, Spark, and...

  • Python/Pyspark, Bigquery with GCP, Apache Iceberg

    1 week ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    Python/Pyspark, Bigquery with GCP,TCS Hiring !!Virtual Drive ***13-dec -25Python/Pyspark, Bigquery with GCP, Apache IcebergTCS - HyderabadImmediate JoinersRole** Python/Pyspark, Bigquery with GCP, Apache IcebergExp -4 to 7 yearsPlease read Job description before ApplyingNOTE: If the skills/profile matches and interested, please reply to this email by...

  • PySpark Developer

    4 days ago

    Hyderabad, Telangana, India Algoleap Technologies Full time

    SUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Databricks + Pyspark

    7 days ago

    Hyderabad, Telangana, India Cognizant Full time

    Skills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...

  • PySpark Developer

    6 days ago

    Hyderabad, Telangana, India Algoleap Technologies Pvt Ltd Full time

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • PySpark Engineer

    2 weeks ago

    Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full time ₹ 6,00,000 - ₹ 25,00,000 per year

    Role: PySpark EngineerExperience Required: Minimum 5-10 YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 30 Days maxRequired skill sets and expertise:5+ years of experience in PySpark, Big Data technologies, Data Warehousing.Strong Python programming experience.Domain: Experience...

  • Senior PySpark Engineer

    2 days ago

    Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full time

    Role: Senior PySpark EngineerExperience Required: Minimum 8+ YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 15 Days maxMode of Interview: VirtualWe are seeking a highly skilled PySpark Data Engineer to design, build, and optimize large-scale data pipelines and distributed...

  • Lead/ Sr. Pyspark Data Engineer

    2 days ago

    Hyderabad, Telangana, India DATAECONOMY Full time

    Job Title: PySpark Data EngineerExperience: 6+ YearsLocation: Hyderabad/ PuneEmployment Type: Full-TimeJob Summary:We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 6+ years of experience in designing and implementing data pipelines using PySpark, AWS Glue,...

  • EverestDX - Senior Data Engineer - Python/PySpark

    2 days ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    DescriptionJob Summary :We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark/Spark, and SQL, along with the ability to guide a small team on...