Pyspark Developer

5 days ago


west bengal, India Tata Consultancy Services Full time

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location Experience : 6 - 10 years Mode of interview : Virtual Location : Chennai, Hyderabad, Kolkata JOB DESCRIPTION: Must have: Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL. Experience in design, build and deployment of Python based applications. Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or Oracle Experience in version control system like Git and CI/CD pipeline is a must. Experience in Delta lake APIs is a plus Experience in Docker and Kubernetes is a plus Knowledge of AWS services like S3, Athena, Glue, Lambda, Redshift or Cloud platform is a plus Responsibilities: Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster. Writing complex queries as per the business rules and data extraction logic Query tuning and Performance optimization of various components as and when required. Work with development leads, System Architects and other teams (as needed) to manage dependencies, risks and issues. Contributing in all phases of the development lifecycle Support testers and defect resolution Update status/risks/issues/impediments in daily scrum calls to the customer and track it to closure. Writing testable, scalable and efficient code Working on the necessary documentations as needed


  • Pyspark Developer-1

    2 weeks ago


    Kolkata, West Bengal, India Realign LLC Full time

    **Job Type: Full Time**: **Job Category: IT**: Job Title: PySpark Developer Job Summary: Responsibilities and Duties: - Develop and optimize PySpark data processing pipelines - Collaborate with data engineers and data scientists to implement data solutions - Write efficient and scalable PySpark code - Troubleshoot and resolve performance issues - Design...


  • west bengal, India Tata Consultancy Services Full time

    Role**Databricks Senior Developer Required Technical Skill Set**Databricks, Spark and Data Migration experience Location: Kolkata Experience: 4 years to 10 Years Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. 8+ years with strong Databricks, Spark and Data Migration experience 2. Should have experience of end-to-end migration from AWS...


  • west bengal, India Tata Consultancy Services Full time

    Role**Databricks Senior DeveloperRequired Technical Skill Set**Databricks, Spark and Data Migration experienceLocation: KolkataExperience: 4 years to 10 YearsDesired Competencies (Technical/Behavioral Competency)Must-Have**1. 8+ years with strong Databricks, Spark and Data Migration experience2. Should have experience of end-to-end migration from AWS...

  • Power Bi Developer

    1 week ago


    West Bengal - Pune, Maharashtra, India CIEL HR Full time

    Location- Pune Kolkata NP-Immediate to 15 only Experience-Relevant should be 6-8 years Please note below skills for the engagement as per client s JD SQL SSMS Power BI Qlikview Python pyspark pandas etc Azure Data Services

  • Azure Databricks

    2 weeks ago


    west bengal, India Tata Consultancy Services Full time

    TCS hiring!! Role: Azure Data Bricks Location: Kolkata- Walk in Drive Interview Date: 15-Nov-25 Experience: 4-12 Must Have: • Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks. • Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources....

  • Azure Databricks

    2 weeks ago


    west bengal, India Tata Consultancy Services Full time

    TCS hiring!!Role: Azure Data BricksLocation: Kolkata- Walk in DriveInterview Date: 15-Nov-25Experience: 4-12Must Have:• Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks. • Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources. •...

  • Aws Glue

    2 weeks ago


    Kolkata, West Bengal, India Cognizant Full time

    **Skill**: AWS Glue **Experience**: 6 to 9 years **Location**: Kolkata **Job description** **Technical Skills**: - AWS Glue: 3+ years of hands-on experience in AWS Glue ETL development - Python/PySpark: Strong programming skills in Python and PySpark for data transformation - AWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMR - Data...

  • Data Engineer

    7 hours ago


    west bengal, India Tata Consultancy Services Full time

    Job title: Data Engineer Job Location: Kolkata, Pune, Bangalore, New DelhiExperience : 4-13 years Virtual Interview : 28th Nov (Friday) 1. 8+ years with strong Databricks, Spark and Data Migration experience2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data...

  • Data Engineer

    1 hour ago


    west bengal, India Tata Consultancy Services Full time

    Job title: Data Engineer Job Location: Kolkata, Pune, Bangalore, New Delhi Experience : 4-13 years Virtual Interview : 28th Nov (Friday) 1. 8+ years with strong Databricks, Spark and Data Migration experience 2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data...

  • Senior Data Engineer

    3 weeks ago


    west bengal, India Sundew Full time

    About the role : We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along...