Pyspark Developer

3 weeks ago


Bengaluru, India Tata Consultancy Services Full time

POSITION :Pyspark developer


JOB LOCATION : Bangalore / Chennai / Pune / Delhi


EXPERIENCE REQUIREMENT : 4 to 12 Years


Mandatory: Primary skill: Pyspark.

  • 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.
  • Must have excellent knowledge in Apache Spark and Python programming experience.
  • Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.
  • Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE
  • Should have experience in fine-tuning process and troubleshooting performance issue.
  • Experience in source code control systems like git, GitHub, SVN etc.
  • Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.
  • Experience in CI/CD tools like Jenkins, Nexus, Ansible etc.
  • Excellent communication and interpersonal skills.
  • Understanding of Unix/Linux Shell Scripting
  • Should understand and have operating experience with Agile delivery methodologies.
  • Should have hands-on experience in the following: data validation, writing unit test cases.
  • Working experience of ETL Tools like Data Stage, Talend etc. is an added advantage.
  • Working experience on Databricks / Delta Lake is an added advantage.

  • Pyspark Developer

    4 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Pyspark Developer Job DescriptionWe are seeking a highly skilled Pyspark Developer to join our team at Tata Consultancy Services. As a Pyspark Developer, you will be responsible for designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for Data warehousing projects.Key...

  • PySpark Developer

    3 weeks ago


    Bengaluru, Karnataka, India Capgemini Engineering Full time

    Job Title: Pyspark EngineerAt Capgemini Engineering, we are seeking a highly skilled Pyspark Engineer to join our team.Responsibilities:Design and develop large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to integrate data engineering solutions.Develop and maintain complex data processing applications using...

  • Pyspark Developer

    1 week ago


    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark.3-6 years of experience in the design and implementation of Big Data pipelines usingPySpark,database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Pyspark Developer

    7 days ago


    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent...

  • Pyspark Developer

    2 months ago


    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Design and implementation of Big Data pipelines using PySparkDesired Experience Range: 5 to 8 YearsJob Location: Bangalore / PuneMust Have:Mandatory: Primary skill: Pyspark.5+ years of experience in the design and implementation of Big Data pipelines using PySpark,...

  • Pyspark Developer

    4 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Pyspark Developer

    4 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developer JOB LOCATION : Bangalore / Chennai / Pune / Delhi EXPERIENCE REQUIREMENT : 4 to 12 Years Mandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. Must have...


  • Bengaluru, India Mantra Labs Pvt Ltd Full time

    Job Title :Pyspark Senior DeveloperJob Description :5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine.We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...


  • Bengaluru, India Minutes to Seconds Pty Ltd Full time

    About the job At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Title:PySpark Hadoop EngineerExperience: 5 to 8 yearsLocation: Pune, Bangalore, Hyderabad, DelhiKey Skills/Knowledge:We are seeking a highly skilled professional with a strong background in data and experience in Hadoop and PySpark. The ideal candidate will have a minimum of 4 years of experience, with at least 2 years of experience in PySpark....


  • Bengaluru, Karnataka, India Hiring House Technology Full time

    About the RoleHiring House Technology is seeking a highly skilled PYSPARK DEVELOPER to join our team and contribute to the design and development of robust PySpark applications for large-scale data processing.Key Responsibilities• Design and implement efficient data ingestion, transformation, and storage processes.• Develop and optimize PySpark...


  • Bengaluru, India Tata Consultancy Services Full time

    Job Title:PySpark Hadoop EngineerExperience- 5 to 8 yrsLocation: Pune, Bangalore, HYD, DelhiKey Skills/Knowledge:Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional)Experience required:Good Data background. Hadoop is the primary...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Title: Senior PySpark DeveloperAt Tata Consultancy Services, we are seeking a highly skilled Senior PySpark Developer to join our team.Key Responsibilities:Design and implement Big Data pipelines using PySpark, database migration, transformation, and integration solutions for Data warehousing projects.Develop data processing tasks using PySpark,...


  • Bengaluru, Karnataka, India Hiring House Technology Full time

    Hiring House Technology is seeking a skilled Sr. PySpark Developer to join our team.Job SummaryWe are looking for a highly motivated and experienced Big Data Engineer to design, develop, and maintain large-scale data processing systems using PySpark.Key ResponsibilitiesDesign and develop robust PySpark applications for data processing and analysis.Build and...


  • Bengaluru, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Pyspark Hadoop DeveloperJob Locations: BengaluruExperience Range: 5 to 10 years5+yrs of hands on experience in Hadoop Scala, Pyspark, Hive, Spark , Hive/Impala/SQL with Hadoop eco systemGood Data background. Hadoop is the primary skill and PySpark is secondary experience. Experience in design...


  • Bengaluru, India Minutes to Seconds Pty Ltd Full time

    About the jobAtMinutes to Seconds we match people having great skills withtailorfitted jobs to achieve welldeserved success. We know how tomatch people to the right job roles to create that perfect fit.This changes the dynamics of business success and catalyzes thegrowth of individuals. Our aim is to provide both our candidatesand clients with great...


  • Bengaluru, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Pyspark Hadoop DeveloperJob Locations: BengaluruExperience Range: 5 to 10 years- 5+yrs of hands on experience in Hadoop Scala, Pyspark, Hive, Spark , Hive/Impala/SQL with Hadoop eco system- Good Data background. Hadoop is the primary skill and Py Spark is secondary experience.- Experience in...

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Capgemini Engineering Full time

    Job Title: Pyspark EngineerAt Capgemini Engineering, we are seeking a highly skilled Pyspark Engineer to join our team. As a Pyspark Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using the PySpark framework.Responsibilities:Design and develop ETL pipelines using PySpark to extract, transform,...

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Data Engineer (Pyspark Developer) Job DescriptionTata Consultancy Services is seeking a highly skilled Data Engineer with expertise in Pyspark to join our team.Key Responsibilities:Design and implement Big Data pipelines using PySparkDevelop data processing tasks using PySpark, including reading data from external sources, merging data, aggregating data,...


  • Bengaluru, Karnataka, India Capgemini Full time

    About the Role:We are looking for a skilled PySpark developer to join our team at Capgemini.Key Responsibilities:Manage large teams and deliver complex data processing projectsDevelop and maintain large-scale data processing systems using PySparkDesign and implement big data processing tools and techniquesCollaborate with cross-functional teams to drive...