Pyspark Engineer

1 month ago


bangalore, India Capgemini Engineering Full time

Responsibilities:
Bachelor's degree in Computer Science, Engineering, or related field.
Experience in data engineering or data analyst.
Should have experience in ETL pipeline development.
Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.
Good experience in SQL/ Advanced SQL.
Strong understanding of PySpark framework and its ecosystem, including DataFrame API, Spark SQL, RDDs, and MLlib.
Experience in migrating to PySpark or similar data processing frameworks is highly desirable.
Solid understanding of distributed computing principles, parallel processing, and scalability considerations.
Familiarity with big data technologies such as Apache Hadoop, Apache Hive, Apache Kafka, and Apache Spark.

Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.

Required Skills:
Experience in data engineering or data analyst.
Should have experience in ETL pipeline development.
Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.
Good experience in SQL/ Advanced SQL.
Strong understanding of PySpark framework and its ecosystem, including DataFrame API, Spark SQL, RDDs, and MLlib.
Experience in migrating to PySpark or similar data processing frameworks is highly desirable.
Solid understanding of distributed computing principles, parallel processing, and scalability considerations.
Familiarity with big data technologies such as Apache Hadoop, Apache Hive, Apache Kafka, and Apache Spark.


  • Pyspark Engineer

    3 weeks ago


    bangalore, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

  • PySpark Engineer

    3 weeks ago


    Pune/Bangalore/Chennai/Hyderabad, India nhrms Full time

    Job Title: PySpark DeveloperJob Summary:We are seeking a highly skilled PySpark Developer to join our team at NHRMS. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using PySpark.Key Responsibilities:Develop and maintain efficient data processing workflows...

  • Pyspark Developer

    2 months ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Data Engineer (Pyspark Developer) Required Skill Set: Design and implementation of Big Data pipelines using PySpark Desired Experience Range: 5 to 8 Years Job Location: Bangalore / Pune Must Have: Mandatory: Primary skill: Pyspark. 5+ years of experience in the design and implementation of Big Data pipelines...

  • Pyspark Developer

    3 weeks ago


    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Data Engineer (Pyspark Developer) Required Skill Set: Design and implementation of Big Data pipelines using PySpark Desired Experience Range: 5 to 8 Years Job Location: Bangalore / Pune Must Have: Mandatory: Primary skill: Pyspark. 5+ years of experience in the design and implementation of Big Data pipelines using...

  • Pyspark Developer

    3 weeks ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Design and implementation of Big Data pipelines using PySparkDesired Experience Range: 5 to 8 YearsJob Location: Bangalore / PuneMust Have:Mandatory: Primary skill: Pyspark.5+ years of experience in the design and implementation of Big Data pipelines using PySpark,...

  • Pyspark Developer

    2 months ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Design and implementation of Big Data pipelines using PySparkDesired Experience Range: 5 to 8 YearsJob Location: Bangalore / PuneMust Have:Mandatory: Primary skill: Pyspark.5+ years of experience in the design and implementation of Big Data pipelines using PySpark,...

  • Pyspark Developer

    2 months ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Data Engineer (Pyspark Developer)Required Skill Set: Design and implementation of Big Data pipelines using PySparkDesired Experience Range: 5 to 8 YearsJob Location: Bangalore / PuneMust Have:Mandatory: Primary skill: Pyspark.5+ years of experience in the design and implementation of Big Data pipelines using PySpark,...

  • PySpark Developer

    3 weeks ago


    Bangalore, India Rigel networks Full time

    Job Title: PySpark DeveloperRigel Networks is seeking a highly skilled PySpark Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable, real-time, and high-performance cloud data lake solutions using PySpark.Key Responsibilities:Design and develop data processing...

  • Pyspark Developer

    2 months ago


    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Data Engineer (Pyspark Developer) Required Skill Set: Design and implementation of Big Data pipelines using PySpark Desired Experience Range: 5 to 8 Years Job Location: Bangalore / Pune Must Have: Mandatory: Primary skill: Pyspark. 5+ years of experience in the design and implementation of Big Data pipelines using...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Position : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...

  • Data Engineer

    1 month ago


    Bangalore/Hyderabad, Karnataka, India ANRI Solutions HR Services Full time

    Job Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...


  • bangalore, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TCS Human Resources Team!! Job Role: Pyspark Hadoop Developer Job Locations: Bengaluru Experience Range: 5 to 10 years - 5+yrs of hands on experience in Hadoop Scala, Pyspark, Hive, Spark , Hive/Impala/SQL with Hadoop eco system - Good Data background. Hadoop is the primary skill and PySpark is secondary experience. -...

  • PySpark Developer

    3 weeks ago


    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...


  • bangalore, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Pyspark Hadoop DeveloperJob Locations: BengaluruExperience Range: 5 to 10 years5+yrs of hands on experience in Hadoop Scala, Pyspark, Hive, Spark , Hive/Impala/SQL with Hadoop eco systemGood Data background. Hadoop is the primary skill and PySpark is secondary experience.Experience in design...


  • bangalore, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Pyspark Hadoop DeveloperJob Locations: BengaluruExperience Range: 5 to 10 years- 5+yrs of hands on experience in Hadoop Scala, Pyspark, Hive, Spark , Hive/Impala/SQL with Hadoop eco system- Good Data background. Hadoop is the primary skill and PySpark is secondary experience.- Experience in...


  • bangalore, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TCS Human Resources Team!!Job Role: Pyspark Hadoop DeveloperJob Locations: BengaluruExperience Range: 5 to 10 years- 5+yrs of hands on experience in Hadoop Scala, Pyspark, Hive, Spark , Hive/Impala/SQL with Hadoop eco system- Good Data background. Hadoop is the primary skill and PySpark is secondary experience.- Experience in...

  • PySpark Developer

    1 month ago


    Bangalore, Karnataka, India Rigel networks Full time

    Job Title - Pyspark DeveloperLocation : Bangalore G.P.O., Karnataka Job Description :Lead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience...

  • PySpark Developer

    2 weeks ago


    Bangalore, India Rigel networks Full time

    Job Title - Pyspark DeveloperLocation : Bangalore G.P.O., Karnataka Job Description :Lead Data Engineer :Top Skills :- Python- SQL- AWS- Spark- 7+ years relevant work experience in the Data Engineering field- 5+ years of experience working with Hadoop and Big Data processing frameworks (Hadoop, Spark, Hive, Flink, Airflow etc.)- 5+ years of Strong experience...

  • PySpark Developer

    3 weeks ago


    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • Data Engineer(Pyspark)

    2 months ago


    bangalore, India LTIMindtree Full time

    Skills : Python & Pyspark; Any Cloud Experience, preferably AWS. Strong Database / Datawarehouse Experience Experience : 12-16 Years Location : Mumbai / Pune / Chennai / Hyderabad / Bangalore / Kolkata / Delhi / Coimbatore Job Description: • Deep experience in developing data processing tasks using PySpark/spark such as reading data from external...