PySpark Engineer

3 weeks ago

PuneBangaloreChennaiHyderabad, India nhrms Full time
Job Title: PySpark Developer

Job Summary:

We are seeking a highly skilled PySpark Developer to join our team at NHRMS. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using PySpark.

Key Responsibilities:

  • Develop and maintain efficient data processing workflows using PySpark.
  • Collaborate with data scientists and analysts to implement data solutions and optimize data transformations.
  • Design and implement data frames for efficient data manipulation and processing.
  • Participate in Agile activities, including daily stand-ups, sprint planning, and retrospectives.
  • Ensure the quality and performance of data processing workflows.
  • Troubleshoot and resolve issues related to data processing and transformation.
  • Document technical solutions and processes.

Required Skills:

  • Strong experience with PySpark and Apache Spark.
  • Proficiency in Python programming.
  • Expertise in working with data frames for data manipulation and processing.
  • Familiarity with big data technologies and tools.
  • Experience with Agile methodologies and participation in Agile activities.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and teamwork skills.

Preferred Skills:

  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Knowledge of SQL and relational databases.
  • Familiarity with version control systems like Git.
  • Understanding of data warehousing and ETL processes.

Education and Experience:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering or a related role.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge data projects.
  • Collaborative and innovative work environment.
  • Professional growth and development opportunities.

  • Pyspark Engineer

    3 weeks ago

    bangalore, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

  • Pyspark Engineer

    1 month ago

    bangalore, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field. Experience in data engineering or data analyst. Should have experience in ETL pipeline development. Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming. Good experience in SQL/ Advanced...

  • PySpark Developer

    3 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...

  • PySpark Developer

    3 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • Pyspark Glue Engineer

    5 days ago

    Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Pyspark Glue EngineerAbout the Role:We are looking for a skilled Pyspark Glue Engineer to join our team at Thinkwise Consulting LLP. As a Pyspark Glue Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue. You will ensure data quality and integrity through rigorous...

  • PySpark Engineer

    3 weeks ago

    Pune, Maharashtra, India KPI Partners Full time

    Job Title: PySpark/Databricks EngineerLocation: RemoteJob Type: Full-timeAbout Us:KPI Partners is a dynamic company seeking a highly skilled PySpark Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing and developing scalable data pipelines and analytics solutions.Responsibilities:Design, develop,...

  • Senior Pyspark Engineer

    1 week ago

    Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks Lead / Senior Data EngineerExperience: 5.5 to 12 years of experience in Pyspark, Databricks, and Cloud (Azure or AWS)Key Responsibilities:Lead the development of Pyspark and Databricks projectsDesign and implement data engineering solutions using Pyspark and DatabricksCollaborate with cross-functional teams to deliver...

  • Pyspark lead/ pyspark engineer/data engineer

    6 days ago

    Pune, India Evoke HR Solutions Pvt. Ltd. Full time

    Position: Pyspark Lead / Databricks Lead / Senior Data EngineerExp : 5.5 Years to 12 YearsNotice Period – Immediate to 28 Days ( Serving only)Job Location – Magarpatta, PuneMandatory Skills – Pyspark OR Databricks, Cloud (Azure or AWS), SQL, Nice to have to Unity catalog

  • Pyspark Lead/ Pyspark Engineer/Data Engineer

    1 week ago

    Pune, India Evoke HR Solutions Pvt. Ltd. Full time

    Position: Pyspark Lead / Databricks Lead / Senior Data EngineerExp : 5.5 Years to 12 YearsNotice Period – Immediate to 28 Days ( Serving only)Job Location – Magarpatta, PuneMandatory Skills – Pyspark OR Databricks, Cloud (Azure or AWS), SQL, Nice to have to Unity catalog

  • Pyspark Lead/ Pyspark Engineer/Data Engineer

    1 week ago

    pune, India Evoke HR Solutions Pvt. Ltd. Full time

    Position: Pyspark Lead / Databricks Lead / Senior Data EngineerExp : 5.5 Years to 12 YearsNotice Period – Immediate to 28 Days ( Serving only)Job Location – Magarpatta, PuneMandatory Skills – Pyspark OR Databricks, Cloud (Azure or AWS), SQL, Nice to have to Unity catalog

  • Pyspark Lead/ Pyspark Engineer/Data Engineer

    7 days ago

    pune, India Evoke HR Solutions Pvt. Ltd. Full time

    Position: Pyspark Lead / Databricks Lead / Senior Data Engineer Exp : 5.5 Years to 12 Years Notice Period – Immediate to 28 Days ( Serving only) Job Location – Magarpatta, Pune Mandatory Skills – Pyspark OR Databricks, Cloud (Azure or AWS), SQL, Nice to have to Unity catalog

  • Pyspark Lead/ Pyspark Engineer/Data Engineer

    1 week ago

    Pune, India Evoke HR Solutions Pvt. Ltd. Full time

    Position: Pyspark Lead / Databricks Lead / Senior Data EngineerExp : 5.5 Years to 12 YearsNotice Period – Immediate to 28 Days ( Serving only)Job Location – Magarpatta, PuneMandatory Skills – Pyspark OR Databricks, Cloud (Azure or AWS), SQL, Nice to have to Unity catalog

  • Pyspark Lead/ Pyspark Engineer/Data Engineer

    7 days ago

    Pune, India Evoke HR Solutions Pvt. Ltd. Full time

    Position: Pyspark Lead / Databricks Lead / Senior Data Engineer Exp : 5.5 Years to 12 Years Notice Period – Immediate to 28 Days ( Serving only) Job Location – Magarpatta, Pune Mandatory Skills – Pyspark OR Databricks, Cloud (Azure or AWS), SQL, Nice to have to Unity catalog

  • Pyspark

    4 weeks ago

    chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Pyspark

    2 weeks ago

    chennai, India Risk Resources LLP Full time

    Overview: The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities: Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Pyspark

    2 months ago

    Chennai, India Risk Resources LLP Full time

    Overview:The role of a Pyspark developer is crucial in our organization as they are responsible for developing and maintaining efficient scalable data processing applications using Pyspark.Key Responsibilities:Experience working in big data platforms for implementing projects with high SLA of data availability and data quality exposure to Azure cloud...

  • Senior PySpark Engineer Lead

    3 weeks ago

    Pune, Maharashtra, India DATAECONOMY Full time

    Job Description:As a Senior PySpark Engineer Lead at DATAECONOMY, you will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark.You will collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data...

  • Pyspark Engineer

    3 weeks ago

    Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks LeadJob Summary: We are seeking a highly skilled Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. The ideal candidate will have 6-12 years of experience in Pyspark, Databricks, Cloud, Big Data, and SQL.Key Responsibilities:Lead the development and implementation of Pyspark and Databricks...

  • PySpark Lead

    3 weeks ago

    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark LeadJob Summary:We are seeking a highly experienced PySpark Lead to join our team at DATAECONOMY. As a key member of our data engineering team, you will be responsible for leading the design and implementation of big data solutions using PySpark.Key Responsibilities:* Lead a team of data engineers in the design and implementation of big...

  • PySpark Lead

    3 weeks ago

    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark LeadAbout the Role:We are seeking an experienced PySpark Lead to join our team at DATAECONOMY. As a key member of our data engineering team, you will be responsible for leading the design and implementation of big data solutions using PySpark.Key Responsibilities:Lead a team of data engineers in the design and implementation of big data...