Senior PySpark Developer

4 weeks ago


Pune, Maharashtra, India Thinkwise Consulting LLP Full time

Job Title: Senior PySpark Developer

Job Summary:

We are seeking a highly skilled Senior PySpark Developer to join our team at Thinkwise Consulting LLP. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.

Key Responsibilities:

  • Design and develop efficient and scalable solutions using PySpark and AWS Glue.
  • Ensure data quality and integrity through rigorous testing, validation, and data cleansing processes.
  • Integrate data from multiple sources such as databases, APIs, and external datasets.
  • Optimize and tune PySpark jobs for enhanced performance and reliability.
  • Document data engineering processes, workflows, and best practices.

Requirements:

  • Strong programming skills in Python and proficiency with PySpark and SQL.
  • Experience working with relational databases and big data technologies like Hadoop, Spark, Hive, and Impala.
  • Excellent communication and collaboration abilities.
  • Bachelor's or Master's degree in Engineering/Technology (BE/BTech or ME/MTech).


  • Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Thinkwise Consulting LLP. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.Key Responsibilities:* Design and develop efficient...


  • Pune, Maharashtra, India NewVision Software Full time

    Job DescriptionJob Title: Senior PySpark DeveloperJob Summary: We are seeking a highly skilled Senior PySpark Developer to join our team at NewVision Software. The ideal candidate will have extensive experience in designing and implementing Big Data systems using PySpark, database migration, transformation, and integration solutions for Data warehousing...


  • Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Senior Data Engineer - PySpark and AWS GlueJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Thinkwise Consulting LLP. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable data solutions using PySpark and AWS Glue.Key Responsibilities:Data...


  • Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks Lead / Senior Data EngineerExperience: 5.5 to 12 years of experience in Pyspark, Databricks, and Cloud (Azure or AWS)Key Responsibilities:Lead the development of Pyspark and Databricks projectsDesign and implement data engineering solutions using Pyspark and DatabricksCollaborate with cross-functional teams to deliver...


  • Pune, Maharashtra, India DATAECONOMY Full time

    Job Description:As a Senior PySpark Engineer Lead at DATAECONOMY, you will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark.You will collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data...


  • Pune, Maharashtra, India Tech Mahindra Full time

    Job Summary:We are seeking a highly experienced Senior PySpark Engineer to lead our team in developing and implementing cutting-edge big data processing systems. The ideal candidate will have a strong background in PySpark, cloud computing, and software architecture.Key Responsibilities:Design and implement scalable big data processing systems using PySpark...


  • Pune, Maharashtra, India Tech Mahindra Full time

    At Tech Mahindra, we are seeking an experienced Senior PySpark Architect to lead our big data processing initiatives. The ideal candidate will have a strong background in software architecture, with a focus on PySpark and big data processing systems.Key Responsibilities:Lead technical assignments to ensure timely and high-quality deliverables.Implement best...

  • Senior Data Engineer

    1 month ago


    Pune, Maharashtra, India Exusia Full time

    Job Title: Senior Data Engineer (Developer) - Python/Pyspark/DatabricksExusia is seeking a highly skilled Senior Data Engineer (Developer) with expertise in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.Key Responsibilities:Design, develop, and maintain large-scale data engineering solutions using...

  • Pyspark Engineer

    1 month ago


    Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks LeadJob Summary: We are seeking a highly skilled Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. The ideal candidate will have 6-12 years of experience in Pyspark, Databricks, Cloud, Big Data, and SQL.Key Responsibilities:Lead the development and implementation of Pyspark and Databricks...

  • PySpark Lead

    4 weeks ago


    Pune, Maharashtra, India DATAECONOMY Full time

    Job Description:As a key member of the DATAECONOMY team, we are seeking a highly skilled PySpark Lead to lead the design and implementation of big data solutions.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions that drive business growth.Design and implement scalable and robust data pipelines using...

  • PySpark Team Lead

    1 month ago


    Pune, Maharashtra, India DATAECONOMY Full time

    Job OverviewLead a team of data engineers in the design and implementation of big data solutions using PySpark.As a PySpark Lead, you will be responsible for collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Key responsibilities include designing and implementing scalable and robust data pipelines using...


  • Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark LeadAbout the Role:DataEconomy is seeking a seasoned PySpark engineer to lead our team of data engineers in the design and implementation of big data solutions. This role involves collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Responsibilities:Design and implement scalable and...

  • PySpark Team Lead

    4 weeks ago


    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark Team LeadAbout the Role:At DATAECONOMY, we are seeking a highly skilled PySpark Team Lead to lead our team of data engineers in the design and implementation of big data solutions using PySpark. As a key member of our team, you will be responsible for collaborating with cross-functional teams to understand business needs and develop...

  • Pyspark Glue Engineer

    2 weeks ago


    Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Pyspark Glue EngineerAbout the Role:We are looking for a skilled Pyspark Glue Engineer to join our team at Thinkwise Consulting LLP. As a Pyspark Glue Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue. You will ensure data quality and integrity through rigorous...

  • PySpark Lead

    1 month ago


    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark LeadJob Summary:We are seeking a highly experienced PySpark Lead to join our team at DATAECONOMY. As a key member of our data engineering team, you will be responsible for leading the design and implementation of big data solutions using PySpark.Key Responsibilities:* Lead a team of data engineers in the design and implementation of big...


  • Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks LeadAbout the Role: We are seeking an experienced Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. As a Pyspark Lead / Databricks Lead, you will be responsible for leading the development and implementation of Pyspark and Databricks solutions.Key Responsibilities:Lead the development and...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: RemoteJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark on Data bricks. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters, as well as expertise in Delta Lake features...


  • Pune, Maharashtra, India Radical Technologies Full time

    At Radical Technologies, we are seeking a highly skilled Senior Software Developer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable data solutions using Cloud computing platforms such as Azure.Key Responsibilities:Develop and implement data pipelines using Data bricks and Data...


  • Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: Senior Python DeveloperJob Overview:We are seeking a highly skilled Senior Python Developer to join our team at DATAECONOMY. The ideal candidate will have extensive experience with Python development and working with large datasets in distributed computing environments. You will be responsible for designing, implementing, and optimizing data...


  • Pune, Maharashtra, India BirlaSoft Full time

    Azure Data Engineer with Databricks and PySpark RoleJob Summary:The ideal candidate for this position will have experience in performing design, development, and deployment using Azure services, specifically Data Factory, Databricks, PySpark, and SQL. They will be responsible for developing and maintaining scalable data pipelines and building new data source...