Pyspark Developer

2 months ago

pune, India NewVision Software Full time

Position Summary:

We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.


Responsibilities:

  • Design, develop, and implement data pipelines using Azure Data Factory (ADF) or other orchestration tools.
  • Write efficient SQL queries to extract, transform, and load (ETL) data from various sources into Azure Synapse Analytics.
  • Utilize PySpark and Python for complex data processing tasks on large datasets within Azure Databricks.
  • Collaborate with data analysts to understand data requirements and ensure data quality.
  • Hands-on experience in designing and developing Datalakes and Warehouses
  • Implement data governance practices to ensure data security and compliance.
  • Monitor and maintain data pipelines for optimal performance and troubleshoot any issues.
  • Develop and maintain unit tests for data pipeline code.
  • Work collaboratively with other engineers and data professionals in an Agile development environment.


Preferred Skills & Experience:

  • Good knowledge of PySpark & working knowledge of Python
  • Full stack Azure Data Engineering skills (Azure Data Factory, DataBricks and Synapse Analytics)
  • Experience with large dataset handling
  • Hands-on experience in designing and developing Datalakes and Warehouses


New Vision is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees

  • Senior PySpark Developer

    3 weeks ago

    Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Thinkwise Consulting LLP. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.Key Responsibilities:* Design and develop efficient...

  • Senior PySpark Developer

    3 weeks ago

    Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Thinkwise Consulting LLP. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.Key Responsibilities:Design and develop efficient...

  • PySpark Glue Developer

    4 weeks ago

    Pune, Maharashtra, India Redbox HR Consulting Full time

    Job Title: Pyspark Glue DeveloperAbout the Role:We are seeking a highly skilled Pyspark Glue Developer to join our team at Redbox HR Consulting. As a Pyspark Glue Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and Glue.Key Responsibilities:Design and develop efficient and scalable...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a PySpark Developer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using Azure...

  • Senior PySpark Developer

    4 weeks ago

    Pune, Maharashtra, India NewVision Software Full time

    Job DescriptionJob Title: Senior PySpark DeveloperJob Summary: We are seeking a highly skilled Senior PySpark Developer to join our team at NewVision Software. The ideal candidate will have extensive experience in designing and implementing Big Data systems using PySpark, database migration, transformation, and integration solutions for Data warehousing...

  • PySpark Glue Developer

    4 weeks ago

    Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: PySpark Glue DeveloperWe are seeking a highly skilled PySpark Glue Developer to join our team at Thinkwise Consulting LLP. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.Key Responsibilities:Design and develop data...

  • Pyspark Glue Developer

    4 weeks ago

    Pune, Maharashtra, India Redbox HR Consulting Full time

    About the RoleWe are seeking a highly skilled Pyspark Glue Developer to join our team at Redbox HR Consulting. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and Glue.Key ResponsibilitiesDesign and develop robust data pipelines using PySpark and...

  • PySpark Developer

    4 weeks ago

    Pune/Bangalore/Chennai/Hyderabad/Mysore, India Vtricks Technologies Full time

    Job Title: PySpark DeveloperWe are seeking an experienced PySpark Developer to join our team at Vtricks Technologies. As a key member of our Agile team, you will be responsible for designing, developing, and maintaining large-scale PySpark-based data pipelines using Azure services.Key Responsibilities:Develop and maintain PySpark-based data pipelines using...

  • PySpark Glue Developer

    4 weeks ago

    Pune, Maharashtra, India Redbox HR Consulting Full time

    About the RoleWe are seeking a highly skilled PySpark Glue Developer to join our team at Redbox HR Consulting. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and Glue.Key ResponsibilitiesDesign and develop data pipelines using PySpark and Glue to...

  • GCP PySpark Developer

    4 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Job Title: PySpark Developer (PySpark + GCP)We are seeking a skilled PySpark Developer with experience in GCP to join our team in Pune.Key Responsibilities:Design and develop scalable PySpark applications on GCPWork with big data technologies such as Hadoop and SparkDevelop and maintain data pipelines using GCP DataProcCollaborate with cross-functional teams...

  • PySpark Glue Developer

    2 weeks ago

    Pune, Maharashtra, India Thinkwise Consulting LLP Full time

    Job Title: Senior Data Engineer - PySpark and AWS GlueJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Thinkwise Consulting LLP. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable data solutions using PySpark and AWS Glue.Key Responsibilities:Data...

  • Senior PySpark Developer

    4 weeks ago

    Pune, Maharashtra, India Synechron Full time

    Job Title: PySpark Developer (PySpark + GCP)Location: PuneNotice: 0 - 15 daysAbout Company:Synechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. Our progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud &...

  • Pyspark Hadoop Developer

    4 weeks ago

    pune, India Tata Consultancy Services Full time

    Job Title: PySpark Hadoop Engineer Experience- 5 to 8 yrsLocation: Pune, Bangalore, HYD, DelhiKey Skills/Knowledge: Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) Experience required: Good Data background. Hadoop is the...

  • Pyspark Hadoop Developer

    2 months ago

    Pune, India Tata Consultancy Services Full time

    Job Title: PySpark Hadoop Engineer Experience- 5 to 8 yrsLocation: Pune, Bangalore, HYD, DelhiKey Skills/Knowledge: Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) Experience required: Good Data background. Hadoop is the...

  • Pyspark Hadoop Developer

    2 months ago

    Pune, India Tata Consultancy Services Full time

    Job Title: PySpark Hadoop Engineer Experience - 5 to 8 yrs Location: Pune, Bangalore, HYD, Delhi Key Skills/Knowledge: Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) Experience required: Good Data background....

  • Pyspark Hadoop Developer

    2 months ago

    Pune, India Tata Consultancy Services Full time

    Job Title: PySpark Hadoop Engineer Experience- 5 to 8 yrsLocation: Pune, Bangalore, HYD, DelhiKey Skills/Knowledge: Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) Experience required: Good Data background. Hadoop is the...

  • Pyspark Hadoop Developer

    2 months ago

    pune, India Tata Consultancy Services Full time

    Job Title: PySpark Hadoop Engineer Experience- 5 to 8 yrsLocation: Pune, Bangalore, HYD, DelhiKey Skills/Knowledge: Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) Experience required: Good Data background. Hadoop is the...

  • Senior PySpark Developer

    4 weeks ago

    Pune H.O, India NewVision Software Full time

    Job Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at NewVision Software. As a Senior PySpark Developer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using PySpark.Key Responsibilities:Design and implement data processing pipelines using...

  • PySpark Lead

    4 weeks ago

    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: PySpark LeadAbout the Role:We are seeking an experienced PySpark Lead to join our team at DATAECONOMY. As a key member of our data engineering team, you will be responsible for leading the design and implementation of big data solutions using PySpark.Key Responsibilities:Lead a team of data engineers in the design and implementation of big data...

  • Pyspark Engineer

    4 weeks ago

    Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks LeadJob Summary: We are seeking a highly skilled Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. The ideal candidate will have 6-12 years of experience in Pyspark, Databricks, Cloud, Big Data, and SQL.Key Responsibilities:Lead the development and implementation of Pyspark and Databricks...