Current jobs related to Deloitte - Data Engineer - PySpark/Python - pune - Deloitte India

  • Data Engineer

    2 months ago

    Pune, India Talentpro Edge Full time

    What will your essential responsibilities include ?- Exploring and acquiring new sources of data. - Using curiosity and creativity, would involve using technology to automate data acquisition, the ability to link new sources with internal data, and an appropriate level of supporting documentation of the source and technical solution.- Ensuring quality and...

  • Python Pyspark

    3 months ago

    Pune, India Virtusa Full time

    Role: Data Engineer 1) Minimum of 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare 3) Extensive data analysis skills and Good communication skills **About Virtusa** Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When...

  • Pyspark Developer

    2 weeks ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Big Data Engineer

    2 months ago

    Pune, India Techno Wise Full time

    Position : Big Data EngineerRelevant Experience : 5+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Pyspark Developer

    4 days ago

    pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • Pyspark Developer

    2 weeks ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Pyspark Developer

    2 weeks ago

    Pune, India NewVision Software Full time

    Position Summary: We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform. Responsibilities: Design, develop, and implement data pipelines using...

  • Pyspark Developer

    4 days ago

    pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Pyspark Developer

    2 weeks ago

    Pune, India NewVision Software Full time

    Position Summary:We are seeking a talented Data Engineer with a strong background in data engineering to join our team. You will play a key role in designing, building, and maintaining data pipelines using a variety of technologies, with a focus on the Microsoft Azure cloud platform.Responsibilities:Design, develop, and implement data pipelines using Azure...

  • Azure Data Engineer

    2 months ago

    Pune, India Kairos Konnect Full time

    Role-Senior Azure Data EngineeringTotal Experience: - 4+ YearsLocation: - Pune Type: - HybridBudget: - 16 LPA maxNotice Period: - 15 days MaxClient: - Leading software development and IT outsourcing companyRequirements :- Must have 3 Years of Experience on Python- Must have 3 yrs. relevant experience on Apache Spark OR PySpark- Must have 3 yrs. of experience...

  • Data Engineer( Azure Pyspark )

    2 weeks ago

    Pune, India Overture Rede Private Limited Full time

    Job DescriptionJob Title: Data Engineer Location: [Specify Location or Remote] Responsibilities: Design, build, and maintain scalable data pipelines using PySpark on Data bricks. Work with Delta Lake to ensure data reliability, consistency, and scalability. Utilize Azure Synapse for integrated analytics, querying, and big data processing. Develop and deploy...

  • PySpark/Databricks Engineers

    2 weeks ago

    pune, India KPI Partners Full time

    Location: Bangalore / Hyderabad / PuneJob Type: Full-time  Introduction: We are seeking a highly skilled PySpark Engineer with over 6 years of experience in big data processing, particularly with a strong background in Python, Spark and SQL. As part of our dynamic team, you will play a crucial role in designing and developing scalable data pipelines and...

  • PySpark/Databricks Engineers

    1 month ago

    Pune, India KPI Partners Full time

    Location: Bangalore / Hyderabad / PuneJob Type: Full-time Introduction:We are seeking a highly skilled PySpark Engineer with over 6 years of experience in big data processing, particularly with a strong background in Python, Spark and SQL. As part of our dynamic team, you will play a crucial role in designing and developing scalable data pipelines and...

  • Data Engineer Azure Pyspark

    1 week ago

    Pune, India Overture Rede Private Limited Full time

    Job Title: Data EngineerLocation: Specify Location or Remote Responsibilities:Design build and maintain scalable data pipelines using PySpark onData bricks. Work with Delta Lake to ensure data reliabilityconsistency and scalability. Utilize Azure Synapse for integratedanalytics querying and big data processing. Develop and deploy datasolutions on Azure...

  • Databricks Engineer

    2 months ago

    Pune, India HNM Solutions Full time

    Role : DatabricksLocation : pune onlyExperience : 2 to 4 yearsNotice Period : Immediate joinersJob Description :A Data Engineer understands the client's requirements and develops and delivers data engineering solutions as per the scope. The role requires good skills in the development of solutions using various services required for data architecture on...

  • Data Engineer

    2 months ago

    Pune, India SDNA Full time

    Primary Skills : PySparkExperience: 6 to 12Notice period : immediate to 30 days Location : Pune/ Description : (Offshore Data Engineers Cloudera Focus (x 3 )Focus : Hands-on analysis, performance tuning, cluster log analysisResponsibilities :- Execute data analysis tasks guided by the architect and lead. (cluster/process log analysis, code profiling,...

  • Data Engineer

    3 days ago

    Pune, India Vimerse Infotech inc Full time

    Job Role: Data EngineerLocation:Pune GGN Bangalore Chennai Exp:48 yrsNP:immediate joiner and October 1st week candidateWork Mode: HybridMandatory skills Pyspark AWS PythonKey SkillsDesign develop maintain efficient and scalable solutions using PySparkEnsure data quality and integrity by implementing robust testing validation and cleansing processesIntegrate...

  • AWS Data Engineer

    2 days ago

    Pune, India Recruitement Agency Full time

    N.P - Immediate to 15 days.Location : - Pune- 7 to 12 years of experience in designing, implementing, and managing cloud solutions on AWS.- Design, develop, and implement cloud solutions on AWS, utilizing a wide range of AWS services, including Glue ETL, Glue Data Catalog, Athena, Redshift, RDS, DynamoDB, Step Function, Event Bridge, Lambda, API Gateway,...

  • Data Engineer

    4 weeks ago

    Pune, India TETRAHED INC Full time

    Role : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...

  • Data Engineer

    1 month ago

    Pune, India Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...

Deloitte - Data Engineer - PySpark/Python

4 months ago

pune, India Deloitte India Full time

Job Description :

- Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting.


- Implement the tools and processes, handling performance, scale, availability, accuracy, and monitoring.


- Liaison with BAs to ensure that requirements are correctly interpreted and implemented.

- Participation in regular planning and status meetings.


- Input to the development process through the involvement in Sprint reviews and retrospectives.


- Input into system architecture and design.

- Peer code reviews.

- Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.

- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, PySpark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTFUL API services).

- Sound knowledge on working Unix/Linux Platform

- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL, PySpark.

- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.

- Understanding of big data modelling techniques using relational and non-relational techniques

- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.

Good to have skills :

- Experience with time-series/analytics dB's such as ElasticSearch.

- Experience with scheduling tools such as Airflow, Control-M.

- Understanding or experience of Cloud design patterns

- Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.

- Experience with developing Hive QL, UDF's for analyzing semi structured/structured datasets.

(ref:hirist.tech)