Deloitte - Data Engineer - PySpark/Python

1 month ago


Pune, Maharashtra, India Deloitte India Full time

Job Description :

- Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting.


- Implement the tools and processes, handling performance, scale, availability, accuracy, and monitoring.


- Liaison with BAs to ensure that requirements are correctly interpreted and implemented.

- Participation in regular planning and status meetings.


- Input to the development process through the involvement in Sprint reviews and retrospectives.


- Input into system architecture and design.

- Peer code reviews.

- Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.

- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, PySpark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTFUL API services).

- Sound knowledge on working Unix/Linux Platform

- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL, PySpark.

- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.

- Understanding of big data modelling techniques using relational and non-relational techniques

- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.

Good to have skills :

- Experience with time-series/analytics dB's such as ElasticSearch.

- Experience with scheduling tools such as Airflow, Control-M.

- Understanding or experience of Cloud design patterns

- Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.

- Experience with developing Hive QL, UDF's for analyzing semi structured/structured datasets.

(ref:hirist.tech)

  • Pune, Maharashtra, India Deloitte India Full time

    Job Description : - Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale,...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Overture Rede Private Limited. Full time

    Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Overture Rede Private Limited. Full time

    Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark DeveloperExp : 5 - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...


  • Pune, Maharashtra, India Synechron Full time

    Python PySpark DeveloperExp : - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...

  • Python Developer

    2 months ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Python DeveloperLocation: PuneExperience: 5-8 yearsJob Description:As a Python Developer, you will be responsible for leveraging your expertise in Python, Pyspark, SQL, and Data Structures to develop and maintain high-quality software solutions. Your primary focus will be on designing, implementing, and optimizing Python-based applications and data...

  • Python Developer

    4 weeks ago


    Pune, Maharashtra, India Advansoft Full time

    Position: Python DeveloperLocation: PuneExperience: 5-8 yearsJob Description:As a Python Developer, you will be responsible for leveraging your expertise in Python, Pyspark, SQL, and Data Structures to develop and maintain high-quality software solutions. Your primary focus will be on designing, implementing, and optimizing Python-based applications and data...


  • Pune, Maharashtra, India PURVIEW Full time

    Role: Python Pyspark- Application leadLocation: Pune Look for 6+years experience profilesLooking for only Immediate Joiners. Job Description: As an Application Lead, you will be responsible for designing, building, and configuring applications. Your typical day will involve working with PySpark, Python on Azure, and PostgreSQL to lead the effort and act as...


  • Pune, Maharashtra, India DataVerze Full time

    About DataVerze : DataVerze is a leading provider of cutting-edge services in GenerativeAI, Machine Learning, and Datamesh. With a strong commitment to innovation and expertise in advanced technologies, we empower businesses to unlock the true potential of their data.Our team of seasoned professionals brings decades of experience in the field, ensuring that...


  • Pune, Maharashtra, India 2coms Full time

    Looking ForAzure Data Engineer With Python Professionals For Global IT MNC GreetingsFrom 2COMSGroup Location Pune/Mumbai/Hyderabad/Bangalore/ChennaiYearsof Experience: 5 10YearsMustHave:Azure Data Engineer Python JobDescription: Any Project specificPrerequisite skillsPython ADBADFPyspark and SnowflakeExpectingPython ADBADF Pyspark andSnowflakeLooking For...


  • Pune, Maharashtra, India DataVerze.ai Full time

    About DataVerze : DataVerze is a leading provider of cutting-edge services in GenerativeAI, Machine Learning, and Datamesh. With a strong commitment to innovation and expertise in advanced technologies, we empower businesses to unlock the true potential of their data.Our team of seasoned professionals brings decades of experience in the field, ensuring that...

  • Python Developer

    2 weeks ago


    Pune, Maharashtra, India IT Full time

    Total Yrs. of Experience : 8+ Relevant Yrs of experience.Roles and Responsibilities :- 5+ years of hands-on Python development experience with excellent programming skills- 3+ years of experience with cloud-based platform, ideally Microsoft Azure- Working experience and skills on big data technologies such as PySpark, Databricks, Kafka- Strong solution...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India PURVIEW Full time

    Purview is hiring Data Engineer with one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Data EngineerLocation: Pune/HyderabadDuration: Permanent with PurviewWe are looking for 5+ years with Python/PySpark Job Description:Design and implement data processing pipelines using Python/Pyspark programming and big data...


  • Pune, Maharashtra, India Persistent Systems Full time

    About Position: we are looking for Senior Python/Data Engineer. Role: Senior Python/Data Engineer Location: Bangalore/ Pune Experience: 4 to 8 Years Job Type: Full Time Employment What You'll Do: Analysis and implementation of Batch ETL framework using Apache Air Flow, Python, PySpark and Bigquery. Acquire deep domain understanding to implement Data...

  • Data Engineer

    2 months ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India PURVIEW Full time

    Purview is hiring Data Engineer with one of our valued clients.If you're interested, please reply for more details.Job Details:Role: Data EngineerLocation: Pune/HyderabadDuration: Permanent with PurviewWe are looking for 5+ years with Python/Py SparkJob Description:Design and implement data processing pipelines using Python/Pyspark programming and big data...

  • Data Engineer

    2 months ago


    Pune, Maharashtra, India EDGESOFT Full time

    Job Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...