![Deloitte India](https://media.trabajo.org/img/noimg.jpg)
Deloitte - Data Engineer - PySpark/Python
4 weeks ago
Job Description :
- Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting.
- Implement the tools and processes, handling performance, scale, availability, accuracy, and monitoring.
- Liaison with BAs to ensure that requirements are correctly interpreted and implemented.
- Participation in regular planning and status meetings.
- Input to the development process through the involvement in Sprint reviews and retrospectives.
- Input into system architecture and design.
- Peer code reviews.
- Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.
- Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, PySpark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTFUL API services).
- Sound knowledge on working Unix/Linux Platform
- Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL, PySpark.
- Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
- Understanding of big data modelling techniques using relational and non-relational techniques
- Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.
Good to have skills :
- Experience with time-series/analytics dB's such as ElasticSearch.
- Experience with scheduling tools such as Airflow, Control-M.
- Understanding or experience of Cloud design patterns
- Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
- Experience with developing Hive QL, UDF's for analyzing semi structured/structured datasets.
-
Deloitte - Data Engineer - PySpark/Python
2 weeks ago
Pune, Maharashtra, India Deloitte India Full timeJob Description : - Software design, Scala & Spark, PySpark & Python development, automated testing of new and existing components in an Agile, DevOps and dynamic environment Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale,...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India Overture Rede Private Limited. Full timeDescription:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India Overture Rede Private Limited. Full timeDescription:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the...
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark Developer Exp : 5 - 8 yrs Loc: Pune Notice: 0 -15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization...
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark DeveloperExp : 5 - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...
-
Python PySpark Developer
2 weeks ago
Pune, Maharashtra, India Synechron Full timePython PySpark DeveloperExp : - 8 yrsLoc: PuneNotice: 0 -15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span...
-
Python Developer
2 months ago
Pune, Maharashtra, India ADVANSOFT Full timePosition: Python DeveloperLocation: PuneExperience: 5-8 yearsJob Description:As a Python Developer, you will be responsible for leveraging your expertise in Python, Pyspark, SQL, and Data Structures to develop and maintain high-quality software solutions. Your primary focus will be on designing, implementing, and optimizing Python-based applications and data...
-
Python Developer
4 weeks ago
Pune, Maharashtra, India Advansoft Full timePosition: Python DeveloperLocation: PuneExperience: 5-8 yearsJob Description:As a Python Developer, you will be responsible for leveraging your expertise in Python, Pyspark, SQL, and Data Structures to develop and maintain high-quality software solutions. Your primary focus will be on designing, implementing, and optimizing Python-based applications and data...
-
Python Pyspark- Application lead
2 weeks ago
Pune, Maharashtra, India PURVIEW Full timeRole: Python Pyspark- Application leadLocation: Pune Look for 6+years experience profilesLooking for only Immediate Joiners. Job Description: As an Application Lead, you will be responsible for designing, building, and configuring applications. Your typical day will involve working with PySpark, Python on Azure, and PostgreSQL to lead the effort and act as...
-
ai - Data Engineer - Python/PySpark
2 weeks ago
Pune, Maharashtra, India DataVerze Full timeAbout DataVerze : DataVerze is a leading provider of cutting-edge services in GenerativeAI, Machine Learning, and Datamesh. With a strong commitment to innovation and expertise in advanced technologies, we empower businesses to unlock the true potential of their data.Our team of seasoned professionals brings decades of experience in the field, ensuring that...
-
Python with Azure Data Bricks Snowflakes
2 weeks ago
Pune, Maharashtra, India 2coms Full timeLooking ForAzure Data Engineer With Python Professionals For Global IT MNC GreetingsFrom 2COMSGroup Location Pune/Mumbai/Hyderabad/Bangalore/ChennaiYearsof Experience: 5 10YearsMustHave:Azure Data Engineer Python JobDescription: Any Project specificPrerequisite skillsPython ADBADFPyspark and SnowflakeExpectingPython ADBADF Pyspark andSnowflakeLooking For...
-
DataVerze.ai - Data Engineer - Python/PySpark
3 weeks ago
Pune, Maharashtra, India DataVerze.ai Full timeAbout DataVerze : DataVerze is a leading provider of cutting-edge services in GenerativeAI, Machine Learning, and Datamesh. With a strong commitment to innovation and expertise in advanced technologies, we empower businesses to unlock the true potential of their data.Our team of seasoned professionals brings decades of experience in the field, ensuring that...
-
Python Developer
2 weeks ago
Pune, Maharashtra, India IT Full timeTotal Yrs. of Experience : 8+ Relevant Yrs of experience.Roles and Responsibilities :- 5+ years of hands-on Python development experience with excellent programming skills- 3+ years of experience with cloud-based platform, ideally Microsoft Azure- Working experience and skills on big data technologies such as PySpark, Databricks, Kafka- Strong solution...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India PURVIEW Full timePurview is hiring Data Engineer with one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Data EngineerLocation: Pune/HyderabadDuration: Permanent with PurviewWe are looking for 5+ years with Python/PySpark Job Description:Design and implement data processing pipelines using Python/Pyspark programming and big data...
-
Senior Python/Data Engineer
2 weeks ago
Pune, Maharashtra, India Persistent Systems Full timeAbout Position: we are looking for Senior Python/Data Engineer. Role: Senior Python/Data Engineer Location: Bangalore/ Pune Experience: 4 to 8 Years Job Type: Full Time Employment What You'll Do: Analysis and implementation of Batch ETL framework using Apache Air Flow, Python, PySpark and Bigquery. Acquire deep domain understanding to implement Data...
-
Data Engineer
2 months ago
Pune, Maharashtra, India ADVANSOFT Full timePosition: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India ADVANSOFT Full timePosition: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India PURVIEW Full timePurview is hiring Data Engineer with one of our valued clients.If you're interested, please reply for more details.Job Details:Role: Data EngineerLocation: Pune/HyderabadDuration: Permanent with PurviewWe are looking for 5+ years with Python/Py SparkJob Description:Design and implement data processing pipelines using Python/Pyspark programming and big data...
-
Data Engineer
2 months ago
Pune, Maharashtra, India EDGESOFT Full timeJob Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...