Pyspark

3 weeks ago

Bengaluru Karnataka, India Hero Moto Corp Full time

»

**Date**:12 Nov 2024

**Location**: Bengaluru, KA, IN, 560038

**Company**:Hero Motocorp

**Function**
- Digital & Information Technologies**Pay Band**
- E4 to M2**Role**
- PySpark, Glue or Databricks developer proficient in cloud technologies who can become a member of HMCL Digital Connected core tech team. The role demands amazing ETL coding skills with great analytical and problem solving thinking. As a core member of the tech team you would be involved in multiple product and platform developments which would strengthen the business presence of HMCL in connected space.
This platform will empower and enable HMCL’s RnD and Data scientists to build ML models which either can help in building a revenue stream or a feature offering. We are on a mission of building a platform that can handle high throughput with rpm greater than 3 lakh (yes you read it right) where data streaming happens near real time by leveraging modern age technologies and tools.**A purpose driven role for you**
- You will help in the technical designs of the multiple products for connected systems, which includes designing architecture blueprints, High level diagrams and Low level diagrams.
- You will work with an embedded team in managing embedded systems development specifically on connectivity and data management at device and cloud side.
- You will work closely with Product teams of Vehicle IoT and Charging and ensure the products are built with scale for domestic and international business

**A Day in the life**
- A PySpark, Glue or Databricks developer proficient in cloud technologies who can become a member of HMCL Digital Connected core tech team. The role demands amazing ETL coding skills with great analytical and problem solving thinking. As a core member of the tech team you would be involved in multiple product and platform developments which would strengthen the business presence of HMCL in connected space.
This platform will empower and enable HMCL’s RnD and Data scientists to build ML models which either can help in building a revenue stream or a feature offering. We are on a mission of building a platform that can handle high throughput with rpm greater than 3 lakh**Academic Qualification & Experience**
- Academic Qualification
- B. Tech/M.Tech

Relevant Experience
5-10 years of relevant experience in a software engineering role and at least 3 years of experience in building scalable connected platforms.**Technical Skills/Knowledge**
- Technical Skills
- 5-10 years of hands-on ETL experience in Python, Spark, Databricks or PySpark or any other ETL tools and technologies.
- Good to have knowledge of Java and Scala and strong in PySpark.
- Good to have conceptual knowledge of batch and real-time data processing.
- Good to have Problem solving analytical skills and play an individual contributor role.
- Must have handled data processes At Scale and possess knowledge of Big Data framework.
- Must have done one large "data platform" implementation on-premises/ on-cloud - Any HyperScalers.
- Knowledge of CICD pipelines and concepts
- Knowledge of IoT and automotive domain.
- Good to have knowledge of SQL/NoSQL databases.
- Knowledge of Open-Source tools and technologies.
- Most importantly, must have design skills for setting up a large data platform.
- End to end understanding of SDLC - analyze, design, develop, test scalable reliable solutions.
- Good to have knowledge of streaming, stateful and stateless data processing.

**Behavioural Skills**
- People Management, Conflict Management, drive for results and Passion at work**What will it be like to work for Hero**
- As the **world’s largest** manufacturer of motorcycles and scooters for the last** 22 years**, Hero is where you will get to work with the brightest innovators, passionate about being the best in what they do. You will become a part of India’s proudest legacy, a brand that is celebrated by** 110 million Indians **and is now taking over the world with its manufacturing superpower. If you are someone who dreams big and goes after their dreams with absolute conviction, Hero is your place to be. At Hero, we are building a cutting-edge future of mobility, pushing frontiers of innovation and aiming for the very best. **Choose to be with the best, choose to be your best.**

**About Hero**
- Headquartered in New Delhi (India), Hero MotoCorp is the **world's largest** manufacturer of motorcycles and scooters for 22 consecutive years. We are at the forefront of developing modern, technologically superior and eco-friendly mobility solutions for its millions of customers around the world.- Hero MotoCorp has rapidly transformed into a true multinational organization with a presence in **47 countries** across Asia, Africa, Latin America and the Middle East.- We have achieved the coveted milestone of **110 million cumulative production** and sales since inception. Aligned with its Vision** “Be the Future of Mobility”**, Hero MotoCorp plans to achieve it

  • pyspark

    2 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services!!We are currently Hiring For PYSPARK,Exp 5+Job descriptionGood Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) AZURE,JOB LOCATIONBangalore/Mumbai /Pune/KolkataNP 30-70 daysInterested...

  • Pyspark Hadoop

    3 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    **Responsibility of / Expectations from the Role** Development of end to end ETL Pipelines using Pyspark on Hadoop Gathering data requirements from Product Owner Data aggregation and complex logic building Leading a 3 person team from offshore of Business Intelligence Area Good understanding of Hadoop data warehousing concepts Qualifications :BACHELOR...

  • Pyspark, Python, SQL

    6 months ago

    Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...

  • pyspark

    2 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services!!We are currently Hiring For PYSPARK , Exp 5+ Job descriptionGood Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) AZURE,JOB LOCATION Bangalore/Mumbai /Pune/KolkataNP 30-70 days Interested...

  • pyspark

    2 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services!!We are currently Hiring For PYSPARK , Exp 5+ Job descriptionGood Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) AZURE,JOB LOCATION Bangalore/Mumbai /Pune/KolkataNP 30-70 days Interested...

  • pyspark

    2 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TATA Consultancy Services!! We are currently Hiring For PYSPARK , Exp 5+ Job description Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional) AZURE, JOB LOCATION Bangalore/Mumbai /Pune/Kolkata NP 30-70...

  • Pyspark Developer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark.3-6 years of experience in the design and implementation of Big Data pipelines usingPySpark,database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Pyspark Developer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent...

  • PySpark Developer

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Role- PySpark DeveloperExperience - 5 TO 10 YRSLocation - Bangalore / HyderabadMust Have - Pyspark Desired Competencies (Technical/Behavioral Competency)Must-Have · Hands-on experience in Pyspark including Dataframe core functions sparkSQL and SparkStreaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & MongoDB · Hands on experience...

  • PySpark Developer

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Role- PySpark DeveloperExperience - 5 TO 10 YRSLocation - Bangalore / HyderabadMust Have - Pyspark Desired Competencies (Technical/Behavioral Competency)Must-Have · Hands-on experience in Pyspark including Dataframe core functions sparkSQL and SparkStreaming. · Minimum 3 years of experience HIVE, Hadoop, Kafka, YARN, HBase & MongoDB · Hands on experience...

  • Senior PySpark Developer

    3 weeks ago

    Bengaluru, India Mantra Labs Pvt Ltd Full time

    Job Title :Pyspark Senior DeveloperJob Description :5+ years of experience in Pyspark including Hadoop, SQL and other big data technologies. Databricks knowledge is fine.We are seeking a skilled PySpark Developer to join our dynamic team. The ideal candidate will have a strong background in big data processing and analytics using PySpark. Additionally,...

  • Pyspark Engineer

    2 months ago

    Bengaluru, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

  • Pyspark Engineer

    2 months ago

    Bengaluru, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

  • Pyspark Engineer

    2 months ago

    Bengaluru, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field. Experience in data engineering or data analyst. Should have experience in ETL pipeline development. Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming. Good experience in SQL/ Advanced SQL....

  • Pyspark Developer

    1 month ago

    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developer JOB LOCATION : Bangalore / Chennai / Pune / Delhi EXPERIENCE REQUIREMENT : 4 to 12 Years Mandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. Must have...

  • Pyspark Developer

    2 months ago

    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Pyspark Developer

    1 month ago

    Bengaluru, India Tata Consultancy Services Full time

    POSITION :Pyspark developerJOB LOCATION : Bangalore / Chennai / Pune / DelhiEXPERIENCE REQUIREMENT : 4 to 12 YearsMandatory: Primary skill: Pyspark. 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.Must have excellent...

  • Senior PySpark Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Minutes to Seconds Pty Ltd Full time

    About the JobAt Minutes to Seconds, we're on a mission to match talented individuals with the perfect job opportunities. Our goal is to provide a seamless fit between skills and roles, driving success for both our candidates and clients.We're currently seeking a skilled Senior PySpark Developer to join our dynamic team. As a key member of our team, you'll be...

  • Senior Pyspark Developer

    3 weeks ago

    Bengaluru, India Minutes to Seconds Pty Ltd Full time

    About the job At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with...

  • Python,pyspark with Aws

    6 months ago

    Bengaluru, India Natobotics Technologies Private Limited Full time

    **INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...