Pyspark

1 week ago


Bengaluru Karnataka, India Hero Moto Corp Full time

»

**Date**:12 Nov 2024

**Location**: Bengaluru, KA, IN, 560038

**Company**:Hero Motocorp

**Function**
- Digital & Information Technologies**Pay Band**
- E4 to M2**Role**
- PySpark, Glue or Databricks developer proficient in cloud technologies who can become a member of HMCL Digital Connected core tech team. The role demands amazing ETL coding skills with great analytical and problem solving thinking. As a core member of the tech team you would be involved in multiple product and platform developments which would strengthen the business presence of HMCL in connected space.
This platform will empower and enable HMCL’s RnD and Data scientists to build ML models which either can help in building a revenue stream or a feature offering. We are on a mission of building a platform that can handle high throughput with rpm greater than 3 lakh (yes you read it right) where data streaming happens near real time by leveraging modern age technologies and tools.**A purpose driven role for you**
- You will help in the technical designs of the multiple products for connected systems, which includes designing architecture blueprints, High level diagrams and Low level diagrams.
- You will work with an embedded team in managing embedded systems development specifically on connectivity and data management at device and cloud side.
- You will work closely with Product teams of Vehicle IoT and Charging and ensure the products are built with scale for domestic and international business

**A Day in the life**
- A PySpark, Glue or Databricks developer proficient in cloud technologies who can become a member of HMCL Digital Connected core tech team. The role demands amazing ETL coding skills with great analytical and problem solving thinking. As a core member of the tech team you would be involved in multiple product and platform developments which would strengthen the business presence of HMCL in connected space.
This platform will empower and enable HMCL’s RnD and Data scientists to build ML models which either can help in building a revenue stream or a feature offering. We are on a mission of building a platform that can handle high throughput with rpm greater than 3 lakh**Academic Qualification & Experience**
- Academic Qualification
- B. Tech/M.Tech

Relevant Experience
5-10 years of relevant experience in a software engineering role and at least 3 years of experience in building scalable connected platforms.**Technical Skills/Knowledge**
- Technical Skills
- 5-10 years of hands-on ETL experience in Python, Spark, Databricks or PySpark or any other ETL tools and technologies.
- Good to have knowledge of Java and Scala and strong in PySpark.
- Good to have conceptual knowledge of batch and real-time data processing.
- Good to have Problem solving analytical skills and play an individual contributor role.
- Must have handled data processes At Scale and possess knowledge of Big Data framework.
- Must have done one large "data platform" implementation on-premises/ on-cloud - Any HyperScalers.
- Knowledge of CICD pipelines and concepts
- Knowledge of IoT and automotive domain.
- Good to have knowledge of SQL/NoSQL databases.
- Knowledge of Open-Source tools and technologies.
- Most importantly, must have design skills for setting up a large data platform.
- End to end understanding of SDLC - analyze, design, develop, test scalable reliable solutions.
- Good to have knowledge of streaming, stateful and stateless data processing.

**Behavioural Skills**
- People Management, Conflict Management, drive for results and Passion at work**What will it be like to work for Hero**
- As the **world’s largest** manufacturer of motorcycles and scooters for the last** 22 years**, Hero is where you will get to work with the brightest innovators, passionate about being the best in what they do. You will become a part of India’s proudest legacy, a brand that is celebrated by** 110 million Indians **and is now taking over the world with its manufacturing superpower. If you are someone who dreams big and goes after their dreams with absolute conviction, Hero is your place to be. At Hero, we are building a cutting-edge future of mobility, pushing frontiers of innovation and aiming for the very best. **Choose to be with the best, choose to be your best.**

**About Hero**
- Headquartered in New Delhi (India), Hero MotoCorp is the **world's largest** manufacturer of motorcycles and scooters for 22 consecutive years. We are at the forefront of developing modern, technologically superior and eco-friendly mobility solutions for its millions of customers around the world.- Hero MotoCorp has rapidly transformed into a true multinational organization with a presence in **47 countries** across Asia, Africa, Latin America and the Middle East.- We have achieved the coveted milestone of **110 million cumulative production** and sales since inception. Aligned with its Vision** “Be the Future of Mobility”**, Hero MotoCorp plans to achieve it


  • Pyspark

    20 hours ago


    Bengaluru, Karnataka, India Cognizant Full time

    **Job Summary** **Responsibilities** - Lead the design and implementation of data processing pipelines using Databricks PySpark and Python - Oversee the development and maintenance of scalable data solutions to support business needs - Provide technical guidance and mentorship to team members to ensure high-quality deliverables - Collaborate with...

  • Python & Pyspark

    1 week ago


    Karnataka, India Teradata Full time

    Teradata’s Global Delivery Center (GDC) brings together data enthusiasts from all corners of the world to support our customers across the globe. We analyze their business needs and address them with the most sophisticated data solutions including Data Warehouses, Data Lakes, Operational Data Stores and much more. We deliver and manage complex hybrid...

  • Pyspark Developer

    2 weeks ago


    Bengaluru, Karnataka, India Synechron Technologies Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Day-to-Day Activities:Design, develop, and maintain ETL pipelines using PySpark on CDP.Implement and manage data ingestion processes from various sources. Process, cleanse, and transform large datasets using PySpark. Conduct performance tuning and optimization of ETL processes. Implement data quality checks and validation routines. Automate data workflows...

  • Pyspark Lead

    14 hours ago


    Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled PySpark Lead with 5 to 8 years of experience, based in Bangalore. The ideal candidate will have expertise in PySpark, SQL, ETL/Data Engineering Pipeline, Cloud understanding, CI/CD, Data Modelling, Airflow, Kafka, EMR/Databricks, Snowflake, and Hive.Roles and ResponsibilityDesign and develop scalable data pipelines using PySpark...


  • Bengaluru, India DEzen Technology Solutions Pvt Ltd. Full time

    **Recruitment Company Name**: - DEzen Technology Solutions Pvt Ltd. **Requirements**: - 4 -7 Years - ETL (Talend/PySpark) **Skills**: - ETL (Talend/PySpark) - ETL Developer Talend / Pyspark Upload Resume **Job Details**: - **Role**: ETL (Talend/PySpark) - **Job Type**: Full Time - **Location**: Bangalore - **Offered Salary**: open - **Posted**:...

  • Pyspark Developer

    5 days ago


    Bengaluru, India Sigma Allied Services Full time

    Position - Pyspark Developer Location - Bangalore Experience - 6 to 9 yrs Required Skills -Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySparkMinimum 5 year(s) of experience is requiredEducational Qualification : 15 years full time educationSummary:As an...

  • Pyspark Architect

    2 days ago


    Bengaluru, Karnataka, India Talent Worx Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Pyspark Developer

    5 days ago


    Bengaluru, India Nuvento Systems Full time

    We are looking for immediate joiner | Work from Home Key skills: Pyspark, Apache Spark, AWS, Databricks, Scala, Java

  • Python Pyspark

    2 weeks ago


    Bengaluru, Karnataka, India Virtusa Full time

    7 Years overall IT experience with minimum 4 years of work experience in below tech skills Tech Skills Proficient in Python scripting and PySpark for data processing task Strong SQL capabilities with hands on experience managing big data using ETL tools like Informatica Experience with the AWS cloud platform and its data services including S3 Redshift Lambda...

  • PySpark Developer

    7 days ago


    Hyderabad, Bengaluru, Chennai, India Coders Brain Technology Private Limited Full time

    Job Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...