Sr. Data Engineer

3 months ago


bangalore, India Stellantis Full time
Sr. Data Engineer
Mobilisights: enabling a smarter world
Exponential growth in adoption and deployment of connected cars and devices is bringing previously unavailable datasets to market – at scale and in real-time.
Our vision is a ‘smarter’ world where innovative applications and services leverage connected vehicle datasets, and the insights they provide, to dramatically transform and continually improve everyday lives for consumers and businesses. Stellantis, one of the largest global car makers and the parent company of fourteen of the most iconic industry brands including Jeep, Fiat, Maserati, Peugeot, and more, has created Mobilisights, a Data-as-a-Service Business Unit, which will harness sensor and other data from millions of connected vehicles and other devices to support data products and services for a growing array of customers
#Stellantis is becoming a #mobility #tech company with the size of a powerhouse and the soul of a startup. Mobilisights represents this vision and future. We are part of Stellantis - a global company with 300 000 employees and will fully leverage the resources and the benefits that provides, but we are built like a startup and operate like one, too.
A truly global company, Mobilisights have teams all over the world and we work entirely remotely.
Our World
Great mobility solutions start with great people This is an exciting time to join us
The driving force behind us is the diverse and talented group of men and women around the world who bring their passion and experience to their work every day. And while we are a truly global organization, we remain deeply rooted in the communities in which we operate, and our people live and work.
Position Responsibilities:
Design and build a best-in-class robust scalable data platform that can ingest, store, manage and stream massive amounts of data while simplifying its analysis and processing to enable rapid development of high-quality data products and services.
Design, implement and test robust low latency streaming data pipelines using state of the art big data technologies for preparing/curating data that will support various data as a service product.
You will work with various cross functional teams to explore data and figure out all the data wrangling needed to clean, curate the data and build the end-to-end data pipeline per requirements.
You will design necessary privacy and security preventive and detective controls into the CICD of each data pipeline.
You will have a strong bias for operational excellence ensuring error handling, restart-ability ensuring data consistency, logging, monitoring and alerting is built into the pipeline.
You will drive continual improvements for reliability, performance, scalability, quality and own associated KPI.
You will provide on-call support for the platform and troubleshooting any issues that arise.
Basic Qualifications
5+ years of experience in development and operation in production of Cloud native data streaming data systems (with an emphasis on scalability, robustness, data delivery low latency and data privacy and quality control)
5+ years’ experience working in Cloud native real-time streaming data ecosystem such as Spark, Flink, Kinesis, Lambda, Kafka, EMR/EKS platform, Lakehouse platform (i.e Delta.io) Experience in using Databricks Intelligent Platform is a plus.
5+ years of experience in developing optimizing AWS data system architecture: Infrastructure as Code, integration and deployment automation, security.
5+ years of experience in ensuring operation reliability of cloud native data system in production – Particularly experience in deploying and monitoring AWS infrastructure using MSK, EKS clusters in Production.
5+ years’ experience with languages like Spark-Scala, Py-Spark and /or Python, Java.
Experience in relational database concepts with a solid knowledge of SQL, SQL Tuning, Big Data NoSQL technologies
Experience in implementing application processing large-scale Geo-spatial data is a plus
Experience with development and deployment of containerized application using Docker, Kubernetes, Helm
Experience in building systems that monitor data losses and data quality control.
Demonstrated knowledge of data structures and algorithms.
Experience in designing foundations of Operational excellence and implementing.
Curiosity and passion to learn with a strong bias to action.
Please share your profiles to with below details:
Total yrs. of exp:
CCTC:
ECTC:
NP:
Disclaimer - At Stellantis, we assess candidates based on qualifications, merit and business needs. We welcome applications from people of all gender identities, age, ethnicity, nationality,
religion, sexual orientation and disability. Diverse teams will allow us to
better meet the evolving needs of our customers and care for our future.
By submitting your application, you are accepting our privacy notice:

  • Sr. Data Engineer-GCP

    1 month ago


    bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools, including...

  • Sr. data engineer-gcp

    1 month ago


    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • Sr. Data Engineer-GCP

    1 month ago


    bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications:● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools● Experience working with Data warehousing tools, including DynamoDB,...

  • Sr. Data Engineer-GCP

    4 weeks ago


    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • Sr. Data Engineer-GCP

    1 month ago


    Bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...

  • Sr. Data Engineer

    3 weeks ago


    Bangalore, India Ness Digital Engineering Full time

    Description Sr. Data EngineerJob Overview:We are seeking an experienced Technical Data Engineer / ELT Developer with expertise in data integration and pipeline development using Snowflake. The ideal candidate will manage data ingestion and transformation, working with an offshore team to deliver efficient and scalable data solutions that align with business...

  • Sr. data engineer

    2 months ago


    Bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, py Spark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...

  • Sr. Data Engineer

    2 months ago


    Bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...

  • Sr. Data Engineer

    2 months ago


    bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full timeSkills Required: T-SQL, SSIS, SSRSPreferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark.Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both Structured...


  • bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark. Job Description: - 6+Years Handson experience in Design, Develop, Deploy and Monitor - Data Extraction Pipelines in Python to process both...


  • bangalore, India Aezion, Inc Full time

    Sr. Data Engineer – SQL/Lead Job Location: Bangalore, Mysore, Coimbatore Full time Skills Required: T-SQL, SSIS, SSRS Preferred: Python, Azure Data Factory, Azure SQL, Azure Data Lake Storage, Databricks, pySpark. Job Description: 6+Years Handson experience in Design, Develop, Deploy and Monitor Data Extraction Pipelines in Python to process both...


  • bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCP Exp: 4+ Location: Bangalore (Hybrid) Notice: Immediate Joiner Qualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools,...


  • bangalore, India Avikal Solutions Full time

    Sr. Data Engineer-GCPExp: 4+Location: Bangalore (Hybrid)Notice: Immediate JoinerQualifications: ● 4+ years of experience developing scalable Pyspark applications or solutions on distributed platforms ● Experience in Google Cloud Platform (GCP) and good to have other cloud platform tools ● Experience working with Data warehousing tools, including...


  • bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...


  • bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...


  • Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...


  • Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...


  • bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Sr. Data Engineer

    3 months ago


    bangalore, India Stellantis Full time

    Sr. Data Engineer Mobilisights: enabling a smarter world Exponential growth in adoption and deployment of connected cars and devices is bringing previously unavailable datasets to market – at scale and in real-time. Our vision is a ‘smarter’ world where innovative applications and services leverage connected vehicle datasets, and the insights...


  • Bengaluru / Bangalore, India Charakala Amala (Proprietor of Expert HR Solutions) Full time

    SR. Azure Data EngineerLocation: Bharteeya City, BangaloreMode: HybridExperience: 8-9+ YearsSummaryA purposeful Azure Data Engineer with over 5-7 years of experience in designing, developing, implementing, and optimizing data solutions on Microsoft Azure. Proven expertise in leveraging Azure services for ETL processes, data warehousing and analytics,...