Sr. Data Engineer

2 months ago

pune, India MICHELIN Full time
Sr. Data Engineer

- - - - - - - - - - - -

A Data Engineer is a data professionals with extensive knowledge and expertise in “big data” technologies and frameworks that works with Python/Scala/Java. They are software engineers who design, build, integrate data from various resources, and manage big data. Experienced in writing spark code with python or Scala, Sql queries, Linux/Unix scripting, deploying and maintaining databases.

She/He is should be good problem solver and proficient at least in any one of language – Java/Scala/Python. She/He should be good in any relational database system along with hands on experience. Added advantage is having experience in NoSQL, Hive etc. She/He also contributes to the elaboration of the data policy and the structuring of its life cycle within the regulatory framework in force, in collaboration with the Chief Data Officer. Her/His intervention scope center's on application systems in the data management and processing domain, and on platforms such as Big Data, IoT, etc. She/He is responsible for overseeing and integrating data of a variety of types originating from these different sources and confirms the quality of the Data entering the Data Lake (she/he receives data, deletes duplicates, etc.).Captures the structured and unstructured data produced within different applications or outside the entityIntegrates the componentsStructures the data (semantics, etc.)Maps the available componentsCleans up the data (deleting duplicates, etc.)Validates the dataWhere appropriate, he creates the data repository.

SKILLS PREFERRED :-

Technical :-

Technical expertise related to data. Expert in writing Spark code with Python. Experience in using Python module like Pandas/NumPy/Sci-kit Expert in writing SQL queries. Specialist in data coming from a database management system. Technical expertise on building ETL data pipeline, extraction from different source like Azure storage, HDFS, Kafka topics, structured and unstructured files, Hive. A Data Engineer understands how to apply technologies to solve big data problems and to develop innovative big data solutions. In order to be able to do this, the Data Engineer should have extensive knowledge in different programming or scripting languages (Python) Good understanding in streaming (Kafka/Storm/Kinesis) Good understanding on Big data components (HDFS, YARN, Map Reduce, Spark, Oozie) Good understanding on Azure components (ADF, ADB, ADLS) Good understanding Version controlling (Git, GitHub, azure DevOps). Competency in Cloud environment is must (preferred, Azure) Should have experience in transforming raw/unstructured data to clean data (Data Quality)

Behavioural :-

Planning & Organizing Teamwork & Collaboration Customer Focus Continuous learning Ownership attitude Problem solving expertise

  • Sr Software Engineer

    7 days ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Sr Software Engineer

    7 days ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Sr Software Engineer

    6 days ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Sr. Data Engineer

    1 month ago

    Pune, India MICHELIN Full time

    Sr. Data Engineer- - - - - - - - - - - -A Data Engineer is a data professionals with extensive knowledge and expertise in “big data” technologies and frameworks that works with Python/Scala/Java. They are software engineers who design, build, integrate data from various resources, and manage big data. Experienced in writing spark code with python or...

  • Sr. Data Engineer

    2 months ago

    Pune, India MICHELIN Full time

    Sr. Data Engineer - - - - - - - - - - - - A Data Engineer is a data professionals with extensive knowledge and expertise in “big data” technologies and frameworks that works with Python/Scala/Java. They are software engineers who design, build, integrate data from various resources, and manage big data. Experienced in writing spark code with python or...

  • Sr QA Engineer

    5 days ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 275474 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Once You Are Here,...

  • Sr QA Engineer

    5 days ago

    pune, India NTT DATA Full time

    Job Description Req ID:  275474  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Once You...

  • Sr QA Engineer

    4 days ago

    pune, India NTT DATA Full time

    Job Description Req ID:  275474  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Once You...

  • Sr QA Engineer

    4 days ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 275474 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Once You Are Here,...

  • Data Engineer

    1 week ago

    Pune, India PURVIEW Full time

    Role: Data Engineer & Sr Data Engineer Location: Pune(1st preference) and Hyderabad Job Type: Permanent with Purview Services We are looking for Data Engineer(3-5 years) and Sr. Data Engineer(6-8 years). Job description: Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL Knowledge Mandatory to have knowledge on any ETL Tool...

  • Sr QA Engineer

    5 days ago

    pune, India NTT DATA Services Full time

    Req ID:  275474  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Once You Are Here, You Will:...

  • Sr QA Engineer

    5 days ago

    Pune, India NTT DATA Services Full time

    Req ID: 275474 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Once You Are Here, You Will:...

  • Sr QA Engineer

    2 days ago

    Pune, India NTT DATA Services Full time

    Req ID: 275474  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr QA Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Once You Are Here,...

  • Data Engineer-GCP

    4 weeks ago

    pune, India PURVIEW Full time

    Role: Data Engineer & Sr Data EngineerLocation: Pune(1st preference) and HyderabadJob Type: Permanent with Purview ServicesWe are looking for Data Engineer(3-5 years) and Sr. Data Engineer(6-8 years).Job description:Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL KnowledgeMandatory to have knowledge on any ETL Tool ONLY...

  • Data Engineer-GCP

    4 weeks ago

    Pune, India PURVIEW Full time

    Role: Data Engineer & Sr Data EngineerLocation: Pune(1st preference) and HyderabadJob Type: Permanent with Purview ServicesWe are looking for Data Engineer(3-5 years) and Sr. Data Engineer(6-8 years).Job description:MandatoryGoogle Cloud Big Query Scripting Skillsor Snowflake AWS or Cloud SQL KnowledgeMandatory to have knowledge on anyETL Tool ONLY amongst...

  • Data Engineer-GCP

    4 weeks ago

    pune, India PURVIEW Full time

    Role: Data Engineer & Sr Data Engineer Location: Pune(1st preference) and Hyderabad Job Type: Permanent with Purview Services We are looking for Data Engineer(3-5 years) and Sr. Data Engineer(6-8 years). Job description: Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL Knowledge Mandatory to have knowledge on any ETL Tool...

  • Data Engineer-GCP

    4 weeks ago

    Pune, India PURVIEW Full time

    Role: Data Engineer & Sr Data EngineerLocation: Pune(1st preference) and HyderabadJob Type: Permanent with Purview ServicesWe are looking for Data Engineer(3-5 years) and Sr. Data Engineer(6-8 years).Job description:Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL KnowledgeMandatory to have knowledge on any ETL Tool ONLY...

  • Data Engineer-GCP

    4 weeks ago

    Pune, India PURVIEW Full time

    Role: Data Engineer & Sr Data EngineerLocation: Pune(1st preference) and HyderabadJob Type: Permanent with Purview ServicesWe are looking for Data Engineer(3-5 years) and Sr. Data Engineer(6-8 years).Job description:Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL KnowledgeMandatory to have knowledge on any ETL Tool ONLY...

  • Senior Data Engineer

    4 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...