Sr GCP Data Engineer, SMAI

5 months ago

Hyderabad, India Micron Full time

Our vision is to transform how the world uses information to enrich life for all.

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

JR47217 Sr GCP Data Engineer, SMAI

As a Sr. Data Engineer at Micron Technology Inc., you will be a key member of a multi-functional team responsible for developing and growing Micron’s methods and systems for extracting new insight for our rapidly growing data streams. You will be collaborating with data scientists, engineers, technicians and analytics teams to design and implement systems to extract data from Micron’s business systems, redefining it into an actionable format, and as needed, crafting multifaceted presentation layers for use by high-level engineers and managers throughout the company. You will be crafting new solutions, as well as, supporting, configuring, and improving existing solutions. 

 
Responsibilities and Tasks

Understand the Business Problem and the Relevant Data

Maintain an intimate understanding of company and department strategy. Translate analysis requirements into data requirements. Identify and understand the data sources that are relevant to the business problem. Develop conceptual models that assemble the relationships within the data. Define the data-quality objectives for the solution. Be a domain guide in data sources and reporting options.

Architect Data Management Systems

Use understanding of the business problem and the nature of the data to select appropriate data management system (Big Data, OLTP, OLAP, etc.) Design and implement optimum data structures in the appropriate data management system in GCP Cloud to satisfy the data requirements. Plan methods for archiving/deletion of information.

Develop, Automate, and Orchestrate an Ecosystem of ETL Processes for Varying Volumes of Data

Identify and select the optimum methods of access for each data source (real-time/streaming, delayed, static) Resolve transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical data model. Develop processes to efficiently load the transform data into the data management system.

Prepare Data to Meet Analysis Requirements

Work with the data scientist to implement strategies for cleaning and preparing data for analysis (, outliers, missing data, etc.). Develop and code data extracts. Follow standard methodologies to ensure data quality and data integrity. Ensure that the data is fit to use for data science applications.

Qualifications and Experience:

5-8 years of proven track record developing, delivering, and/or supporting data engineering, sophisticated analytics or business intelligence solutions. Ability to work with multiple operating systems (, Windows, Unix, Linux, etc.) Strong Experience in developing ETL/ELT processes using Python, Py-Spark, SQL . Significant experience with big data processing and/or developing applications and data sources via GCP Services like GCS, BigQuery, DataProc, Pub/Sub, Cloud Functions, Big Table, Cloud Composer/Cloud Workflows etc. Good to have knowledge on Cloud Data Warehousing systems like Snowflake. Understanding of how distributed systems work. Familiarity with software architecture (data structures, data schemas, etc.) Strong working knowledge of databases (Oracle, MSSQL, etc.) including SQL and NoSQL. Strong mathematics background, analytical, problem solving, and social skills. Strong interpersonal skills (written, verbal and presentation). Experience working in a global, multi-functional environment. Minimum 4 years of proven experience in any of the following: At least one high-level client, object-oriented language ( JAVA, Python, Scala, etc.); Good to have - one or more Data Extraction Tools (NIFI etc.) Software development. Ability to travel as needed.

  • Sr Data Engineer, SMAI

    5 months ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47215 Sr Data Engineer, SMAI As a Sr. Big Data...

  • Senior Cloud Data Engineer, SMAI

    2 days ago

    Hyderabad, Telangana, India Micron Full time

    Transforming Data into IntelligenceMicron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR47217 Senior Cloud Data Engineer, SMAIAbout the RoleAs a Senior Cloud Data Engineer at Micron Technology...

  • Staff Data Science Engineer, SMAI

    5 months ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR52043 Staff Data Science Engineer, SMAI ...

  • SR.DATA ENGINEER, SMAI(GCP, Spark, ETL, Snowflake)

    5 months ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR46939 ENGINEER, SMAI(GCP, Spark, ETL, Snowflake) ...

  • Staff Solution Architect, SMAI

    2 weeks ago

    Hyderabad, Telangana, India Micron Full time

    Transforming Information into IntelligenceMicron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.As a Staff Solution Architect, SMAI, you will partner with Data Scientists and Data Engineers to...

  • Staff Solution Architect, SMAI

    5 months ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47096 Staff Solution Architect, SMAI Solution...

  • Staff Solution Architect, Smai

    2 months ago

    Hyderabad, Telangana, India Micron Full time

    **Our vision is to transform how the world uses information to enrich life for **_all_**.** Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR46936 STAFF SOLUTION ARCHITECT,...

  • Staff Solution Architect, Smai

    5 months ago

    Hyderabad, Telangana, India Micron Full time

    **Our vision is to transform how the world uses information to enrich life for **_all_**.** Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47096 Staff Solution Architect,...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    GCP Data Engineer Job DescriptionWe are seeking a highly skilled GCP Data Engineer to join our team at Virtusa. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Google Cloud Platform (GCP).Key Responsibilities:Design and implement data pipelines using...

  • GCP Data Engineer

    2 months ago

    hyderabad, India CriticalRiver Inc. Full time

    Role: - GCP Data Engineer Experience: 9+ Years Work Location: - Hyderabad Skills: - GCP, BigQuery, Airflow, Python scripting and DBT Roles and Responsibilities Data Engineer with experience in GCP, BigQuery, Airflow, Python scripting and DBT. Good experience in developing Pipeline and maintaining it. Provide operational and enhancement support to...

  • Gcp data engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience: 5 to 12 Years Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of Big Data and Hadoop Ecosystems. Strong experience required in GCP. Must have done multiple large projects with GCP Big Query...

  • GCP Data Engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data Engineer Job Location – Chennai, Hyderabad, Bangalore, Pune, Gurgaon Experience: 5 to 12 Years Requirement: Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems. Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and...

  • Data Engineer- GCP

    3 days ago

    Hyderabad, India NucleusTeq Full time

    Experience- 6 Year + Location- Indore/Bangalore/Hyderabad/Raipur Role Description This is a full-time hybrid role for a Data Engineer GCP at NucleusTeq . The Data Engineer will be responsible for tasks such as GCP cloud Migration ,data engineering, data modeling, ETL processes, data warehousing to...

  • GCP Data Engineer

    5 days ago

    hyderabad, India Tekgence Inc Full time

    1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference.Role: GCP Data EngineerExperience: 5 - 11 YearsNotice Period: Immediate - 30 days maxBudget: 20 - 32 LPA maxLocation: Pune/Chennai/HyderabadMandate Skills:GCP BigQuery, SQL Scripting & Python coding experience.GCP...

  • GCP Data Engineer

    4 days ago

    hyderabad, India Tekgence Inc Full time

    1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference. Role: GCP Data Engineer Experience: 5 - 11 Years Notice Period: Immediate - 30 days max Budget: 20 - 32 LPA max Location: Pune/Chennai/Hyderabad Mandate Skills: GCP BigQuery, SQL Scripting & Python coding experience. GCP...

  • GCP Data Engineer

    3 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience: 5 to 12 YearsRequirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETLExperience...

  • GCP Data Engineer

    1 month ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title : GCP Data EngineerJob Location – Chennai, Hyderabad, Bangalore, Pune, GurgaonExperience: 5 to 12 YearsRequirement:Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETLExperience...

  • Sr Engineer Data Engineering

    5 months ago

    Hyderabad, India TransUnion LLC Full time

    What We'll Bring: We are looking for Data Engineer to bring big data, marketing analytics, and database technology together to deliver best-in-class insights. You must be a hands-on data guru who’s passionate about data, database product development, and play well with others. If you have a curiosity for different industries and companies, a passion for...

  • GCP Data Engineer

    2 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role :GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP BigQuery, Python Secondary: CloudRun, Cloud Functions, GC Storage Interested candidates can share cvs to the mail:haneesha.b@tekgence.com

  • Gcp data engineer

    2 weeks ago

    Hyderabad, India Tekgence Inc Full time

    Hello Connections.. Greetings from Tekgence Inc, We have immediate openings for one of our reputed Clients, Job Description: Role : GCP Data Engineer Location : Hyderabad/Pune Primary : Linux Shell Script, SQL, GCP Big Query, Python Secondary: Cloud Run, Cloud Functions, GC Storage Interested candidates can share cvs to the...