SR.DATA ENGINEER, SMAI(GCP, Spark, ETL, Snowflake)

1 month ago


Hyderabad, India Micron Full time
Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR46939 ENGINEER, SMAI(GCP, Spark, ETL, Snowflake)Responsibilities and Tasks

Understand the Business Problem and the Relevant DataMaintain an intimate understanding of company and department strategyTranslate analysis requirements into data requirementsIdentify and understand the data sources that are relevant to the business problemDevelop conceptual models that capture the relationships within the dataDefine the data-quality objectives for the solutionBe a subject matter expert in data sources and reporting options

Architect Data Management Systems

Use understanding of the business problem and the nature of the data to select appropriate data management system (Big Data, OLTP, OLAP, etc.)Design and implement optimum data structures in the appropriate data management system (Hadoop, Teradata, SQL Server, etc.) to satisfy the data requirementsPlan methods for archiving/deletion of informationDevelop, Automate, and Orchestrate an Ecosystem of ETL Processes for Varying Volumes of DataIdentify and select the optimum methods of access for each data source (real-time/streaming, delayed, static)Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical data modelDevelop processes to efficiently load the transform data into the data management system

Prepare Data to Meet Analysis Requirements

Work with the data scientist to implement strategies for cleaning and preparing data for analysis (, outliers, missing data, etc.)Develop and code data extractsFollow standard methodologies to ensure data quality and data integrityEnsure that the data is fit to use for data science applications

Qualifications and Experience:

4-7 years of experience developing, delivering, and/or supporting data engineering, advanced analytics or business intelligence solutionsAbility to work with multiple operating systems (, MS Office, Unix, Linux, etc.)Experienced in developing ETL/ELT processes using Apache Ni-Fi and SnowflakeSignificant experience with big data processing and/or developing applications and data sources via Hadoop, Yarn, Hive, Pig, Sqoop, MapReduce, HBASE, Flume, etc.Understanding of how distributed systems workFamiliarity with software architecture (data structures, data schemas, etc.)Strong working knowledge of databases (Oracle, MSSQL, etc.) including SQL and NoSQL.Strong mathematics background, analytical, problem solving, and organizational skillsStrong communication skills (written, verbal and presentation)Experience working in a global, multi-functional environmentMinimum of 2 years’ experience in any of the following: At least one high-level client, object-oriented language (, C#, C++, JAVA, Python, Perl, etc.); at least one or more web programming language (PHP, MySQL, Python, Perl, JavaScript, ASP, etc.); one or more Data Extraction Tools (SSIS, Informatica etc.)Software developmentAbility to travel as needed

Education:

degree in Computer Science, Software Engineering, Electrical Engineering, Applied Mathematics or related field of study.degree preferred.

  • hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR46939 ENGINEER, SMAI(GCP, Spark, ETL, Snowflake)...


  • Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR46939 ENGINEER, SMAI(GCP, Spark, ETL, Snowflake) ...


  • hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47217 Sr GCP Data Engineer, SMAI As a Sr. Data...


  • Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47217 Sr GCP Data Engineer, SMAI As a Sr. Data...


  • Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR47217 Sr GCP Data Engineer, SMAIAs a Sr. Data Engineer at...


  • Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR47215 Sr Data Engineer, SMAIAs a Sr. Big Data Engineer at...


  • hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR52043 Staff Data Science Engineer, SMAI ...


  • Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR52043 Staff Data Science Engineer, SMAI ...

  • Sr Data Engineer, SMAI

    2 months ago


    hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47215 Sr Data Engineer, SMAI As a Sr. Big Data...

  • Sr Data Engineer, SMAI

    2 months ago


    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47215 Sr Data Engineer, SMAI As a Sr. Big Data...

  • GCP Data Engineer

    2 months ago


    Hyderabad, India Huquo Full time

    Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...

  • Data Engineer

    2 weeks ago


    Hyderabad, India Arjava Consultants LLP Full time

    Title : Data EngineerLocation : Hyderabad Experience : 5+ (as Data Engineer)Must have : Snowflakes, python, ETL, Data Bricks, Cloud, Spark.Key Responsibilities :- Lead and mentor a team of data engineers to design, develop, and maintain our data infrastructure, including data warehouses, ETL pipelines, and data lakes.- Oversee the implementation and...

  • Data Engineer

    2 weeks ago


    Hyderabad, India Arjava Consultants LLP Full time

    Title : Data EngineerLocation : Hyderabad Experience : 5+ (as Data Engineer)Must have : Snowflakes, python, ETL, Data Bricks, Cloud, Spark. Key Responsibilities : - Lead and mentor a team of data engineers to design, develop, and maintain our data infrastructure, including data warehouses, ETL pipelines, and data lakes. - Oversee the implementation and...

  • Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Arjava Consultants LLP Full time

    Title : Data EngineerLocation : Hyderabad Experience : 5+ (as Data Engineer)Must have : Snowflakes, python, ETL, Data Bricks, Cloud, Spark.Key Responsibilities :- Lead and mentor a team of data engineers to design, develop, and maintain our data infrastructure, including data warehouses, ETL pipelines, and data lakes.- Oversee the implementation and...


  • Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR52043 Staff Data Science Engineer, SMAIResponsibilities...

  • Snowflake Engineer

    1 month ago


    Hyderabad, India Kudos Technolabs Full time

    Job Title: SnowflakeEngineerExperience:8 Years(4 Years Relevant)SkillsRequired:Cloud Data Warehouse Snowflake ProCertification ETL TerraformRBACLocations:BangaloreNoida HyderabadJobDescription:We are seeking ahighly skilled Snowflake Engineer to join our team at multiplelocations including Bangalore Noida and Hyderabad. As a SnowflakeEngineer you will be...

  • GCP Data Engineer

    2 months ago


    Pune,Hyderabad,Anywhere in India,Multiple Locations Huquo Full time

    Job Description : Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage,...

  • GCP Data Engineer

    1 month ago


    Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...

  • Snowflake

    1 week ago


    Hyderabad, India Nityo Infotech Full time

    •Experience working with Snowflake Functions hands on exp with Snowflake utilities stage and file upload features time travel fail safe procedure writing tasks snowpipe Snow SQL.•Solid understand and hands-on experience on DBT (database build tool) to perform ETL/ELT tasks•Fluent in relational design principles and writing complex SQL.•Beginner...

  • Snowflake Engineer

    1 month ago


    hyderabad, India Kudos Technolabs Full time

    Job Title: SnowflakeEngineerExperience: 8 Years(4 Years Relevant)SkillsRequired: Cloud Data Warehouse Snowflake ProCertification ETL TerraformRBACLocations: BangaloreNoida Hyderabad JobDescription: We are seeking ahighly skilled Snowflake Engineer to join our team at multiplelocations including Bangalore Noida and Hyderabad. As a SnowflakeEngineer you...