Sr. GCP Data Engineer

2 weeks ago

Hyderabad, Telangana, India Micron Technology Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Our vision is to transform how the world uses information to enrich life for all.

Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

Responsibilities and Tasks

Understand the Business Problem and the Relevant Data

  • Maintain and understanding of company and department strategy
  • Translate analysis requirements into data requirements
  • Identify and understand the data sources that are relevant to the business problem
  • Develop conceptual models that capture relationships within the data
  • Define the data-quality objectives for the solution
  • Be a subject matter expert in data sources and reporting options

Architect Data Management Systems

  • Use understanding of the business problem and the nature of the data to select appropriate data management systems (Big Data, OLTP, OLAP, etc.)
  • Design and implement optimum data structures in the appropriate data management system (GCP BQ, Snowflake, SQL server etc.) to satisfy the data requirements
  • Plan methods for archiving/deleting of information

Develop, Automate, and Orchestrate an Ecosystem of ETL Processes for Varying Volumes of Data

  • Identify and select the optimum methods of access for each data source (real-time/streaming, batch, delayed, static)
  • Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical data model
  • Develop processes to efficiently load the transformed  data into the data management system

Prepare Data to Meet Analysis Requirements

  • Work with the data scientist to implement strategies for cleaning and preparing data for analysis (e.g., outliers, missing data, etc.)
  • Develop and code data extracts
  • Follow standard methodologies to ensure data quality and data integrity
  • Ensure that the data is fit to use for data science applications

Qualifications and Experience:

  • 4-7 years of experience developing, delivering, and/or supporting data engineering, advanced analytics or business intelligence solutions
  • Ability to work with multiple operating systems and generic tools.
  • Experienced in developing ETL/ELT processes using Apache Ni-Fi, Cloud solutions like GCP, Big Query and Snowflake or any equivalent etc.
  • Significant experience with big data processing and/or developing applications and data sources using different cloud services etc.
  • Experienced in integration with different Ingestion, Scheduling, logging, Alerting and Monitoring cloud services.
  • Understanding of how distributed systems work
  • Familiarity with software architecture (data structures, data schemas, etc.)
  • Strong working knowledge of databases (Cloud DBs like BQ, Snowflake, AlloyDB or any equivalents etc.) including SQL and NoSQL.
  • Strong mathematics background, analytical, problem solving, and organizational skills
  • Strong communication skills (written, verbal and presentation)
  • Experience working in a global, multi-functional environment
  • Minimum of 2 years experience in any of the following: At least one high-level client, object-oriented language (e.g., C#, C++, JAVA, Python, Perl, etc.); at least one or more web programming language (PHP, MySQL, Python, Perl, JavaScript, ASP, etc.); one or more Data Extraction Tools (SSIS, Informatica etc.)
  • Software development
  • Ability to travel as needed

Education:

B.S. degree in Computer Science, Software Engineering, Electrical Engineering, Applied Mathematics or related field of study.Role & responsibilities

  • GCP Data Engineer

    2 days ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    Job Title:GCP Data Engineer (4+ Years Experience)Location:Hyderabad / PuneOpen Positions:3Compensation:Up to₹12 LPA(Based on experience & skills)Must Read Before ApplyingWe are looking forexperienced professionals with a minimum of 4+ yearsinGCP Data Engineering.Only candidates who meet theexperience requirementand possess themandatory skills listed...

  • Gcp Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Egen (Formerly SpringML) Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Overview: We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working...

  • GCP Data Engineer

    3 days ago

    Hyderabad, Telangana, India Talent21 Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Role & responsibilities-GCP Data Engineer , Big Querry, Data flow, Data Composer, SQL, Python, Pyspark along with 3+ Years strong GCP experience & worked as Module lead / Tech LeadExp - 4 to 15 yrsLocations - Pan IndiaWork Mode - HybridNotice Period - Immediate to 30 Days & Serving notice period

  • GCP Data Engineer

    5 days ago

    Hyderabad, Telangana, India Estuate Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Job Title : Data Engineer / Integration Engineer Job Summary : We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP/Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role...

  • GCP Data Engineer

    5 days ago

    Hyderabad, Telangana, India Zennial Pro Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title:GCP Data Engineer Location: Hyderabad / Pune Experience: 4+ YearsKey ResponsibilitiesDesign, build, and optimize scalable data pipelines on Google Cloud Platform (GCP) .Work on BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions for data ingestion, transformation, and analytics.Develop ETL/ELT processes ensuring data quality,...

  • GCP Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Synechron Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    GCP Data Engineer | Cloud Data Pipelines, Python, BigQuery, Agile Methodology Job Summary Synechron is seeking a highly skilled GCP Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data solutions leveraging Google Cloud Platform (GCP) technologies. Your expertise will support the...

  • Sr. Snowflake DATA ENGINEER

    7 days ago

    Hyderabad, Telangana, India Rapinno Tech Solutions GmbH Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're HiringWe are looking for aSr. Snowflake/dbt with SAP HANA Data Engineerto join our growing teamLocations: Mumbai, Pune, Chennai & BangaloreExperience: 5+ yearsKey Responsibilities Design, develop, test & deploy robust ETL pipelines onSnowflake (Azure/AWS/GCP) Build solutions usingSnowflake, dbt, Databricks, Cloud Composer (Airflow), Cloud Run Ingest...

  • GCP Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Synechron Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job SummarySynechron is seeking a highly skilled GCP Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data solutions leveraging Google Cloud Platform (GCP) technologies. Your expertise will support the organization's data infrastructure, enabling scalable analytics, data processing, and...

  • Data Engineer

    1 hour ago

    Hyderabad, Telangana, India Talescope Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role:We are looking for a highly experienced and hands-onGCP Data Engineer(AdTech) to lead our analytics team. This role is ideal for someone with a strong background in log-level data handling, cross-platform data engineering, and a solid command of modern BI tools. You'll play a key role in building scalable data pipelines, leading analytics...

  • Lead GCP Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Incedo Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Lead GCP Data EngineerLocation: Hyderabad/ChennaiExperience: 6+ YearsJob details:Key ResponsibilitiesLead the end-to-end design and implementation of data pipelines , ETL/ELT processes , and data lake/warehouse solutions on GCP.Architect scalable data platforms leveraging BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage, Composer, and Cloud...