Senior Data Engineer GCP

2 months ago

New Delhi, India Logic Software Solutions Full time
Title: Senior Data Engineer(GCP)Location:JobType:FullTimeAboutUs: Logic Hire Software Solutions is an innovativedatacentric organization committed to leveraging advanced analyticsand data engineering practices to inform strategic businessdecisions and improve client engagement. We are seeking a seasonedSenior Data Engineer to join our team and contribute to theoptimization and expansion of our datainfrastructures.JobDescription:Weare in search of a highly proficient Senior Data Engineer with over12 years of handson experience in architecting and maintaining datainfrastructure. The ideal candidate will possess extensiveexpertise in leveraging the Google Cloud Platform (GCP) and theBigQuery ecosystem alongside strong commands in SQL SSIS (SQLServer Integration Services) SSRS (SQL Server Reporting Services)and Python. This role necessitates a combined technical acumen andstrong interpersonal skills to successfully engage with businessunits while supporting the overall projectlifecycle.KeyResponsibilities:
  • Architectimplement and maintain highperformance data pipelines utilizingGCP services particularly BigQuery Cloud StorageCloud Functions and Dataflow ensuring optimal dataflow and accessibility.
  • Design and write highlyefficient scalable SQL queries including complex joins CTEs andaggregations to enable robust data analysis and reporting acrossmultiple operational facets.
  • Develop ETL(Extract Transform Load) processes using SSIS for operational dataintegration and leverage SSRS for generating executivelevelreporting and analyticsdashboards.
  • Employ Python tocreate productionquality scripts and applications for dataingestion transformation and visualization utilizing libraries suchas Pandas NumPy or Apache Airflow for orchestratingworkflows.
  • Engage withcrossfunctional teams to elicit document and analyze businessrequirements subsequently translating these into comprehensivetechnical specifications data models andworkflows.
  • Implement and uphold data governanceframeworks to ensure data integrity quality control and securityprotocols across all data engineeringprocesses.
  • Monitor data pipelines and systemperformance metrics identifying bottlenecks and implementingsolutions to optimize throughput and minimizedowntime.
  • Provide analytical insights andrecommendations to project and client management facilitatingdatadriven decisionmaking.
  • Mentor junior dataengineering staff cultivating an environment of knowledge sharingand professional development.
  • Stay abreast oflatest trends in data engineering technologies tools andmethodologies to continually refine our datapractices.
Qualifications:
  • Bachelors degree in Computer Science Engineering Data Science or a relateddiscipline; a Master s degree is highlydesirable.
  • A minimum of 8 yearsof experience in the field of data engineering particularly withinGCP and the BigQueryarchitecture.
  • Profoundexperience in formulating and executing complex SQL queries and asolid understanding of relational database designprinciples.
  • Advanced proficiencywith SSIS for ETL processes and SSRS for business intelligencereporting.
  • Strongprogramming skills in Python with a focus on data manipulation andthe development of scalable ETLsolutions.
  • Demonstrated abilityin constructing deploying and maintaining data engineeringpipelines utilizing modern bestpractices.
  • Strong verbal and writtencommunication skills complemented by an ability to liaiseeffectively between technical teams and businessstakeholders.
  • Exceptional analytical andproblemsolving capabilities with a proactive approach towardsdiagnosing and resolving issues.
  • Workingknowledge of data governance principles compliance with dataprivacy regulations and industry bestpractices.
PreferredSkills:
  • Familiaritywith additional GCP services such as Cloud Dataflow forstream/batch processing Dataproc for managing Hadoop/Spark clustersor Pub/Sub for messagingservices.
  • Understandingof machine learning concepts and frameworks (e.g. TensorFlowscikitlearn) to integrate predictive analytics within datasolutions.
  • Experienceworking within Agile environments and proficiency with projectmanagement tools (e.g. JIRATrello).
WhatWe Offer:
  • Acompetitive salary and comprehensive benefitspackage.
  • Opportunities for continuedprofessional development and advancement within a cuttingedgeenvironment.
  • A collaborative workspace thatencourages innovation and creativity.
  • Flexibleworking options to support worklifebalance.
If youpossess the expertise and are eager to advance your career bydriving impactful data initiatives at Logic Hire we invite you toapply. Please submit your resume and a cover letter detailing yourrelevant qualifications andaccomplishments.
Communicationin English should be proficient.
Experiencein Data Engineering & Architecture ( Data Modeling ETLProcesses Data Pipeline Development Data Integration and Cloud DataSolutions(GCP)Experiencein Cloud Platforms (Google Cloud Platform (GCP) particularlyBigQuery Cloud Storage Cloud Functions)Experience inBig Data Tools (Hadoop Spark MapReduce Pig Hive NoSQL ApacheAirflow)Experiencein Data Governance(data governance frameworks ensuring dataintegrity quality control and securityprotocols)Experiencein Data Visualization & Reporting (PowerBI Tableau SSISSSRS SupersetPlotly)Experiencein Programming Languages (: Python SQL R Scala C CJava)Experiencein Database Technologies (Teradata Oracle SQLServer)
Note: Must be Green Card US Citizen

problem-solving,c++,spark,clouddata solutions (gcp),workflow management,data analysis,datapipelines,etl processes,data reporting,cloud,c,datavisualization,data governance frameworks,bigquery,datagovernance,scikit-learn,data integrity,data engineering,hive,dataengineering & architecture,tensorflow,gcp,data science,datavisualization & reporting,data engineering pipelines,agilemethodology,business intelligencereporting,tableau,hadoop,ssis,cloud functions,agilemethodologies,pandas,databasetechnologies,teradata,reporting,monitoring,numpy,java,plotly,superset,datapipeline development,sql,team management,data engineeringmethodologies,cloud platforms (google cloud platform (gcp),particularly bigquery, cloud storage, cloud functions),dataarchitecture,agile environments,etl,etl (extract, transform,load),google cloud platform (gcp),data quality control,programminglanguages,big data tools,data engineering technologies,data,bigdata tools (hadoop, spark, mapreduce, pig, hive, nosql, apacheairflow),agile,apache airflow,data integration,data security,datagovernance (data governance frameworks, ensuring data integrity,quality control, and security protocols),ssrs,scala,datastorage,project management,cloud data solutions,datasolutions,cloud storage,nosql,communication,data modeling,databasetechnologies (teradata, oracle, sql server),business requirementsanalysis,mapreduce,python,data manipulation,relational databasedesign,dataflow,r,securityprotocols,mentoring,analytics,programming languages (python, sql,r, scala, c, c++, java),technicalspecifications,pipelines,powerbi,cloud platforms,data visualization& reporting (powerbi, tableau, ssis, ssrs, superset,plotly),machine learning,communication skills,oracle,pig,googlecloud platform

  • Senior Data Integration Engineer | Senior Data Integration Engineer | delhi

    1 day ago

    delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    16 hours ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    16 hours ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...

  • Senior Data Engineer GCP

    1 month ago

    Delhi, Delhi, India Logic Software Solutions Full time

    Job DescriptionWe are seeking a seasoned Senior Data Engineer to join our team at Logic Software Solutions. The ideal candidate will possess extensive expertise in leveraging the Google Cloud Platform (GCP) and the BigQuery ecosystem alongside strong commands in SQL, SSIS, SSRS, and Python.Key ResponsibilitiesArchitect, Implement, and Maintain...

  • GCP Data Engineer

    1 month ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • GCP Data Engineer

    3 weeks ago

    Delhi, India Mastech InfoTrellis Full time

    Position:GCP Data EngineerLocation:Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)Duration:Full TimeService based Company:Mastech InfoTrellis Mastech Digital Period:15-45 days (Non negotiable)Job Description:We are seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP) and PySpark to join our...

  • GCP Data Engineer

    3 weeks ago

    delhi, India Mastech InfoTrellis Full time

    Position: GCP Data EngineerLocation: Chennai, Tamil Nadu(3 day/week) / (Remote with travel 1 week/ 3 months)Duration: Full TimeService based Company: Mastech InfoTrellis and Mastech Digital Period: 15-45 days (Non negotiable)Job Description:We are seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP) and...

  • GCP Data Engineer

    3 weeks ago

    Delhi, India Tekgence Inc Full time

    1 of our MNC client is looking for GCP Data Engineers on an urgent basis. Kindly find below the details for your reference.Role: GCP Data EngineerExperience: 5 - 11 YearsNotice Period: Immediate - 30 days maxBudget: 20 - 32 LPA maxLocation: Pune/Chennai/HyderabadMandate Skills:GCP BigQuery, SQL Scripting & Python coding experience.GCP Certification...

  • GCP Data Engineer

    2 months ago

    Delhi, India Quantiphi Full time

    Designation:Data EngineerExperience Level:4-16 YearsLocation:Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of relational...

  • GCP Data Engineer

    3 weeks ago

    delhi, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Gcp data engineer

    1 month ago

    Delhi, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • GCP Data Engineer

    1 month ago

    Delhi, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • GCP Data Engineer

    3 weeks ago

    delhi, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Sr Cloud Engineer

    2 weeks ago

    new delhi, India Zemoso Technologies Full time

    What You will do We're looking for bright Senior DevOps engineers that are deeply experienced individual contributors anddynamic team leaders, to join our dedicated DevOps Practice Group. As a Senior DevOps practitioner atZemoso you’ll use your expertise to provide DevSecOps services to our customers and to our inhouseDev teams.Basic Qualifications●...

  • GCP Data Engineer

    4 weeks ago

    Hyderabad/Chennai/Bangalore/Delhi/Kolkata/Mumbai/Pune, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Data EngineerWe are looking for a skilled Data Engineer to join our team at MLOPS SOLUTIONS PRIVATE LIMITED. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data engineering solutions using Google Cloud Platform (GCP).Key Responsibilities :Develop and implement data engineering solutions using standards,...

  • GCP Data Engineer

    3 weeks ago

    delhi, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • GCP Data Engineer

    3 weeks ago

    delhi, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Gcp data engineer

    3 weeks ago

    Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market.As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • GCP Data Engineer

    1 month ago

    Delhi, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • GCP Data Engineer

    4 weeks ago

    delhi, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...