Data Engineer

5 days ago

Pune, India Intriant HR Services Full time
JobDescription:We areseeking a skilled and experienced GCP (Google Cloud Platform) DataEngineering Specialist to join our team. The ideal candidate shouldhave 3 years of relevant experience with expertise in BigQueryDataflow Spark and Pub/Sub. As a Data Engineering Specialist youwill be responsible for designing developing and maintaining datapipelines data integration solutions and ETL processes on the GCPplatform to support our datadriven applications and analyticsinitiatives.Responsibilities:
  • Designdevelop and maintain data pipelines and ETL processes usingBigQuery Dataflow Spark and Pub/Sub on the GCPplatform.
  • Collaborate with data scientists dataanalysts and other stakeholders to gather requirements and definedata engineering solutions that meet businessneeds.
  • Optimize and troubleshoot data pipelinesfor performance reliability andscalability.
  • Ensure data quality and integrityby implementing data validation cleansing and transformationprocesses.
  • Monitor and manage data processingworkflows troubleshoot and resolve data processingissues.
  • Develop and maintain documentation fordata engineering processes workflows and bestpractices.
  • Stay updated with the latestadvancements in GCP data engineering technologies and recommend andimplement improvements to existing data engineeringprocesses.
  • Strong GCP Hadoop Hive Spark UnixShell scripting and Pythonexperience.
  • Exceptional troubleshooting skillsin the following: GCP Hadoop Hive Spark Unix Shellscripting.
  • Construct and maintain ELT/ETL jobprocesses sourcing from disparate systems throughout the enterpriseand load into an enterprise datalake.
  • Effectively acquire and translate userrequirements into technical specifications to develop automateddata pipelines to satisfy businessdemand
Skills andQualifications
  • Bachelorsor Masters degree in Computer Science Engineering or a relatedfield.
  • 3 years of relevant experience in dataengineering with a strong focus on GCP technologies includingBigQuery Dataflow Spark and Pub/Sub.
  • Handsonexperience in designing developing and optimizing data pipelinesETL processes and data integration solutions onGCP.
  • Proficiency in programming languages suchas Python or Scala with experience in writing efficient andscalable code for data processing.
  • Strongunderstanding of data modeling data warehousing and dataintegration concepts.
  • Knowledge of data lakeand data warehouse architectures data governance and data securitybest practices on GCP.
  • Excellent problemsolvingskills with the ability to troubleshoot and resolve complex dataengineering issues.
  • Strong communication andcollaboration skills to work effectively with crossfunctional teamsand stakeholders.
  • GCP certifications such asGoogle Cloud Certified Data Engineer Google Cloud CertifiedProfessional Data Engineer or related certifications are aplus.

gcp,spark,dataflow,data engineering,data integration,etl

  • Senior Data Engineer

    1 month ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    3 weeks ago

    Pune, India NTT DATA Full time

    Job DescriptionReq ID:278258NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN)."Job Duties:...

  • Data Engineer

    3 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 278258 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN)."Job...

  • Data Engineer

    3 weeks ago

    pune, India NTT DATA Full time

    Job Description Req ID:  278258  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN)....

  • Data Engineer

    3 weeks ago

    pune, India NTT DATA Full time

    Job Description Req ID:  278258  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN)....

  • Data Engineer

    3 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 278258 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN)."Job...

  • Data Engineer

    3 weeks ago

    pune, India NTT DATA Services Full time

    Req ID:  278258  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN). "Job Duties: ●...

  • Data Engineer

    3 weeks ago

    Pune, India NTT DATA Services Full time

    Req ID: 278258 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN)."Job Duties: ● Develop,...

  • Data Engineer

    3 weeks ago

    Pune, India NTT DATA Services Full time

    Req ID: 278258  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (ETL/SQL) to join our team in Pune, Mahārāshtra (IN-MH), India (IN). "Job...

  • Senior Data Scientist

    1 month ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Data Scientist

    2 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Product Owner, Data Modeling

    2 months ago

    Pune, India Data Axle Full time

    **About Data Axle**: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Product Owner, Data Modeling

    2 months ago

    Pune, India Data Axle Full time

    **About Data Axle**: - Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Associate Data Scientist

    3 weeks ago

    pune, India Data Axle Full time

    Job Description Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Associate Data Scientist

    3 weeks ago

    Pune, India Data Axle Full time

    Job Description Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform...

  • Associate Data Scientist

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform...