Senior Data Engineer

18 hours ago

Mumbai, Maharashtra, India All European Careers Full time  1,20,000 -  1,80,000 per year

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates

using the following resources: Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation.

Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term.

Tasks and Responsibilities:

  • Refactor, develop, maintain the web analytics ETL pipeline

Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs,

Use data pipeline jobs to curate extracted raw data

Use data pipeline jobs to apply transformation based on reporting needs

Data source connectors to ingest the data from various data sources

Write the spark SQLs to produce the datasets

Monitor, troubleshoot and remediate the above jobs

  • Data Modelling

Maintenance of the existing data models in the data lake and data warehouse

Design & Implement data models for new data sources as required

  • Refactor, maintain the CloudFormation templates and CDK as per the CICD guidelines/requirements
  • Other ad hoc deliverables required by the project

Profile:

  • University degree in computer science, engineering or other related discipline;
  • +5 years of experience as Data Engineer;
  • Hands-on experience writing code for AWS Glue in python with PySpark and Spark SQL;
  • Relational databases such as PostgreSQL (preferably AWS Redshift) with expertise in SQL, query optimization;
  • Serverless Query Service, preferably AWS Athena;
  • Experience in implementing an end to end cloud native Data warehouse platform - data modelling;
  • ETL, data integration and data migration, preferably related to AWS Redshift;
  • Expertise in SQL, query optimization;
  • Experience in implementing data integration from different sources;
  • Experience with AWS IaC (CloudFormation & CDK) and CICD pipelines;
  • Experience in Python programming and using PySpark for distributed computing in AWS Cloud;
  • Experience in working with ERP applications such as PeopleSoft is an added advantage;
  • Development of Reports/Dashboards using Tableau is an added advantage;
  • Fluent in English;

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...

  • Senior Data Engineer

    1 week ago

    Mumbai, Maharashtra, India origin hr Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description Senior Data Engineer Full time Locations: Bangalore, Delhi, Hyderabad, Mumbai, Pune Posted: 11 hours agoPosition Senior Data Engineer Experience: 8 years Job Location: Mumbai / Pune / Bangalore / Delhi NCR / HyderabadSkills Required:Developing, maintaining, and documenting reliable and scalable data infrastructure and data products in...

  • Senior Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Uplers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience: yearsSalary: Confidential (based on experience)Shift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Full time Permanent Position(*Note: This is a requirement for one of Uplers' client - Forbes Advisor)What do you need for this opportunity?Must have skills required: Airflow, dbt, Google CloudForbes Advisor is Looking...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FID Federal Risk Applications Data Engineer Req ID: 341951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in...

  • Senior Associate Automation Engineer

    4 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Senior Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Engineer- MS,AWS Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your...

  • Senior AI Engineer

    6 days ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Senior GenAI Engineers Req ID: 341050 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). ...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Senior Data Engineer

    11 hours ago

    Mumbai, Maharashtra, India Fornax Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Who is this forIf solving business challenges drives you. This is the place to be. Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a skilled Analytics Engineer who has worked in a Retail/Ecommerce domain. The ideal candidate will possess a strong blend of...

  • Director - Data Center Operations

    6 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Director,...