Senior Data Engineer

4 days ago

bangalore, India All European Careers Full time

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates using the following resources: Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation. Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term. Tasks and Responsibilities: Refactor, develop, maintain the web analytics ETL pipeline Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs, Use data pipeline jobs to curate extracted raw data Use data pipeline jobs to apply transformation based on reporting needs Data source connectors to ingest the data from various data sources Write the spark SQLs to produce the datasets Monitor, troubleshoot and remediate the above jobs Data Modelling Maintenance of the existing data models in the data lake and data warehouse Design & Implement data models for new data sources as required Refactor, maintain the CloudFormation templates and CDK as per the CICD guidelines/requirements Other ad hoc deliverables required by the project Profile: University degree in computer science, engineering or other related discipline; +5 years of experience as Data Engineer; Hands-on experience writing code for AWS Glue in python with PySpark and Spark SQL; Relational databases such as PostgreSQL (preferably AWS Redshift) with expertise in SQL, query optimization; Serverless Query Service, preferably AWS Athena; Experience in implementing an end to end cloud native Data warehouse platform - data modelling; ETL, data integration and data migration, preferably related to AWS Redshift; Expertise in SQL, query optimization; Experience in implementing data integration from different sources; Experience with AWS IaC (CloudFormation & CDK) and CICD pipelines; Experience in Python programming and using PySpark for distributed computing in AWS Cloud; Experience in working with ERP applications such as PeopleSoft is an added advantage; Development of Reports/Dashboards using Tableau is an added advantage; Fluent in English;

  • Senior DevOps Engineer

    4 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    3 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    3 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    5 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Senior Data Engineer

    18 hours ago

    bangalore, India Elements HR Services Pvt Ltd Full time

    Senior Data Engineer Title Senior Data Engineer Department ISSLocation BengaluruReports To Data Engineers – LeadLevel 4,5,6 We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business area)...

  • Senior Data Engineer

    5 days ago

    bangalore, India MeghGen Technologies Full time

    Company DescriptionMeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...

  • Senior Data Engineer

    4 days ago

    bangalore, India MeghGen Technologies Full time

    Company Description MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...

  • Senior Data Engineer

    3 days ago

    Bangalore, India MeghGen Technologies Full time

    Company Description MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...

  • Senior Data Engineer

    5 days ago

    bangalore, India LogixHealth Full time

    Job Title: Senior Data EngineerLocation: Bengaluru/CoimbatoreJob Type: Full-TimeImmediate joiners or notice period of less than 10days are needed.Job Role:As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-edge solutions that directly improve the healthcare industry. You’ll...