Data Engineer

1 month ago


bangalore, India Sony UK Technology Centre Full time

We look for the risk-takers , the collaborators , the inspired and the inspirational . We want the people who are brave enough to work at the cutting edge and create solutions that will enrich and improve the lives of people across the globe. So, if you want to make the world say wow, let's talk.

The conversation starts here. If this role matches your ambitions and skillset, let's get started with your application . Take a look at our other open positions too. Our many opportunities can lead to infinite possibilities .
 

(Job Title):

Data Engineer

(Project Details):

This project is to design and develop data delivery on Sony Music Publishing’s data warehouse on AWS.

(Technology and Sub-technology):

AWS

(Base Location):

Bengaluru

(Type):

Hybrid

(Qualifications):

BE/B.Tech in Computer Science 4+ years experience.

(Job Overview):

The Data Engineer is responsible for designing and developing data delivery on our data warehouse on AWS.This data will be consumed by visual dashboards/reports that Sony Music Publishing teams use to better understand trends and insights to improve market share/songwriter deals

(Primary Skills):

Experience in data architecture including data modeling, data mining and data ingestion Experience with AWS associated technologies (S3 buckets, Glue, Data Pipeline, DMS, RDS, Redshift, Aurora, Lambda) Knowledge of creating ETL scripts with languages such as Python, Node.js, SQL Experience in data warehousing and big data Experience with Relational databases (SQL Server) Experience working in Agile/Scrum teams

AWS Services/Skills

Competency (Basic, Intermediary, Advanced)

1

Python

  Intermediary

2

PySpark

  Intermediary

3

EMR/Glue

  Advanced

4

CICD

  Intermediary

5

Serverless Framework

  Intermediary

6

Cloud Formation Templates

  Intermediary

7

Redshift

  Advanced

8

Lambdas

  Advanced

9

Step Functions

  Advanced

10

Cloud Watch

  Intermediary

11

ElasticSearch/Open Search

 Advanced

12

Kibana

 Advanced

13

Kinesis

  Advanced

14

Redshift Spectrum

  Advanced

15

DMS

 Advanced

(Good to have Skills):

PySpark CICD Cloud Formation Templates

(Responsibilities and Duties):

Works with product owners, developers and AWS Infrastructure team to design and develop ETL processes Ability to automate and optimize processes as much as possible Ability to work in an Agile/Scrum team Ability to problem solve and propose solutions Use established Analytics standards/processes in ETL processes Ability to communicate with technical and business teams Ability to learn new technology quickly

(Keywords)

Python PySpark EMR/Glue CICD Serverless Framework Cloud Formation Templates Redshift Lambdas Step Functions Cloud Watch ElasticSearch/Open Search Kibana Kinesis Redshift Spectrum DMS
  • Aptus Data Labs

    1 month ago


    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    3 weeks ago


    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    4 weeks ago


    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    2 weeks ago


    bangalore, India ANZ Full time

    About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is...


  • bangalore, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Data Engineer

    6 days ago


    bangalore, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role Description This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for...

  • Data Engineer

    2 weeks ago


    bangalore, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join...

  • Data Engineer

    1 month ago


    bangalore, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelines Hands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimization Design, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    3 days ago


    bangalore, India Joveo Full time

    Role: Data Engineer Location: Hybrid (Bangalore/Hyderabad) About Joveo Joveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and...

  • Data Engineer

    2 weeks ago


    bangalore, India Aryng Full time

    Welcome! You made it to the job description page! Aryng is looking for a Senior Data Engineer with experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficient Data Engineer who is an expert in theimplementation of a large-scale, highly efficient data platform,...

  • Data Engineer

    7 hours ago


    bangalore, India Genpact Full time

    Inviting applications for the role of Principal Consultant-Senior Data Engineer Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitoring for data pipelines, and automating repetitive data-oriented tasks....

  • Data Engineer

    1 month ago


    bangalore, India Yara Full time

    Responsibilities Participate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams. Monitor, manage and maintain data pipelines as part of the day-to-day data operations. Build data mart tables for various use cases by working with the different data...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    1 month ago


    Bangalore, India Magna Hire Full time

    Responsibilities : Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards. Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases. Assist senior team members in optimizing dbt models and...

  • Data Engineer

    3 days ago


    bangalore, India RaaGaa Value Add Technologies. Full time

    Key Responsibilities: 1.Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform, and load large volumes of structured and unstructured data from diverse sources in Batch and Real-time processing. 2.Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to...

  • Data Engineer

    1 month ago


    bangalore, India Recro Full time

    Job Description:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in data engineering, with a focus on Google Cloud Platform (GCP), particularly BigQuery, data integration, and building robust data pipelines. This role will involve working with various data sources, designing data models, and...

  • Aptus Data Labs

    3 weeks ago


    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing...

  • Data Engineer

    8 hours ago


    bangalore, India Alstom Full time

    Req ID:418339  Leading societies to a low carbon future, Alstom develops and markets mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorail, and trams to integrated systems, customised services, infrastructure, signalling and digital mobility...

  • Data Engineer

    4 weeks ago


    Bangalore, India Danaher Full time

    As a Data Engineer you will be responsible for designing, implementing, and managing our data architecture, pipelines, and business systems. You will join a Center of Excellence and collaborate closely with data scientists, analysts, leaders, and other stakeholders to ensure data availability, quality, and reliability. Your work will be instrumental in...

  • Data Engineer

    4 weeks ago


    bangalore, India Klub Full time

    Responsibilities Responsiblefor setting up a scalable DataWarehouse and building data pipelinemechanisms to integrate the data from various sources for all ofKlub s data. Setup data as a service to exposethe needed data as part of Apis. Have a goodunderstanding on how the finance dataworks. Standardise and optimise design thinkingacross the technology...