Data Engineer

3 weeks ago


Bengaluru, India Sony UK Technology Centre Full time
We look for the

risk-takers

, the

collaborators

, the

inspired

and the

inspirational

. We want the people who are brave enough to work at the

cutting edge

and create solutions that will enrich and improve the lives of people across the globe. So, if you want to make the world say wow, let's talk.The conversation starts here. If this role matches your ambitions and skillset,

let's get started with your application

. Take a look at our other open positions too. Our

many opportunities

can lead to

infinite possibilities

.

(Job Title):Data Engineer(Project Details):This project is to design and develop data delivery on Sony Music Publishing’s data warehouse on AWS.(Technology and Sub-technology):AWS(Base Location):Bengaluru(Type):Hybrid(Qualifications):BE/B.Tech in Computer Science4+ years experience.(Job Overview):The Data Engineer is responsible for designing and developing data delivery on our data warehouse on AWS.This data will be consumed by visual dashboards/reports that Sony Music Publishing teams use to better understand trends and insights to improve market share/songwriter deals(Primary Skills):Experience in data architecture including data modeling, data mining and data ingestionExperience with AWS associated technologies (S3 buckets, Glue, Data Pipeline, DMS, RDS, Redshift, Aurora, Lambda)Knowledge of creating ETL scripts with languages such as Python, Node.js, SQLExperience in data warehousing and big dataExperience with Relational databases (SQL Server)Experience working in Agile/Scrum teamsAWS Services/SkillsCompetency (Basic, Intermediary, Advanced)1PythonIntermediary2PySparkIntermediary3EMR/GlueAdvanced4CICDIntermediary5Serverless FrameworkIntermediary6Cloud Formation TemplatesIntermediary7RedshiftAdvanced8LambdasAdvanced9Step FunctionsAdvanced10Cloud WatchIntermediary11ElasticSearch/Open SearchAdvanced12KibanaAdvanced13KinesisAdvanced14Redshift SpectrumAdvanced15DMSAdvanced(Good to have Skills):PySparkCICDCloud Formation Templates(Responsibilities and Duties):Works with product owners, developers and AWS Infrastructure team to design and develop ETL processesAbility to automate and optimize processes as much as possibleAbility to work in an Agile/Scrum teamAbility to problem solve and propose solutionsUse established Analytics standards/processes in ETL processesAbility to communicate with technical and business teamsAbility to learn new technology quickly(Keywords)PythonPySparkEMR/GlueCICDServerless FrameworkCloud Formation TemplatesRedshiftLambdasStep FunctionsCloud WatchElasticSearch/Open SearchKibanaKinesisRedshift SpectrumDMS
  • Aptus Data Labs

    2 weeks ago


    Bengaluru, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Big Data Developer

    4 weeks ago


    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Data Engineer

    1 day ago


    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    9 hours ago


    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    6 days ago


    Bengaluru, India ANZ Full time

    About the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is to combine business & technology...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    6 days ago


    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data EngineerData EngineerReq ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: BengaluruAbout the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe....

  • Data Engineer

    2 weeks ago


    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.Familiarity with Kubeflow, with a preference on hands-on experience.Strong proficiency in Python programming for data...

  • Data Engineer

    6 days ago


    Bengaluru, India Aryng Full time

    Welcome! You made it to the job description page!Aryngis looking for aSenior Data Engineerwith experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficientData Engineerwho is an expert in theimplementation of a large-scale, highly efficient data platform, batch, and...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NatWest Group Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...


  • Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing...

  • Data Engineer

    2 weeks ago


    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)- Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.- Familiarity with Kubeflow, with a preference on hands-on experience.- Strong proficiency in Python programming for data...

  • Data Engineer

    2 days ago


    Bengaluru, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role DescriptionThis is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for some...


  • Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelinesHands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimizationDesign, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    1 week ago


    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the roleData Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Yara Full time

    ResponsibilitiesParticipate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams.Monitor, manage and maintain data pipelines as part of the day-to-day data operations.Build data mart tables for various use cases by working with the different data consumers...

  • Data Engineer

    12 hours ago


    Bengaluru, India Joveo Full time

    Role: Data Engineer Location: Hybrid (Bangalore/Hyderabad) About Joveo Joveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and machine...