Data Engineer I

1 month ago

bangalore, India ADCI - Karnataka Full time
Amazon Music is awash in data To help make sense of it all, the DISCO (Data, Insights, Science & Optimization) team: (i) enables the Consumer Product Tech org make data driven decisions that improve the customer retention, engagement and experience on Amazon Music. We build and maintain automated self-service data solutions, data science models and deep dive difficult questions that provide actionable insights. We also enable measurement, personalization and experimentation by operating key data programs ranging from attribution pipelines, northstar weblabs metrics to causal frameworks. (ii) delivering exceptional Analytics & Science infrastructure for DISCO teams, fostering a data-driven approach to insights and decision making. As platform builders, we are committed to constructing flexible, reliable, and scalable solutions to empower our customers. (iii) accelerates and facilitates content analytics and provides independence to generate valuable insights in a fast, agile, and accurate way. This domain provides analytical support for the below topics within Amazon Music: Programming / Label Relations / PR / Stations / Livesports / Originals / Case & CAM. DISCO team enables repeatable, easy, in depth analysis of music customer behaviors. We reduce the cost in time and effort of analysis, data set building, model building, and user segmentation. Our goal is to empower all teams at Amazon Music to make data driven decisions and effectively measure their results by providing high quality, high availability data, and democratized data access through self-service tools.
If you love the challenges that come with big data then this role is for you. We collect billions of events a day, manage petabyte scale data on Redshift and S3, and develop data pipelines using Spark/Scala EMR, SQL based ETL, Airflow and Java services.
We are looking for talented, enthusiastic, and detail-oriented Data Engineer, who knows how to take on big data challenges in an agile way. Duties include big data design and analysis, data modeling, and development, deployment, and operations of big data pipelines. You'll help build Amazon Music's most important data pipelines and data sets, and expand self-service data knowledge and capabilities through an Amazon Music data university.
DISCO team develops data specifically for a set of key business domains like personalization and marketing and provides and protects a robust self-service core data experience for all internal customers. We deal in AWS technologies like Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, and Lambda. Your team will manage the data exchange store (Data Lake) and EMR/Spark processing layer using Airflow as orchestrator. You'll build our data university and partner with Product, Marketing, BI, and ML teams to build new behavioural events, pipelines, datasets, models, and reporting to support their initiatives. You'll also continue to develop big data pipelines.
Key job responsibilities
•Deep understanding of data, analytical techniques, and how to connect insights to the business, and you have practical experience in insisting on highest standards on operations in ETL and big data pipelines. With our Amazon Music Unlimited and Prime Music services, and our top music provider spot on the Alexa platform, providing high quality, high availability data to our internal customers is critical to our customer experiences.
•Assist the DISCO team with management of our existing environment that consists of Redshift and SQL based pipelines. The activities around these systems will be well defined via standard operation procedures (SOP) and typically involve approving data access requests, subscribing or adding new data to the environment
•SQL data pipeline management (creating or updating existing pipelines)
•Perform maintenance tasks on the Redshift cluster.
•Assist the team with the management of our next-generation AWS infrastructure. Tasks includes infrastructure monitoring via CloudWatch alarms, infrastructure maintenance through code changes or enhancements, and troubleshooting/root cause analysis infrastructure issues that arise, and in some cases this resource may also be asked to submit code changes based on infrastructure issues that arise.
About the team
Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators.From personalized music playlists to exclusive podcasts,concert livestreams to artist merch,we are innovating at some of the most exciting intersections of music and culture.We offer experiences that serve all listeners with our different tiers of service:Prime members get access to all music in shuffle mode,and top ad-free podcasts,included with their membership;customers can upgrade to Music Unlimited for unlimited on-demand access to 100 million songs including millions in HD,Ultra HD,spatial audio and anyone can listen for free by downloading Amazon Music app or via Alexa-enabled devices.Join us for opportunity to influence how Amazon Music engages fans, artists,and creators on a global scale.
We are open to hiring candidates to work out of one of the following locations:
Bangalore, KA, IND

BASIC QUALIFICATIONS

- 2+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience in Unix
- Experience in Troubleshooting the issues related to Data and Infrastructure issues.

PREFERRED QUALIFICATIONS

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
- Knowledge of distributed systems as it pertains to data storage and computing
- Experience in building or administering reporting/analytics platforms

  • Data Engineer

    6 days ago

    bangalore, India G2 Full time

    About The Role G2 is looking for a Data Engineer - I, you'll be actively involved in designing and implementing data pipelines, focusing on ETL processes, and contributing to the optimization of data solutions within AWS and Snowflake environments. You'll work on data extraction, transformation, and loading, ensuring reliability and efficiency in...

  • Data Engineer

    2 months ago

    Bangalore, India Danaher Full time

    Beckman Coulter Life Sciences’ mission is to empower those seeking answers to life’s most important scientific and healthcare questions. With a legacy spanning 80+ years, we have long been a trusted partner to our customers, who are working to transform science and healthcare with the next groundbreaking discovery. As part of our team of more than...

  • Software Engineer I

    4 weeks ago

    Bangalore, India Danaher Full time

    Chromatography, the science of separation, affects the lives of almost everyone. Phenomenex’s chromatography products advance the future of scientific analysis and investigation, ensuring the quality of essentials like your food, water, shampoo, and even cold medication. We strive to provide the best tools and resources possible to help scientists...

  • Software Engineer I

    3 weeks ago

    Bangalore, India Danaher Full time

    Chromatography, the science of separation, affects the lives of almost everyone. Phenomenex’s chromatography products advance the future of scientific analysis and investigation, ensuring the quality of essentials like your food, water, shampoo, and even cold medication. We strive to provide the best tools and resources possible to help scientists...

  • Software Engineer I

    4 weeks ago

    Bangalore, India Danaher Full time

    Chromatography, the science of separation, affects the lives of almost everyone. Phenomenex’s chromatography products advance the future of scientific analysis and investigation, ensuring the quality of essentials like your food, water, shampoo, and even cold medication. We strive to provide the best tools and resources possible to help scientists...

  • Software Engineer I

    3 weeks ago

    Bangalore, India Danaher Full time

    Chromatography, the science of separation, affects the lives of almost everyone. Phenomenex’s chromatography products advance the future of scientific analysis and investigation, ensuring the quality of essentials like your food, water, shampoo, and even cold medication. We strive to provide the best tools and resources possible to help scientists...

  • Data Engineer

    15 hours ago

    bangalore, India May I Help You Full time

    Position : Data Engineer Exp & Package 3-5 yrs-15 LPA 5-7 yrs-18 LPA Location-Bangalore, Pune, Chennai, Mumbai, Hyderabad, Gurgaon Intervie wmode-Virtual Pelase share CV to JOB DESCRIPTION : Strong experience (4-7 Years) as a Data Engineer, with a strong track record of designing and implementing data pipelines. Proficiency in data integration and ETL...

  • Senior Analyst I

    3 weeks ago

    Bangalore/Chennai, Tamil Nadu, India T D Newton Full time

    Job Description :- Look for candidates with exp in Data Visualization , reporting , dashboard- Exp in SAS + SQL - must - Python - good to have- Exp in Control \Control Testing -must- Exp in data Monitoring\Automation is required Control Testing Development : - As a Senior Analyst, I design and implement robust control tests to ensure data integrity and...

  • Senior Analyst I

    3 weeks ago

    Bangalore/Chennai, India T D Newton Full time

    Job Description : - Look for candidates with exp in Data Visualization , reporting , dashboard- Exp in SAS + SQL - must - Python - good to have- Exp in Control \Control Testing -must- Exp in data Monitoring\Automation is required Control Testing Development : - As a Senior Analyst, I design and implement robust control tests to ensure data integrity and...

  • Senior Engineer

    2 months ago

    bangalore, India Celeros Flow Technology Full time

      1.0 Job Summary Responsible for undertaking controls & instrumentation (C&I) engineering activities across OE, A/Market and Development. Providing Technical support on tender enquiries.   As a Senior C&I engineer, your primary duty is to undertake a defined range of engineering activities in line with all relevant processes and quality requirements. You...

  • Senior Engineer

    3 weeks ago

    bangalore, India Celeros Flow Technology Full time

    1.0 Job Summary   Responsible for undertaking controls & instrumentation (C&I) engineering activities across OE, A/Market and Development. Providing Technical support on tender enquiries. As a Senior C&I engineer, your primary duty is to undertake a defined range of engineering activities in line with all relevant processes and quality requirements. You...

  • Machine Learning Engineer

    1 month ago

    bangalore, India Aptus Data Labs Full time

    ML Engineer-Video Analytics Location - Bangalore/RemoteWe are seeking a talented and experienced ML Engineer worked on Video Analytics to join our Data Science team. The ideal candidate will be responsible for developing and implementing machine learning algorithms to analyze and extract insights from video data. This role offers the opportunity to work on...

  • Data Engineering Specialist

    4 weeks ago

    bangalore, India BT Group Full time

    What you’ll be doing 1.Drives the design, coding, unit testing, and deployment of data processes'for ingestion and transformation of data while keeping data security and privacy in mind.2.Leads the development of architecture and design patterns to process and store high volume data sets.3.Leads key projects using advanced technical knowledge to drive...

  • Data Engineering Specialist

    3 weeks ago

    bangalore, India BT Group Full time

    What you’ll be doing 1.Drives the design, coding, unit testing, and deployment of data processes'for ingestion and transformation of data while keeping data security and privacy in mind.2.Leads the development of architecture and design patterns to process and store high volume data sets.3.Leads key projects using advanced technical knowledge to drive...

  • Senior Data Engineer

    2 months ago

    bangalore, India News Corp Full time

    Job Description : Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India News Corp Full time

    Job Description : Senior Data Engineer About the Role We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the...

  • Data Engineer

    2 months ago

    bangalore, India Zyient Full time

    Job Description/Requirements: 1.6+ years of experience in data engineering or software development roles, with a focus on building and maintaining data pipelines and infrastructure. Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark or Flink. Strong understanding of...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Lead Software Engineer I

    4 weeks ago

    Bangalore, India Danaher Full time

    Chromatography, the science of separation, affects the lives of almost everyone. Phenomenex’s chromatography products advance the future of scientific analysis and investigation, ensuring the quality of essentials like your food, water, shampoo, and even cold medication. We strive to provide the best tools and resources possible to help scientists...