Data Engineer, IN Data Engineering

4 weeks ago

bangalore, India ADCI - Karnataka Full time
IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build analytics solutions and manage the largest petabyte-scale data infrastructure in India and for Amazon India businesses.
IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified Data and Analytics Infrastructure (UDAI) for all A.in teams which includes central Petabyte-scale Redshift data warehouse, analytics infrastructure and frameworks for visualizing and automating generation of reports & insights and self-service data applications for ingesting, storing, discovering, processing & querying of the data 2) Providing business specific data and analytics solutions for various business streams like Payments, Finance, Consumer & Delivery Experience. The Data Engineer will play a key role in being a strong owner of our Analytics & data platform. He/she will own and build automations and solutions to ensure the availability, efficiency, scaling, expansion, operations and compliance of the data and analytics platform that serves 200 + IN businesses. The role sits in the heart of technology & business worlds and provides opportunity for growth, high business impact and working with seasoned business leaders.
An ideal candidate will be someone with sound technical background in building data & analytics solutions, managing large data infrastructures, , working with petabyte-scale data, building scalable automations and driving operational excellence. An ideal candidate will be someone who is a self-starter that can start with a requirement & work backwards to conceive and devise best possible solution, a good communicator while driving customer interactions, a passionate learner of new technology when the need arises, a strong owner of every deliverable in the team, obsessed with customer delight, business impact and ‘gets work done’ in business time.
Key job responsibilities
- Design/implement data & analytics solutions and manage our massive Data infrastructure to scale for the Analytics needs of Amazon IN.
- Build solutions to achieve BAA(Best At Amazon) standards for data availability, consistency & compliance.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, Amazon and AWS big data technologies
- Drive operational excellence strongly within the team and build automations and mechanisms to reduce operations
- Enable efficient data exploration, experimentation of large datasets on our platform and implement data access control mechanisms for stand-alone datasets
- Design and implement scalable and cost effective data & analytics infrastructure to enable Non-IN(Emerging Marketplaces and WW) use cases on our data platform
- Must possess strong verbal and written communication skills, be self-driven, and deliver high quality results in a fast-paced environment.
- Enjoy working closely with your peers in a group of very smart and talented engineers.
A day in the life
India Data Engineering and Analytics (IDEA) team is central data engineering team for Amazon India. Our vision is to simplify and accelerate data driven decision making for Amazon India by providing cost effective, easy & timely access to high quality data. We achieve this by providing UDAI (Unified Data & Analytics Infrastructure for Amazon India) which serves as a central data platform and provides data engineering infrastructure, ready to use datasets and self-service reporting capabilities. Our core responsibilities towards India marketplace include a) providing systems(infrastructure) & workflows that allow ingestion, storage, processing and querying of data b) building ready-to-use datasets for easy and faster access to the data c) automating standard business analysis / reporting/ dash-boarding d) empowering business with self-service tools to manage data and generate insights.
We are open to hiring candidates to work out of one of the following locations:
Bengaluru, KA, IND

BASIC QUALIFICATIONS

- 1+ years of data engineering experience
- Experience with SQL
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with data visualization software (e.g., AWS QuickSight or Tableau) or open-source project

PREFERRED QUALIFICATIONS

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
- Knowledge of AWS Infrastructure

  • Aptus Data Labs

    4 weeks ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    3 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineering Lead

    4 days ago

    bangalore, India In Time Tec Full time

    Exprience: 5+yearsJob Overview:The position requires an experienced and ambitious candidate who is passionate about technology and is self-driven. The candidate must be technically proficient in all phases of development life cycle, yet savvy enough to interface with non-technical stakeholders to achieve results and meet common project goals. The candidate...

  • Data Engineer

    7 days ago

    bangalore, India ANZ Full time

    About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is...

  • Big Data Developer

    4 weeks ago

    Bangalore Metropolitan Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Data Engineer

    1 day ago

    bangalore, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role Description This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for...

  • Data Engineer

    7 days ago

    bangalore, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join...

  • Data Engineer

    4 weeks ago

    bangalore, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelines Hands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimization Design, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    1 week ago

    bangalore, India Aryng Full time

    Welcome! You made it to the job description page! Aryng is looking for a Senior Data Engineer with experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficient Data Engineer who is an expert in theimplementation of a large-scale, highly efficient data platform,...

  • Data Engineer

    4 weeks ago

    bangalore, India Yara Full time

    Responsibilities Participate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams. Monitor, manage and maintain data pipelines as part of the day-to-day data operations. Build data mart tables for various use cases by working with the different data...

  • Data Engineer

    4 weeks ago

    Bangalore, India Magna Hire Full time

    Responsibilities : Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards. Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases. Assist senior team members in optimizing dbt models and...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Aptus Data Labs

    4 weeks ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing modular...

  • Aptus Data Labs

    3 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description :Qualifications :- Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out)- knowledge in developing modular...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing...

  • Sr Data Engineer/Data Engineer

    3 weeks ago

    bangalore, India Trigent Software - Professional Services Full time

    Senior Data Engineer (5+ Years) / Data Engineer (3+): Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, PySpark, Airflow (3+ years), Spark with Scala (optional). Able to write code which is optimized for performance. Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Able to...

  • Data Engineer

    4 weeks ago

    bangalore, India Recro Full time

    Job Description:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in data engineering, with a focus on Google Cloud Platform (GCP), particularly BigQuery, data integration, and building robust data pipelines. This role will involve working with various data sources, designing data models, and...

  • Data Engineer

    3 weeks ago

    Bangalore, India Danaher Full time

    As a Data Engineer you will be responsible for designing, implementing, and managing our data architecture, pipelines, and business systems. You will join a Center of Excellence and collaborate closely with data scientists, analysts, leaders, and other stakeholders to ensure data availability, quality, and reliability. Your work will be instrumental in...

  • Associate Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Edge in Asia Recruitment Private Limited Full time

    Job Description :Our client is a Limited is a platform in the financial services sector in India set up primarily with the mission of catering to the diverse credit requirements of under-served households and businesses, who is growing their presence in India and is searching for Associate Data Engineers to join their team.Some of the key responsibilities...