Data Engineer, IN Data Engineering

3 weeks ago

Bengaluru, India ADCI - Karnataka Full time
IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified Data and Analytics Infrastructure (UDAI) for all A.in teams which includes central Petabyte-scale Redshift data warehouse, analytics infrastructure and frameworks for visualizing and automating generation of reports & insights and self-service data applications for ingesting, storing, discovering, processing & querying of the data 2) Providing business specific data solutions for various business streams like Payments, Finance, Consumer & Delivery Experience. The Data Engineer will play a key role in being a strong owner of our Data Platform. He/she will own and build automations and solutions to ensure the availability, efficiency, scaling, expansion, operations and compliance of the data platform that serves 200 + IN businesses. The role sits in the heart of technology & business worlds and provides opportunity for growth, high business impact and working with seasoned business leaders.An ideal candidate will be someone with sound technical background in managing large data infrastructures, working with petabyte-scale data, building scalable data solutions/automations and driving operational excellence. An ideal candidate will be someone who is a self-starter that can start with a Platform requirement & work backwards to conceive and devise best possible solution, a good communicator while driving customer interactions, a passionate learner of new technology when the need arises, a strong owner of every deliverable in the team, obsessed with customer delight, business impact and ‘gets work done’ in business time.Key job responsibilities- Design/implement automation and manage our massive Data infrastructure to scale for the Analytics needs of Amazon IN.- Build solutions to achieve BAA(Best At Amazon) standards for data availability, consistency & compliance.- Enable efficient data exploration, experimentation of large datasets on our data platform and implement data access control mechanisms for stand-alone datasets- Design and implement scalable and cost effective data infrastructure to enable Non-IN(Emerging Marketplaces and WW) use cases on our data platform- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, Amazon and AWS big data technologies- Must possess strong verbal and written communication skills, be self-driven, and deliver high quality results in a fast-paced environment.- Drive operational excellence strongly within the team and build automations and mechanisms to reduce operations- Enjoy working closely with your peers in a group of very smart and talented engineers.A day in the lifeIndia Data Engineering and Analytics (IDEA) team is central data engineering team for Amazon India. Our vision is to simplify and accelerate data driven decision making for Amazon India by providing cost effective, easy & timely access to high quality data. We achieve this by providing UDAI (Unified Data & Analytics Infrastructure for Amazon India) which serves as a central data platform and provides data engineering infrastructure, ready to use datasets and self-service reporting capabilities. Our core responsibilities towards India marketplace include a) providing systems(infrastructure) & workflows that allow ingestion, storage, processing and querying of data b) building ready-to-use datasets for easy and faster access to the data c) automating standard business analysis / reporting/ dash-boarding d) empowering business with self-service tools to manage data and generate insights.We are open to hiring candidates to work out of one of the following locations:Bengaluru, KA, IND

BASIC QUALIFICATIONS

- 1+ years of data engineering experience- Experience with SQL- Experience with data modeling, warehousing and building ETL pipelines- Experience with one or more scripting language (e.g., Python, KornShell)

PREFERRED QUALIFICATIONS

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.- Knowledge of AWS Infrastructure

  • Aptus Data Labs

    2 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Data Engineer

    24 hours ago

    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    4 hours ago

    Bengaluru, India JRD Systems Full time

    Role : Data Engineer - AWS and Oracle ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Big Data Developer

    1 month ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    4 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 years Location: Remote / core location - Bangalore Mandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation ) Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQL Extensive experience with Python and PySpark for data processing and...

  • Data Engineer

    5 days ago

    Bengaluru, India ANZ Full time

    About the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is to combine business & technology...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Analyst

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Experience in implementing data storage solutions, managing, and developing data processing, and optimizing data solutions (Azure). Expertise in integrating, transforming, and consolidating data from structured and semi-structured data systems suitable for analytics solutions. Hands-on experience in integrating event based or streaming data into an...

  • Data Engineer

    5 days ago

    Bengaluru, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data EngineerData EngineerReq ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: BengaluruAbout the roleData Engineer –Role Type – FTEJob Grade: Group 4.3At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe....

  • Data Engineer

    2 weeks ago

    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.Familiarity with Kubeflow, with a preference on hands-on experience.Strong proficiency in Python programming for data...

  • Data Engineer

    5 days ago

    Bengaluru, India Aryng Full time

    Welcome! You made it to the job description page!Aryngis looking for aSenior Data Engineerwith experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficientData Engineerwho is an expert in theimplementation of a large-scale, highly efficient data platform, batch, and...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NatWest Group Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • Data Engineering Lead

    5 days ago

    Bengaluru, India In Time Tec Full time

    Exprience: 5+yearsJob Overview:The position requires an experienced and ambitious candidate who is passionate about technology and is self-driven. The candidate must be technically proficient in all phases of development life cycle, yet savvy enough to interface with non-technical stakeholders to achieve results and meet common project goals. The candidate...

  • Data Engineering Lead

    5 days ago

    Bengaluru, India In Time Tec Full time

    Exprience: 5+years Job Overview: The position requires an experienced and ambitious candidate who is passionate about technology and is self-driven. The candidate must be technically proficient in all phases of development life cycle, yet savvy enough to interface with non-technical stakeholders to achieve results and meet common project goals. The...

  • Data Engineering Lead

    4 days ago

    Bengaluru, India In Time Tec Full time

    Exprience: 5+yearsJob Overview:The position requires an experienced and ambitious candidate who is passionate about technology and is self-driven. The candidate must be technically proficient in all phases of development life cycle, yet savvy enough to interface with non-technical stakeholders to achieve results and meet common project goals. The candidate...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer, IN Data Engineering

    4 weeks ago

    Bengaluru, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing...

  • Data Engineer

    2 weeks ago

    Bengaluru, India Ascendion Full time

    Job Title: Data Engineer/ LeadDuration: Full TimeLocation: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid)NOTE: Looking for Immediate Joiners ( 2-3 weeks notice)- Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks.- Familiarity with Kubeflow, with a preference on hands-on experience.- Strong proficiency in Python programming for data...