AWS Data Engineer

1 month ago


Mumbai, India TopN Analytics Full time

We are seeking a full-time AWS Data Engineer to join our team in Mumbai / Bangalore.


Company Description

TopN Analytics is an analytics services provider that helps companies achieve their goals through data-driven decision-making. We specialize in Big Data Analytics, Advanced Business Analytics, Marketing Analytics, Website & App analytics, Data Science, Data Engineering, Visualization, Forecasting, and Predictive Modelling solutions.


Role Description

The Data Engineer will develop and maintain scalable data pipelines using AWS services, and will be responsible for data acquisition, data transformation, and data modeling. The Data Engineer will also be responsible for collaborating with cross-functional teams to design and develop data solutions that meet business requirements, as well as creating and maintaining technical documentation for system design, development and testing.


Our technology stack includes AWS, Postgres SQL, MySQL, Looker, Tableau, Python, Docker, Apache Airflow, AWS Glue, etc. We work with diverse data sources, including data from various SaaS platforms, Google Sheets, 3rd-party APIs, Google, Facebook, and more.


Responsibilities

  1. Design data pipelines to curate sourced data into the Redshift data warehouse
  2. Build and maintenance of data pipelines and data platforms with tools such as Airflow, AWS Glue
  3. Explore ways to enhance data quality and reliability
  4. Develop analytical tooling to better support BI and Advanced Data Analytics activities
  5. Promote and champion data engineering standards and best-in-class methodology


Requirements

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
  • 2-5 years of hands-on experience in data engineering with AWS services (S3, EMR, RDS, DynamoDB, Redshift, etc.)
  • Strong SQL skills
  • Strong programming skills with experience in scripting languages such as Python or Java
  • Experience in data modeling, ETL/ELT frameworks, data warehousing and BI concepts
  • Experience in creating and managing data warehouses and databases - Snowflake, PostgreSQL, MS SQL, MySQL, Redshift, etc.
  • Understanding of web protocols (HTTP, FTP) and web services (REST APIs)
  • Good understanding of data analysis and data science concepts
  • Strong critical-thinking, analytical and problem-solving skills
  • Excellent communicator with team-oriented approach

  • Data Engineer

    2 weeks ago


    Mumbai, India Domnic Lewis International Full time

    Key Deliverables : 1. Implement data ingestion processes to extract data from various sources, including databases, APIs, and streaming platforms.2. Develop and maintain Extract, Transform, Load (ETL) pipelines using AWS Glue, AWS Lambda, or custom scripts.3. Perform data cleansing activity such as removing spaces, upper/lower, drop duplicate data, Renaming...

  • Data Engineer

    4 weeks ago


    mumbai, India Huquo Full time

    Position : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...

  • Data Engineer

    2 weeks ago


    Mumbai, India Huquo Full time

    Position : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...

  • Data Engineer

    2 weeks ago


    Mumbai, India Huquo Full time

    Position : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...

  • Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Huquo Full time

    Position : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Chennai/Pune/Mumbai, India Voyager Partners Full time

    Company : Mastek Digital (https :// Overview :We are looking for a talented AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform. Your expertise in AWS services and data engineering will be critical in building scalable,...


  • mumbai, India Ventura Securities Ltd. Full time

    Job description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...

  • Oneture Technologies

    2 weeks ago


    Mumbai/Navi Mumbai/Pune, India Oneture Technologies Full time

    Role : Data Engineer (AWS)Location : Mumbai, PuneExperience : 1 to 3 yrsTechnologies / Skills : Advanced SQL, AWS, ETL pipelines development and optimization, Data Modelling, Spark - Scala/Python, Airflow, KafkaJob Overview : We are looking for a Data Engineer to join our data team to solve data-driven critical business problems. You will be responsible for...

  • Oneture Technologies

    4 weeks ago


    Mumbai/Navi Mumbai/Pune, Maharashtra, India Oneture Technologies Full time

    Role : Data Engineer (AWS)Location : Mumbai, PuneExperience : 1 to 3 yrsTechnologies / Skills : Advanced SQL, AWS, ETL pipelines development and optimization, Data Modelling, Spark - Scala/Python, Airflow, KafkaJob Overview :We are looking for a Data Engineer to join our data team to solve data-driven critical business problems. You will be responsible for...

  • AWS Data Engineer

    2 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, India Change Leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    4 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...


  • Navi Mumbai, India Ventura Securities Ltd. Full time

    Job description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...


  • Thane/Mumbai/Navi Mumbai/Maharashtra, India Ventura Securities Ltd. Full time

    Job description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...


  • Thane/Mumbai/Navi Mumbai/Maharashtra, Maharashtra, India Ventura Securities Ltd. Full time

    Job description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...


  • Mumbai, India GAMIFi Consulting Services Pvt Ltd Full time

    Position : Data Engineering ManagerFunctional Area : AWS Data EngineeringExperience : 10+ yrsJob Location : MumbaiJob Type : Permanent & Work From OfficeQualification : B.Tech / B.E / MCAResponsibilities : Research and develop designs and products. Lead research and development projects that produce new designs, products, and processes. Determine the need...

  • Data Engineer

    2 weeks ago


    mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...

  • Data Engineer

    2 weeks ago


    Mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data Security...

  • AWS DevOps Engineer

    2 weeks ago


    Pune/Mumbai/Maharashtra/Navi Mumbai, India fingertips data intelligence solutions Full time

    Walking drive in Pune for aws devops (Saturday 1st March'24)JD - AWS DevOps Engineer- Bachelor's degree in Computer Science, Information Technology, or related field.- 5+ years of experience in DevOps or SRE.- In-depth knowledge of cloud services and its best practices AWS preferable.- Ability to provide support and maintain AWS/Azure any cloud...


  • mumbai, India AWS India - Maharashtra - D03 Full time

    Amazon Web Services is the global market leader and technology forerunner in the Cloud business. As a member of the AWS Support team, you will be at the forefront of this transformational technology, assisting a global list of companies and developers that are taking advantage of a growing set of services and features to run their mission-critical...

  • Data Engineer

    4 weeks ago


    mumbai, India Anicalls (Pty) Ltd Full time

    Candidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...