AWS Data Engineer

2 weeks ago

chennai, India Manvision Technologies Full time

Role Summary: Senior Data Engineer

Pune/Bangalore/Chennai

About the Role

As a Senior Data Engineer, we are looking for someone passionate about working as part of a team to deliver high-quality, professional dashboards that have a business impact.

Experience in years:

At least 5 years of hands-on experience using AWS to deliver complex data pipelines for large or dynamic organizations (MNCs or Start-ups)

Area of Responsibility

Working with our Product Owner and Business Analysts to deliver data pipelines and standardized data assets as part of our regional data model:

Breaking down requirements into deliverable work packages, that can be estimated and support roadmap creation. Supporting our regional architects in defining a regional data model of standardized data assets which maximize data reusability. Delivering data assets that transform raw data into semantic data assets that are harmonize across markets within the region. Implementing data pipeline to ingest and cleanse raw data from various source systems including SaaS, Cloud based and On-prep databases. Collaborating with Business Analysts and Tableau Developers to develop the

Materialized / Table Views to be consumed by Tableau and enable the dashboard visualizations:

  • Analyzing available data assets and deliver Materialized / Table Views (incl.

joins, window functions, aggregation, and calculations) based on a scalable regional architecture.

  • Working with Business Analysts to understand KPI calculations and ensuring data is consistently reported within the dashboard.
  • Implementing functional requirements including incremental loads, data snapshots and identity resolution

Optimizing data pipelines to improve performance and cost, while ensuring a high quality of data within the data lake:

  • Monitoring services and jobs for cost and performance, ensuring continual operations of data pipelines, and fixing of defects
  • Constantly looking for opportunities to optimize data pipelines to improve performance.

Quality-first mindset, with a strong focus on taking responsibility and ownership of their work and supporting the rest of the team towards a common goal.

Knowledge / Experience

  • AWS Glue
  • AWS S3
  • AWS Redshift
  • AWS Athena
  • Spark / Pyspark, Python, SQL
  • Data Modeling
  • CI/CD (incl. GitHub / GitHub Actions, Terraform)
  • JIRA

Nice to have:

  • AWS Kinesis / Kafka
  • Dbt (Data Build Tool)

  • Data Engineer

    2 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 282638 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob...

  • Data Engineer

    17 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • AWS Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns Work closely with DevOps engineer to support...

  • AWS Data Engineer

    2 weeks ago

    Chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the roleThe role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient ETL...

  • AWS Data Engineer

    3 weeks ago

    Chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the roleThe role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient ETL...

  • AWS Data Engineer

    3 weeks ago

    Chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • AWS Data Engineer

    2 weeks ago

    chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • AWS Data Engineer

    3 weeks ago

    chennai, India RELX Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • AWS Data Engineer

    2 weeks ago

    Chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • Data Engineer

    21 hours ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID:282638NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking...

  • AWS Data Engineer

    23 hours ago

    Chennai, Tamil Nadu, India RELX Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • Data Engineer

    3 days ago

    Chennai, India NTT DATA Services Full time

    Req ID: 282638 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are...

  • Data Engineer

    3 days ago

    chennai, India NTT DATA Services Full time

    Req ID:  282638  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Data Engineer Job Summary We...

  • AWS Data Engineer

    1 month ago

    Chennai, India LexisNexis Full time

    Software Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...

  • Data Engineer

    2 months ago

    chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • AWS Data Engineer

    18 hours ago

    Chennai, Tamil Nadu, India Manvision Technologies Full time

    Role Summary: Senior Data EngineerPune/Bangalore/ChennaiAbout the RoleAs a Senior Data Engineer, we are looking for someone passionate about working as part of a team to deliver high-quality, professional dashboards that have a business impact.Experience in years:At least 5 years of hands-on experience using AWS to deliver complex data pipelines for large or...

  • AWS Data Engineer

    18 hours ago

    Chennai, Tamil Nadu, India LexisNexis Full time

    Software Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...

  • AWS Data Engineer

    2 weeks ago

    chennai, India HTC Global Services Full time

    AWS Data EngineerExperience: 5+ yearsLocation: ChennaiNotice Period: Immediate to 30 daysJob Description:Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...

  • AWS Data Engineer

    1 month ago

    Chennai, India LexisNexis Full time

    Software Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...

  • AWS Data Engineer

    1 month ago

    chennai, India LexisNexis Full time

    Software Engineer III Do you enjoy designing analytic solutions at an enterprise scale for global customers? Do you have experience in working on complex problems? About our Team Our product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data...