Data Engineer

7 days ago

Mumbai, Maharashtra, India Wipro Full time ₹ 1,20,000 - ₹ 3,00,000 per year

Role Purpose

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters

Responsibilities:

Design and implement the data modeling, data ingestion and data processing for various datasets

Design, develop and maintain ETL Framework for various new data source

Develop data ingestion using AWS Glue/ EMR, data pipeline using PySpark, Python and Databricks.

Build orchestration workflow using Airflow & databricks Job workflow

Develop and execute adhoc data ingestion to support business analytics.

Proactively interact with vendors for any questions and report the status accordingly

Explore and evaluate the tools/service to support business requirement

Ability to learn to create a data-driven culture and impactful data strategies.

Aptitude towards learning new technologies and solving complex problem.

Qualifications :

Minimum of bachelors degree. Preferably in Computer Science, Information system, Information technology.

Minimum 5 years of experience on cloud platforms such as AWS, Azure, GCP.

Minimum 5 year of experience in Amazon Web Services like VPC, S3, EC2, Redshift, RDS, EMR, Athena, IAM, Glue, DMS, Data pipeline & API, Lambda, etc.

Minimum of 5 years of experience in ETL and data engineering using Python, AWS Glue, AWS EMR /PySpark and Airflow for orchestration.

Minimum 2 years of experience in Databricks including unity catalog, data engineering Job workflow orchestration and dashboard generation based on business requirements

Minimum 5 years of experience in SQL, Python, and source control such as Bitbucket, CICD for code deployment.

Experience in PostgreSQL, SQL Server, MySQL & Oracle databases.

Experience in MPP such as AWS Redshift, AWS EMR, Databricks SQL warehouse & compute cluster.

Experience in distributed programming with Python, Unix Scripting, MPP, RDBMS databases for data integration

Experience building distributed high-performance systems using Spark/PySpark, AWS Glue and developing applications for loading/streaming data into Databricks SQL warehouse & Redshift.

Experience in Agile methodology

Proven skills to write technical specifications for data extraction and good quality code.

Experience with big data processing techniques using Sqoop, Spark, hive is additional plus

Experience in data visualization tools including PowerBI, Tableau.

Nice to have experience in UI using Python Flask framework anglular

Mandatory Skills: Python for Insights

Experience : 5-8 Years.

  • Data Engineer

    4 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 days ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FID Federal Risk Applications Data Engineer Req ID: 341951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in...

  • Data Ingest Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA North America Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Ingest Engineer at NTT DATA in Pune, Maharashtra, India, you will be an integral part of the Ingestion team of the DRIFT data ecosystem. Your primary focus will be on ingesting data in a timely, complete, and comprehensive manner using the latest technology available to Citi. It is imperative that you leverage new and creative methods for...

  • FID Federal Risk Applications Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 341951NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties:...

  • Specialist - Data Center Operations - IBMS IT/OT

    5 hours ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Data & AI Strategist

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: We are currently seeking a Data & AI Strategist to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Location: | Experience: 15+ years (5+ in AI/ML architecture) Role Overview We are seeking a seasoned AI / GenAI Solution Architect with 15+ years of total experience , including 5+ years of relevant expertise in AI/ML, Data Science, and...

  • Specialist - Data Center Operations

    7 days ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • SOC Engineer

    4 hours ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...

  • Site Engineer

    7 days ago

    Navi Mumbai, Maharashtra, India M L Labade Engineer Contractor Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesOrganizing materials and ensuring sites are safe and clean.Preparing cost estimates and ensuring appropriate materials and tools are available.Providing technical advice and suggestions for improvement on particular projects.Diagnosing and troubleshooting equipment as required.Negotiating with suppliers and vendors to ensure the best...

  • Mechanical Design Engineer

    5 days ago

    Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Engineer to oversee Data center Design for all new HyperScale and Edge Data Centers. Right from site selection, civil and architectural design from HVAC side including chillers, precision air handling units, fan wall units, VRF, thermal storage tanks, pumps, PACsand low side works.The candidate's job will be to ensure that the Design for every data center...