Data Engineer

2 days ago

Mumbai, Maharashtra, India Wipro Full time ₹ 1,20,000 - ₹ 3,00,000 per year

Role Purpose

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters

Responsibilities:

Design and implement the data modeling, data ingestion and data processing for various datasets

Design, develop and maintain ETL Framework for various new data source

Develop data ingestion using AWS Glue/ EMR, data pipeline using PySpark, Python and Databricks.

Build orchestration workflow using Airflow & databricks Job workflow

Develop and execute adhoc data ingestion to support business analytics.

Proactively interact with vendors for any questions and report the status accordingly

Explore and evaluate the tools/service to support business requirement

Ability to learn to create a data-driven culture and impactful data strategies.

Aptitude towards learning new technologies and solving complex problem.

Qualifications :

Minimum of bachelors degree. Preferably in Computer Science, Information system, Information technology.

Minimum 5 years of experience on cloud platforms such as AWS, Azure, GCP.

Minimum 5 year of experience in Amazon Web Services like VPC, S3, EC2, Redshift, RDS, EMR, Athena, IAM, Glue, DMS, Data pipeline & API, Lambda, etc.

Minimum of 5 years of experience in ETL and data engineering using Python, AWS Glue, AWS EMR /PySpark and Airflow for orchestration.

Minimum 2 years of experience in Databricks including unity catalog, data engineering Job workflow orchestration and dashboard generation based on business requirements

Minimum 5 years of experience in SQL, Python, and source control such as Bitbucket, CICD for code deployment.

Experience in PostgreSQL, SQL Server, MySQL & Oracle databases.

Experience in MPP such as AWS Redshift, AWS EMR, Databricks SQL warehouse & compute cluster.

Experience in distributed programming with Python, Unix Scripting, MPP, RDBMS databases for data integration

Experience building distributed high-performance systems using Spark/PySpark, AWS Glue and developing applications for loading/streaming data into Databricks SQL warehouse & Redshift.

Experience in Agile methodology

Proven skills to write technical specifications for data extraction and good quality code.

Experience with big data processing techniques using Sqoop, Spark, hive is additional plus

Experience in data visualization tools including PowerBI, Tableau.

Nice to have experience in UI using Python Flask framework anglular

Mandatory Skills: Python for Insights

Experience : 5-8 Years.

  • Data Ingest Engineer

    6 days ago

    Mumbai, Maharashtra, India NTT DATA North America Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Ingest Engineer at NTT DATA in Pune, Maharashtra, India, you will be an integral part of the Ingestion team of the DRIFT data ecosystem. Your primary focus will be on ingesting data in a timely, complete, and comprehensive manner using the latest technology available to Citi. It is imperative that you leverage new and creative methods for...

  • FID Federal Risk Applications Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 341951NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties:...

  • Specialist- Data Center Operations

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Continue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...

  • Data & AI Strategist

    1 week ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: We are currently seeking a Data & AI Strategist to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Location: | Experience: 15+ years (5+ in AI/ML architecture) Role Overview We are seeking a seasoned AI / GenAI Solution Architect with 15+ years of total experience , including 5+ years of relevant expertise in AI/ML, Data Science, and...

  • Electrical Design Engineer

    6 days ago

    Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job DescriptionJob Title: Electrical Engineer (Design)Job Level: ManagerFunction: EngineeringLocation : Pan IndiaReporting to : Engineering HeadPurpose of the Job1) Use expertise to assist in the design of electrical systems; helping to avoid problems and addressing any issues that might arise in the reliability of the design, thus reducing downtime and...

  • Specialist - Data Center Operations

    23 hours ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • MS Engineer

    2 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Networking...

  • Site Engineer

    23 hours ago

    Navi Mumbai, Maharashtra, India M L Labade Engineer Contractor Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesOrganizing materials and ensuring sites are safe and clean.Preparing cost estimates and ensuring appropriate materials and tools are available.Providing technical advice and suggestions for improvement on particular projects.Diagnosing and troubleshooting equipment as required.Negotiating with suppliers and vendors to ensure the best...

  • Specialist- Data Center Operations

    1 week ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India AMISEQ Full time

    Data Engineer Navi Mumbai, MH Job Description: As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...