Data Engineer

5 days ago

Mumbai, Maharashtra, India Tata Power Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role & responsibilities

  • 7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS) and Data Governance domains.
  • Take ownership of the technical aspects of implementing data pipeline & migration requirements, ensuring that the platform is being used to its fullest potential through designing and building applications around business stakeholder needs.
  • Interface directly with stakeholders to gather requirements and own the automated end-to end data engineering solutions.
  • Implement data pipelines to automate the ingestion, transformation, and augmentation of both structured, unstructured, real time data, and provide best practices for pipeline operations
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
  • Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers. Implement Data Governance best practices.
  • Comprehensive knowledge of Functional and technical impact analysis. Provide advice and ideas for technical solutions and improvements to data systems
  • Create and maintain clear documentation on data models/schemas as well as transformation/validation rules
  • Implement tools that help data consumers to extract, analyse, and visualize data faster through data pipelines
  • Leading the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETL's.
  • Work directly with our internal product/technical teams to ensure that our technology infrastructure is seamlessly and effectively integrated.
  • Migrate current data applications & pipelines to Cloud (AWS) leveraging PaaS technologies.

Preferred candidate profile

  • Graduate with Engineering Degree (CS/Electronics/IT) / MCA / MCS or equivalent with substantial data engineering experience.
  • 8+ years of recent hands-on experience with a modern programming language (Scala, Python, Java) is required; Spark/ Pyspark is preferred.
  • Experience with configuration management and version control apps (ie: Git) and experience working within a CI/CD framework is a plus. An even bigger plus if you have experience building framework.
  • 8+ years of recent hands-on SQL programming experience in a Big Data environment is required; Hadoop/Hive experience is preferred.
  • Working knowledge of PostgreSQL, RDBMS, NoSQL and columnar databases.
  • Hands on experience in AWS Cloud data engineering components including API Gateway, Glue, IoT Core, EKS, ECS, S3, RDS, Redshift, EMR etc.
  • Experience developing and maintaining ETL applications and data pipelines using big data technologies is required; Apache Kafka, Spark, Airflow experience is a must
  • Knowledge of API and microservice integration with applications
  • Experience building data solutions for Power BI and Web visualization applications.
  • Experience with Cloud is a plus.
  • Experience in managing multiple projects and stakeholders with excellent communication and interpersonal skills.
  • Ability to develop and organize high-quality documentation.
  • Superior analytical skills and a strong sense of ownership in your work.
  • Collaborate with data scientists on several projects. Contribute to development and support of analytics including AI/ML.
  • Ability to thrive in a fast-paced environment, and to manage multiple, competing priorities simultaneously.
  • Prior Energy & Utilities industry experience is a big plus.

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FID Federal Risk Applications Data Engineer Req ID: 341951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in...

  • Data Engineer

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer Req ID: 340021 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties: Key...

  • Data & AI Strategist

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 341167NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Strategist to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Location: | Experience: 15+ years...

  • Specialist - Data Center Operations - IBMS IT/OT

    7 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Director - Data Center Operations

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Director,...

  • Specialist - Data Center Operations

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Site Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India M L Labade Engineer Contractor Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesOrganizing materials and ensuring sites are safe and clean.Preparing cost estimates and ensuring appropriate materials and tools are available.Providing technical advice and suggestions for improvement on particular projects.Diagnosing and troubleshooting equipment as required.Negotiating with suppliers and vendors to ensure the best...

  • SOC Engineer

    7 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...

  • Mechanical Design Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Engineer to oversee Data center Design for all new HyperScale and Edge Data Centers. Right from site selection, civil and architectural design from HVAC side including chillers, precision air handling units, fan wall units, VRF, thermal storage tanks, pumps, PACsand low side works.The candidate's job will be to ensure that the Design for every data center...