Data Engineer

3 days ago

Mumbai, Maharashtra, India Tata Power Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role & responsibilities

  • 7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS) and Data Governance domains.
  • Take ownership of the technical aspects of implementing data pipeline & migration requirements, ensuring that the platform is being used to its fullest potential through designing and building applications around business stakeholder needs.
  • Interface directly with stakeholders to gather requirements and own the automated end-to end data engineering solutions.
  • Implement data pipelines to automate the ingestion, transformation, and augmentation of both structured, unstructured, real time data, and provide best practices for pipeline operations
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
  • Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers. Implement Data Governance best practices.
  • Comprehensive knowledge of Functional and technical impact analysis. Provide advice and ideas for technical solutions and improvements to data systems
  • Create and maintain clear documentation on data models/schemas as well as transformation/validation rules
  • Implement tools that help data consumers to extract, analyse, and visualize data faster through data pipelines
  • Leading the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETL's.
  • Work directly with our internal product/technical teams to ensure that our technology infrastructure is seamlessly and effectively integrated.
  • Migrate current data applications & pipelines to Cloud (AWS) leveraging PaaS technologies.

Preferred candidate profile

  • Graduate with Engineering Degree (CS/Electronics/IT) / MCA / MCS or equivalent with substantial data engineering experience.
  • 8+ years of recent hands-on experience with a modern programming language (Scala, Python, Java) is required; Spark/ Pyspark is preferred.
  • Experience with configuration management and version control apps (ie: Git) and experience working within a CI/CD framework is a plus. An even bigger plus if you have experience building framework.
  • 8+ years of recent hands-on SQL programming experience in a Big Data environment is required; Hadoop/Hive experience is preferred.
  • Working knowledge of PostgreSQL, RDBMS, NoSQL and columnar databases.
  • Hands on experience in AWS Cloud data engineering components including API Gateway, Glue, IoT Core, EKS, ECS, S3, RDS, Redshift, EMR etc.
  • Experience developing and maintaining ETL applications and data pipelines using big data technologies is required; Apache Kafka, Spark, Airflow experience is a must
  • Knowledge of API and microservice integration with applications
  • Experience building data solutions for Power BI and Web visualization applications.
  • Experience with Cloud is a plus.
  • Experience in managing multiple projects and stakeholders with excellent communication and interpersonal skills.
  • Ability to develop and organize high-quality documentation.
  • Superior analytical skills and a strong sense of ownership in your work.
  • Collaborate with data scientists on several projects. Contribute to development and support of analytics including AI/ML.
  • Ability to thrive in a fast-paced environment, and to manage multiple, competing priorities simultaneously.
  • Prior Energy & Utilities industry experience is a big plus.

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Specialist - Data Center Operations - IBMS IT/OT

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Director - Data Center Operations

    3 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Director,...

  • SOC Engineer

    7 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...

  • Mechanical Design Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Engineer to oversee Data center Design for all new HyperScale and Edge Data Centers. Right from site selection, civil and architectural design from HVAC side including chillers, precision air handling units, fan wall units, VRF, thermal storage tanks, pumps, PACsand low side works.The candidate's job will be to ensure that the Design for every data center...

  • Managed Service Engineer

    4 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Cross...

  • Senior Associate Automation Engineer

    2 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Specialist-Data Center Operations

    2 weeks ago

    Mumbai, Maharashtra, India NTT Global Data Centers Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India MSol Technologies Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionMSol Technologies Pvt. Ltd., founded in 2018, is a CMMI Level 3 and ISO/IEC 27001:2022 certified company providing leading IT services in outsourced software product development, data science, and analytics. We specialize in cutting-edge technologies such as cloud & web solutions, mobility, IoT, drones, AR/VR, data engineering, data...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India CodesmoTech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionCodesmoTech leads the digital transformation era, facilitating agile and scalable solutions for both global corporations and startups. As pioneers in AI, automation, and cloud computing, we deliver unparalleled user experiences and functionality. Our service lines cover Digital Transformation, Data and AI, Cloud Solutions, Modern Software...