Data Engineer

2 weeks ago

Pune, Maharashtra, India Impetus Full time

Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune

Job Description

  • 3-8 years' experience working on Data engineering & ETL/ELT processes, data warehousing, and data lake implementation with AWS services
  • Hands on experience in designing and implementing solutions like creating/deploying jobs, Orchestrating the job/pipeline and infrastructure configurations
  • Expertise in designing and implementing pySpark and Spark SQL based solutions
  • Design and implement data warehouses using Amazon Redshift, ensuring optimal performance and cost efficiency.
  • Good understanding of security, compliance, and governance standards.

Roles & Responsibilities

  • Design and implement robust and scalable data pipelines using AWS/Azure services
  • Drive architectural decisions for data solutions on AWS, ensuring scalability, security, and cost-effectiveness.
  • Hands-on experience of Develop and deploy ETL/ELT processes using Glue/Azure data factory, Lambda/Azure functions, Step function/Azure logic apps/MWAA, S3 and Lake formation from various data sources.
  • Strong Proficiency in pySpark, SQL, Python.
  • Proficiency in SQL for data querying and manipulation.
  • Experience with data modelling, ETL processes, and data warehousing concepts.
  • Create and maintain documentation for data pipelines, processes, and following best practices.
  • Knowledge of various Spark Optimization technique, Monitoring and Automation would be a plus.
  • Participate in code reviews and ensure adherence to coding standards and best practices.
  • Understanding of data governance, compliance, and security best practices.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills – with understanding on stakeholder mapping

Good to Have:

  • Understanding of databricks is good to have.
  • GenAI, Working with LLMs are good to have

Mandatory Skills - AWS OR Azure Cloud, Python Programming, SQL, Spark SQL, Hive, Spark optimization techniques and Pyspark.

Share resume at sonali.mangore@impetus.com with details (CTC, Expected CTC, Notice Period)

  • Senior QE Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330977NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior QE Engineer

    3 days ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior Software Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Whitehorse Manpower Full time

    Responsibilities: Design, develop, and deploy data solutions on Azure, leveraging SQL Azure, Azure Data Factory, and Databricks. Build and maintain scalable data pipelines to ingest, transform, and load data from various sources into Azure data repositories. Implement data security and compliance measures to safeguard sensitive information....

  • Mid .Net Engineer

    3 days ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:331146NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Mid .Net Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Who we are:NTT DATA America...

  • Data Engineer

    18 hours ago

    Pune, Maharashtra, India aQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable PostgreSQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

    We are hiring a Data Engineer for Pune/Hyderabad/Bangalore.Experience: 6+ YearsDesignation: Senior Software Engineer/Lead Software Engineer –Data EngineerSkill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, LambdaJD:6+ years of experience in data engineering, specifically in cloud environments like AWS.Proficiency in...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

    We are hiring a Data Engineer for Pune/Hyderabad/Bangalore. Experience: 6+ Years Designation: Senior Software Engineer/Lead Software Engineer –Data Engineer Skill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, Lambda JD: 6+ years of experience in data engineering, specifically in cloud environments like AWS....