Data Engineer

4 weeks ago

Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

We are hiring a Data Engineer for Pune/Hyderabad/Bangalore.

Experience: 6+ Years

Designation: Senior Software Engineer/Lead Software Engineer –Data Engineer

Skill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, Lambda

JD:

  • 6+ years of experience in data engineering, specifically in cloud environments like AWS.
  • Proficiency in Python and PySpark for data processing and transformation tasks.
  • Solid experience with AWS Glue for ETL jobs and managing data workflows.
  • Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration.
  • Strong experience with AWS services such as S3, Lambda, Redshift, RDS, and EC2.

Technical Skills:

  • Deep understanding of ETL concepts and best practices.
  • Strong knowledge of SQL for querying and manipulating relational and semi-structured data.
  • Experience with Data Warehousing and Big Data technologies, specifically within AWS.

Additional Skills:

  • Experience with AWS Lambda for serverless data processing and orchestration.
  • Understanding of AWS Redshift for data warehousing and analytics.
  • Familiarity with Data Lakes, Amazon EMR, and Kinesis for streaming data processing.
  • Knowledge of data governance practices, including data lineage and auditing.
  • Familiarity with CI/CD pipelines and Git for version control.
  • Experience with Docker and containerization for building and deploying applications.
  • Design and Build Data Pipelines: Design, implement, and optimize data pipelines on AWS using PySpark, AWS Glue, and AWS Data Pipeline to automate data integration, transformation, and storage processes.
  • ETL Development: Develop and maintain Extract, Transform, and Load (ETL) processes using AWS Glue and PySpark to efficiently process large datasets.
  • Data Workflow Automation: Build and manage automated data workflows using AWS Data Pipeline, ensuring seamless scheduling, monitoring, and management of data jobs.
  • Data Integration: Work with different AWS data storage services (e.g., S3, Redshift, RDS) to ensure smooth integration and movement of data across platforms.
  • Optimization and Scaling: Optimize and scale data pipelines for high performance and cost efficiency, utilizing AWS services like Lambda, S3, and EC2.

Interested or know someone who fits? Send your resume to

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330977NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior Software Engineer

    3 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About the Role : We are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Whitehorse Manpower Full time

    Responsibilities: Design, develop, and deploy data solutions on Azure, leveraging SQL Azure, Azure Data Factory, and Databricks. Build and maintain scalable data pipelines to ingest, transform, and load data from various sources into Azure data repositories. Implement data security and compliance measures to safeguard sensitive information....

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

    We are hiring a Data Engineer for Pune/Hyderabad/Bangalore.Experience: 6+ YearsDesignation: Senior Software Engineer/Lead Software Engineer –Data EngineerSkill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, LambdaJD:6+ years of experience in data engineering, specifically in cloud environments like AWS.Proficiency in...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Mount Talent Consulting Pvt Ltd. Full time

    We are hiring a Data Engineer for Pune/Hyderabad/Bangalore.Experience: 6+ YearsDesignation: Senior Software Engineer/Lead Software Engineer –Data EngineerSkill Tech stack: AWS Data Engineer, Python, PySpark, SQL, Data Pipeline, AWS, AWS Glue, LambdaJD:6+ years of experience in data engineering, specifically in cloud environments like AWS.Proficiency in...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Cognition Techsystems Private Limited Full time

    Job DescriptionHello All,We are seeking an experienced Data Engineer to design, build, and optimize enterprise-grade data solutions on Azure. The role involves working with Azure Synapse, SQL schema design, ETL/ELT pipelines, data partitioning strategies, and Power BI dashboards, ensuring robust and scalable data systems. The ideal candidate will have strong...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time

    About the job :Experience Required : 510 years Industry : IT Consulting & ServicesEducation : Bachelor's or Master's degree in Computer Science, Engineering, or a related field.Location : PuneRole Overview :As a Data Engineer at Atgeir Solutions, you will play a pivotal role in designing, developing, and optimizing our data infrastructure and workflows. Your...

  • Data Engineer

    3 days ago

    Pune, Maharashtra, India Cybage Software Full time

    About CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the worlds largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...