Data Engineer

2 weeks ago

Vellore, Tamil Nadu, India Impetus Full time

Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune

Job Description

  • 1-8 years' experience working on Data engineering & ETL/ELT processes, data warehousing, and data lake implementation with AWS services
  • Hands on experience in designing and implementing solutions like creating/deploying jobs, Orchestrating the job/pipeline and infrastructure configurations
  • Expertise in designing and implementing pySpark and Spark SQL based solutions
  • Design and implement data warehouses using Amazon Redshift, ensuring optimal performance and cost efficiency.
  • Good understanding of security, compliance, and governance standards.

Roles & Responsibilities

  • Design and implement robust and scalable data pipelines using AWS/Azure services
  • Drive architectural decisions for data solutions on AWS, ensuring scalability, security, and cost-effectiveness.
  • Hands-on experience of Develop and deploy ETL/ELT processes using Glue/Azure data factory, Lambda/Azure functions, Step function/Azure logic apps/MWAA, S3 and Lake formation from various data sources.
  • Strong Proficiency in pySpark, SQL, Python.
  • Proficiency in SQL for data querying and manipulation.
  • Experience with data modelling, ETL processes, and data warehousing concepts.
  • Create and maintain documentation for data pipelines, processes, and following best practices.
  • Knowledge of various Spark Optimization technique, Monitoring and Automation would be a plus.
  • Participate in code reviews and ensure adherence to coding standards and best practices.
  • Understanding of data governance, compliance, and security best practices.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills – with understanding on stakeholder mapping

Mandatory Skills - AWS OR Azure Cloud, Python Programming, SQL, Spark SQL, Hive, Spark optimization techniques and Pyspark.

Share resume at sonali.mangore@impetus.com with details (CTC, Expected CTC, Notice Period)

  • Data Engineer

    3 weeks ago

    Vellore, Tamil Nadu, India Marktine Technology Solutions Pvt Ltd Full time

    Position: Senior Data EngineerExp: 12-15 YearsLocation: RemoteWe are seeking a Senior Data Engineer. The ideal candidate will be based in India and work remotely. This role requires a blend of design and implementation expertise.Key Responsibilities:Design and bootstrap data solutions, including setting up Snowflake for a large, complex conglomerate.Utilize...

  • Data Engineer

    11 hours ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ProfessionalAs a senior data engineer at a leading technology firm, you will be responsible for working with large-scale data sets to uncover valuable insights and inform business decisions.Key Responsibilities:Develop and maintain scalable big data architectures using distributed processing frameworks and data warehousing solutions.Collaborate with...

  • Lead Data Engineer

    12 hours ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Opportunity: Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a key member of the data engineering team, you will be responsible for designing and developing scalable data pipelines using PySpark.The ideal candidate will have hands-on expertise in building complex business logic using Spark SQL, DataFrame, and RDD APIs.A...

  • Cloud Data Engineer

    3 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data EngineerJob Summary:We are seeking a skilled Cloud Data Engineer with expertise in CI/CD and Kubernetes to develop scalable data ingestion workflows.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support efficient ingestion processes.Key Responsibilities:Design, develop, and...

  • Healthcare Data Engineer

    15 hours ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you ready to make a difference in the healthcare industry with data engineering?We're seeking a skilled Data Engineer to join our innovative team and contribute to AI/ML initiatives through advanced data preparation and management.This exciting role involves cleaning, rationalizing, normalizing, and integrating large healthcare datasets (claims, member,...

  • Data Analytics Engineer

    11 hours ago

    Vellore, Tamil Nadu, India beBeeDataAnalyticsEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a highly skilled and detail-oriented functional engineer with expertise in data analytics platforms. This role will play a critical part in the migration of enterprise data solutions, ensuring business continuity, data integrity, and performance optimization.The ideal candidate will bridge the gap between business requirements...

  • Strategic Data Engineering Leader

    3 days ago

    Vellore, Tamil Nadu, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Effective Data Engineering LeadershipMain Responsibilities:Lead a team of data engineers in designing and delivering scalable data pipelines and analytics platforms on Microsoft Azure.Architect and oversee the development of end-to-end data solutions using Azure Data Services and Databricks, ensuring seamless integration with cross-functional...

  • Data engineer Architect

    2 weeks ago

    Vellore, Tamil Nadu, India InfoSpeed Services, Inc. Full time

    Hi All,We are hiring Azure Data architect with the below primary skills to one of my primary clients.Job Title: Data engineer Architect remote

  • Data Engineering Specialist

    15 hours ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Specialist">We are seeking a highly skilled data engineering specialist to join our team. As a key member of our data platform implementation team, you will be instrumental in designing, developing, and maintaining efficient extraction, transformation, and loading (ETL) processes for large-scale data warehousing.">The successful...

  • Data Engineer for Cloud-based Data Solutions

    2 days ago

    Vellore, Tamil Nadu, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Summary:Azure Databricks Developer needed to design, develop, and implement scalable cloud-based data solutions using Azure services.About the Role:We are seeking an experienced Data Engineer with a strong background in Azure Databricks and PySpark to join our team. As a Data Engineer, you will be responsible for developing and maintaining large-scale...