Data Engineering Specialist for Large-Scale Data Pipelines

2 weeks ago


Delhi, Delhi, India Mphasis Full time
About the Role

We are seeking an experienced Senior Software Engineer to lead the development of large-scale data pipelines using AWS services. This is a challenging role that requires expertise in designing, developing, and maintaining scalable data pipelines.

Key Responsibilities
  • Design and develop data pipelines to ingest and transform data from multiple sources using AWS services like S3, Glue, and Redshift.
  • Implement best practices for ETL/ELT processes, optimizing performance, reliability, and data quality.
  • Manage data storage and retrieval strategies using Amazon S3 for structured and unstructured data.
  • Leverage Redshift for data warehousing needs, performing database operations to support analytics and reporting.
  • Use AWS Glue to develop and orchestrate data transformation processes, ensuring data is clean, consistent, and optimized for analysis.
  • Write Python scripts for data manipulation, transformation, and integration, handling data from various sources and in different formats.
Requirements
  • A minimum of 7 years of experience in data engineering.
  • Strong expertise in AWS services, including S3, Lambda, Glue, Step Function, and Redshift.
  • Proficiency in Python programming language.
  • Experience with data pipeline development, ETL/ELT processes, and data management.
About Mphasis

Mphasis is a leading IT solutions provider offering applications, business process outsourcing, and infrastructure services globally. We have a strong presence in Bangalore, Mumbai, Hyderabad, and Chennai.



  • Delhi, Delhi, India ANSR Full time

    About the Role:ANSR is seeking a skilled Senior Data Engineer to join our team in Bangalore. In this role, you will be responsible for designing and implementing large-scale data pipelines using Python, Spark, SQL, Snowflake, dbt, and other relevant technologies.Key Responsibilities:• Design and develop scalable and efficient data pipelines using Python,...


  • Delhi, Delhi, India Iappsdata Full time

    About IappsdataIappsdata is a technology company that provides innovative solutions for industrial data management and AI-driven insights.Job DescriptionThe ideal candidate will have a strong background in data engineering, data analysis, and machine learning, with experience working with large-scale datasets and complex systems.Main ResponsibilitiesData...

  • Senior Data Architect

    2 weeks ago


    Delhi, Delhi, India ZEALOGICS IT SOLUTIONS PRIVATE LIMITED Full time

    Job Description">We are seeking a highly skilled Senior Data Architect to design, implement, and manage large-scale data pipelines using Azure Databricks and Azure Data Factory.About the Role">The ideal candidate will have expertise in writing complex SQL queries, navigating source systems, and performing data analysis to drive business...


  • Delhi, Delhi, India Restored Cloud Full time

    Job Title: Data Infrastructure Specialist - Large Scale Machine LearningAbout the Role:We are seeking a highly skilled Data Infrastructure Specialist to join our team at Restored Cloud. In this role, you will design and build cutting-edge tools, frameworks, and systems that enable efficient training, deployment, and scaling of machine learning models.About...


  • Delhi, Delhi, India DeepRec Full time

    We are seeking a skilled Data Engineer to design and implement scalable machine learning services and data pipelines within our AWS/Kubernetes environment. As a key member of our team, you will be responsible for setting up infrastructure to support the ingestion, processing, and indexing of text-based data.About the RoleIn this role, you will collaborate...

  • Data Engineer

    1 week ago


    Delhi, Delhi, India Pacific Data Integrators Full time

    Pacific Data Integrators is seeking a highly skilled Data Engineer to join our team. This role involves designing and optimizing data pipelines, ensuring seamless movement of data across systems, and supporting data initiatives with strong technical expertise.


  • Delhi, Delhi, India Essvee Consultant Full time

    Essvee Consultant is seeking a highly skilled Data Engineer with expertise in Scala and Azure to join our team. With a strong background in database development, analytics, and data integration, you will be responsible for analyzing, designing, developing, testing, and modifying new and existing applications.We are looking for a proven professional with 4-6...


  • Delhi, Delhi, India LinkedIn Full time

    About LinkedInLinkedIn is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers. Our vision is to create economic opportunity for every member of the global workforce.Job DescriptionWe are looking for a talented and driven individual to accelerate our efforts and be a major part of...


  • Delhi, Delhi, India Coders Brain Technology Private Limited Full time

    **Job Summary:**Coders Brain Technology Private Limited seeks a seasoned Cloud Data Engineer to design, develop, and deploy scalable data pipelines on Azure.**About the Role:**We are looking for an experienced professional with expertise in Azure big data tools, relational SQL, NoSQL databases, and scripting languages like Python.**Responsibilities:Design...


  • Delhi, Delhi, India MINDTEL GLOBAL PRIVATE LIMITED Full time

    Job SummaryWe are seeking a skilled Data Science Pipeline Specialist to join our innovative team at MINDTEL GLOBAL PRIVATE LIMITED. As an expert in machine learning operations, you will be responsible for designing, implementing, and maintaining scalable data science pipelines.About the RoleOptimize Machine Learning Pipelines: Collaborate with data...


  • Delhi, Delhi, India Talpro Full time

    Job DescriptionTalpro is seeking a highly skilled Data Engineering Specialist to join our team. This role will play a critical part in designing, building, and maintaining the infrastructure and pipelines that power our machine learning models and data processing workflows.About the RoleThis position requires a deep understanding of Python, cloud...

  • Data Entry Specialist

    2 weeks ago


    Delhi, Delhi, India Data entry Full time

    We are seeking a highly skilled Data Entry Specialist to join our team. The ideal candidate will have excellent typing skills, attention to detail, and proficiency in Microsoft Excel and Google Sheets.About the RoleThe successful candidate will be responsible for accurately and efficiently entering data into various systems, managing spreadsheets, and...

  • Cloud Data Engineer

    3 weeks ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Job Role: Cloud Data Engineer - Big Data Solutions SpecialistAbout the Role: Tata Consultancy Services is seeking a skilled Cloud Data Engineer to join our team in Chennai. As a key member of our big data solutions team, you will be responsible for developing and deploying scalable big data pipelines on Google Cloud Platform (GCP).Responsibilities: Develop...


  • Delhi, Delhi, India Recro Full time

    We Are Hiring: An Experienced AWS DevOps Engineer to Join Our Team.About the Role:Recro is a Fortune Global Top 25 company looking for a skilled AWS DevOps Engineer to work on large-scale projects handling petabytes of data while integrating cutting-edge AI capabilities.Job Requirements:5+ years of experience in AWS, DevOps, Python, Terraform, CI/CD, and...


  • Delhi, Delhi, India AccedePro Private Limited Full time

    We are seeking a Senior Data Engineering Specialist to join our team at AccedePro Private Limited. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:- Design and implement data pipelines using Python and Databricks.- Develop and maintain ETL processes...

  • Cloud Data Specialist

    2 weeks ago


    Delhi, Delhi, India Muoro Full time

    About MuoroMuoro is a pioneer in data engineering innovation, empowering businesses through cutting-edge data solutions.Job DescriptionWe are seeking an expert Cloud Data Specialist to lead the design, development, and deployment of large-scale cloud data infrastructure on AWS, collaborating with cross-functional teams to deliver exceptional results.Key...


  • Delhi, Delhi, India VSHR UNNATI LLP Full time

    Salary Range: ₹10 - 16 LPAJob Overview:VSHR UNNATI LLP is seeking an experienced Data Engineer Specialist to join our Quality Assurance team. The ideal candidate will have strong expertise in testing data pipelines, machine learning models, and large-scale data processing systems, specifically within the Databricks environment.Key Responsibilities:Develop...

  • Data Engineer

    1 month ago


    Delhi, Delhi, India Max life insurance co ltd Full time

    **About the Role**Max Life Insurance Co Ltd is seeking an experienced Data Engineer - Cloud Big Data Specialist to join our team. This role requires a skilled professional who can design, implement, and maintain scalable data pipelines and infrastructure on AWS cloud platform.In this position, you will be responsible for architecting large-scale data...

  • Data Entry Specialist

    2 weeks ago


    Delhi, Delhi, India Data entry Full time

    Data Entry Job DescriptionWe are seeking a detail-oriented and skilled data entry specialist to join our team. As a data entry specialist, you will be responsible for accurately and efficiently inputting data into various software systems.Key Responsibilities:Enter data into spreadsheets (e.g., Google Sheets or Excel) with high accuracy and speed.Convert...


  • Delhi, Delhi, India Talent500 Full time

    About the RoleTalent500 is seeking a highly skilled Data Engineering Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing and developing large-scale analytics solutions on Snowflake cloud data platforms.