Data Engineer Specialist

2 days ago


Anywhere in IndiaMultiple Locations MWIDM Staffing Services Full time

About MWIDM Staffing Services

We are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.

Job Description:

The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing ETL processes to ingest, transform, and load data from various sources, optimizing PySpark code for performance and scalability, and working with large datasets and distributed computing frameworks.

Key Responsibilities:

  • Design, develop, and maintain efficient and reliable data pipelines using PySpark.
  • Implement ETL processes to ingest, transform, and load data from various sources.
  • Optimize PySpark code for performance and scalability.
  • Work with large datasets and distributed computing frameworks.
  • Develop and maintain data quality checks and monitoring processes.
  • Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver data solutions.
  • Build and deploy data pipelines to production environments.
  • Troubleshoot and debug data pipeline issues.

Required Skills and Qualifications:

  • 5+ years of experience in data engineering.
  • Strong proficiency in Python and PySpark.
  • Deep understanding of Spark architecture and its core components.
  • Experience with data warehousing concepts and dimensional modeling.
  • Proficiency in SQL and experience writing complex queries.
  • Experience with data ingestion tools and techniques.
  • Experience with data transformation and cleansing.
  • Experience with data quality monitoring and validation.
  • Experience with workflow management tools (Airflow, Luigi).
  • Experience with version control systems (Git).


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    Large Scale Data Ingestion SpecialistAventior Digital Private Limited is seeking an experienced Large Scale Data Ingestion Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and managing large-scale data ingestion processes into Microsoft SQL Server.Key Responsibilities:Design and...


  • Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full time

    Company Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...


  • Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    Job Title: Senior Data EngineerCompany Overview: Cybyrotek Solutions is a leading technology company that specializes in providing innovative data engineering solutions to its clients.Job Description: We are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Coders Brain Technology & Private Limited Full time

    About the role :- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are...


  • Anywhere in India/Multiple Locations Digihelic Solutions Private Limited Full time

    **Key Responsibilities:** We are seeking a Data Visualization and Reporting Specialist to join our team at Digihelic Solutions Private Limited. As a specialist in data visualization and reporting, you will play a key role in developing and implementing business intelligence and analytics solutions using SAP SAC. Data Visualization and Reporting...


  • Anywhere in India/Multiple Locations V2Soft Pvt Ltd Full time

    About Us :V2Soft Pvt Ltd has established itself as a leader in next-generation technology solutions and IT consulting. Our customer-first approach drives us to integrate cutting-edge technology into business processes, enhancing efficiency and providing our clients with a competitive edge. Leveraging our deep domain expertise and innovative technology...

  • Data Architect Lead

    9 hours ago


    Anywhere in India/Multiple Locations Zenfinet Full time

    About ZenfinetZenfinet is a leading provider of data engineering services, helping businesses unlock the full potential of their data. As a Senior Databricks Specialist, you will play a key role in delivering high-quality solutions to our clients and driving business growth.


  • Anywhere in India/Multiple Locations Upraised Full time

    About UpraisedUpraised is a forward-thinking organization dedicated to harnessing the power of data engineering and stream processing. Our team is passionate about leveraging innovative technologies like Snowflake and Kafka to drive business growth and success.Job SummaryWe are seeking an experienced Streaming Solutions Architect to join our dynamic team. As...


  • Anywhere in India/Multiple Locations Thermofisher Scientific Full time

    **Job Overview**We are seeking a highly skilled Data Migration Specialist to join our team at Thermofisher Scientific. In this role, you will be responsible for collaborating with business users to understand requirements and recommending solutions.Key Responsibilities:Develop and validate aggregate safety reports.Troubleshoot and address end-user queries...

  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    Responsibilities :- Design, develop, and maintain efficient and reliable data pipelines using PySpark.- Implement ETL processes to ingest, transform, and load data from various sources.- Optimize PySpark code for performance and scalability.- Work with large datasets and distributed computing frameworks.- Develop and maintain data quality checks and...


  • Anywhere in India/Multiple Locations Digihelic Solutions Private Limited Full time

    About the RoleThis is an exciting opportunity to work with a leading organization in the industry. As a Data Insights Specialist - Workday, you will be responsible for analyzing data from reports and dashboards to identify key trends, patterns, and insights.ResponsibilitiesAnalyze data from reports and dashboards to identify key trends, patterns, and...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Overview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Sureminds Full time

    As a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...

  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations Insight Global Full time

    Position : Data Engineer. Location : 100% Remote in India.Shift : Must be able to overlap with US team working 8 : 00am-5 : 00pm EST (Eastern Standard Time). Required Skills & Qualifications : .- 5-7+ years of experience as a Data Engineer.- Proficient in Apache Airflow and Google Cloud Platform (GCP).- Experience creating DAGs and workflows, monitoring...


  • Anywhere in India/Multiple Locations Mount Talent Consulting Full time

    We have an opportunities with the leading IT Service based company for the data migration specialist interested candidates can drop their Cv's here. Skills Required : Salesforce Data Migration Specialist with 10 years of experience with Strong IICS experience is must (Salesforce Admin+ Salesforce Data Migration+ IICS/ Informatica Cloud exp....

  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full time

    Job Title : Data EngineerExperience : 5 to 8 YearsLocation : RemoteContract : 6 months to 1 yearJob Description :We are seeking a skilled Data Engineer to assist in designing and implementing Snowflake-based analytics solutions on AWS. The ideal candidate will have experience in data lake and data warehouse architecture, data integration, and pipeline...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Patch Infotech Private Limited Full time

    Key Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...

  • Data Engineer

    20 minutes ago


    Anywhere in India/Multiple Locations Techno Comp Computer services pvt Ltd Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Techno Comp Computer Services Pvt Ltd.About the Role:Design, develop, and maintain scalable and robust data pipelines for collecting, processing, and transforming large datasets.Implement ETL (Extract, Transform, Load) processes to ensure efficient movement of data...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations CA-One Tech Cloud Full time

    Job Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...

  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.- Develop and implement data validation and testing processes to ensure that data is processed accurately and...