Current jobs related to Enterprise Data Pipeline Architect - Anywhere in IndiaMultiple Locations - MWIDM Staffing Services


  • Anywhere in India/Multiple Locations MindBrain Full time

    About the RoleMindBrain's Senior ETL Developer will be responsible for designing, building, and maintaining robust ETL pipelines using Databricks and Snowflake. This role involves collaborating with data scientists and analysts to deliver actionable insights, developing and managing data integrations, and implementing cloud-based data solutions on AWS and...


  • India Teladoc Health Full time

    Job Title: Senior Data Integration EngineerDescription:Our company is seeking a highly skilled Senior Data Integration Engineer to join our team.This role involves designing and optimizing data pipelines, integrating data from multiple enterprise applications.Responsibilities include developing and maintaining data workflows in Alteryx, administering Alteryx...


  • Anywhere in India/Multiple Locations Resource Tree Global Services Full time

    Enterprise Data SpecialistWe are seeking an experienced Enterprise Data Specialist to join our team at Resource Tree Global Services. As a key member of our organization, you will play a critical role in building and maintaining the data infrastructure that powers key business decisions across various domains.Your primary responsibility will be to design,...


  • India Cybyrotek Solutions Full time

    Job Title: Data ArchitectCybyrotek Solutions is seeking a highly motivated and experienced Data Architect to lead our data integration and engineering efforts. As a key member of our team, you will be responsible for designing, implementing, and maintaining efficient data pipelines using industry-standard tools and programming languages.Key...

  • Cloud Data Architect

    21 hours ago


    Anywhere in India/Multiple Locations Follex Technology Full time

    About the PositionWe are seeking an experienced Cloud Data Architect to join our data engineering team. As a key member of our team, you will be responsible for designing and implementing robust data ingestion pipelines for both structured and unstructured data.ResponsibilitiesDesign and implement data pipelines for unstructured data (e.g., images,...

  • Data Architect

    2 weeks ago


    Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    Job Title : Data Architect Location : Mahadevpura - Bangalore Experience : 10 + Years Notice Period : Immediate to 30 DaysJob Description : Data Integration : - Design and implement data integration workflows to connect disparate systems (e.g., APIs, ETL/ELT tools, and data lakes). - Work with stakeholders to understand data requirements and ensure...


  • Anywhere in India/Multiple Locations Follex Technology Full time

    Job DescriptionFollex Technology is looking for a talented Sr. Data Engineer to lead our data engineering efforts. As a senior member of our team, you will be responsible for developing and managing robust data ingestion pipelines for both structured and unstructured data.Key ResponsibilitiesDevelop and manage data pipelines for unstructured data (e.g.,...


  • Anywhere in India/Multiple Locations NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Akira Insights is a boutique pure-play Data & Analytics consulting firm providing services to Multinational corporations, Large enterprises, and Fortune 500s from various sectors helping businesses unlock valuable insights from their data. Responsibilities : - Collaborate with stakeholders to understand business requirements and translate them into scalable...


  • Anywhere in India/Multiple Locations Optivalue tek consulting Full time

    About the Job:We are seeking an experienced Cloud Infrastructure Specialist to join our team at Optivalue Tek Consulting. As a key member of our team, you will be responsible for designing, implementing, and maintaining robust CI/CD pipelines for Salesforce deployments.Key Responsibilities:Design and implement Azure DevOps pipelines for Salesforce CI/CD...

  • Data Architect

    6 days ago


    Anywhere in India/Multiple Locations Resource Tree Global Services Full time

    Job DescriptionWe are seeking a highly skilled Data Architect to join our team at Resource Tree Global Services. As a key member of our organization, you will play a critical role in building and maintaining the data infrastructure that powers key business decisions across various domains.Your primary responsibility will be to design, develop, and maintain...


  • India Sonata Software Full time

    About Sonata Software In today's market, we observe a distinct duality in technology adoption. On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their digital storefronts, aiming to appeal to both consumers and B2B customers alike. As a leading Modernization Engineering company, we aim to...


  • India Sonata Software Full time

    About Sonata SoftwareIn today's market, we observe a distinct duality in technology adoption. On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their digital storefronts, aiming to appeal to both consumers and B2B customers alike.As a leading Modernization Engineering company, we aim to...


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    Job Title : Data Architect. Required Experience : 7+ years. We are looking for an experienced Senior Data Architect to join our team. You will be responsible for large-scale data ingestion, cleaning, and standardization from diverse data sources into Microsoft SQL Server. The ideal candidate will have expertise in creating efficient data pipelines, writing...

  • Cloud Data Architect

    15 hours ago


    Anywhere In India/multiple Locations Genpact Full time

    About GenpactGenpact is a global professional services and solutions firm delivering impactful outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients.We serve leading enterprises, including the Fortune Global 500, with our deep...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full time

    Job Title : Data EngineerExperience : 5 to 8 YearsLocation : RemoteContract : 6 months to 1 yearJob Description :We are seeking a skilled Data Engineer to assist in designing and implementing Snowflake-based analytics solutions on AWS. The ideal candidate will have experience in data lake and data warehouse architecture, data integration, and pipeline...


  • India Enterprise Minds, Inc Full time

    Job Summary:">We are seeking an experienced Senior Cloud Data Engineer to lead the design and implementation of scalable, high-performance data pipelines across Azure, AWS, and Google Cloud platforms.">Responsibilities:">">Design and Implement Data Pipelines: Use cloud services to architect and implement data pipelines that meet business needs.">Lead a Team...


  • India Xped pvt Ltd Full time

    Job DescriptionXped pvt Ltd is seeking an experienced Data Pipeline Architect to design, develop, and maintain scalable data pipelines for efficient extraction, transformation, and loading of data from diverse sources. The ideal candidate will have a strong expertise in writing clean, efficient, and maintainable code, with a deep understanding of design...


  • Anywhere in India/Multiple Locations Info Services Full time

    About Info Services">At Info Services, we're committed to empowering our clients with actionable insights through innovative data solutions. We're seeking a highly skilled Senior Azure Data Engineer to join our team and drive the development of cutting-edge data pipelines and architectures.">Job Description">">Design and Develop Robust Data Pipelines:...


  • Anywhere in India/Multiple Locations PROXIMITY LABS PRIVATE LIMITED Full time

    Company Overview">At Proximity Labs Private Limited, we are dedicated to pushing the boundaries of what is possible with AI/ML technology. Our team of experts is passionate about creating innovative solutions that drive real-world impact.">Job Summary">We are seeking a seasoned Senior Solutions Architect to join our team and lead the design, development, and...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Title : Data Engineer - DBTExperience : 5 - 8 YearsLocation : GurgaonNotice period : 15 DaysJob Type : FTE/C2HWork Mode : RemoteJob Responsibilities : - Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS- Requirements definition, source data analysis and profiling, the logical...

Enterprise Data Pipeline Architect

1 week ago


Anywhere in IndiaMultiple Locations MWIDM Staffing Services Full time

About the Role

We are seeking an Enterprise Data Pipeline Architect to join our team at MWIDM Staffing Services. The ideal candidate will have a strong background in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing ETL processes to ingest, transform, and load data from various sources, optimizing PySpark code for performance and scalability, and working with large datasets and distributed computing frameworks.

Key Responsibilities:

  • Design, develop, and maintain efficient and reliable data pipelines using PySpark.
  • Implement ETL processes to ingest, transform, and load data from various sources.
  • Optimize PySpark code for performance and scalability.
  • Work with large datasets and distributed computing frameworks.
  • Develop and maintain data quality checks and monitoring processes.
  • Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver data solutions.
  • Build and deploy data pipelines to production environments.
  • Troubleshoot and debug data pipeline issues.

Requirements:

  • 5+ years of experience in data engineering.
  • Strong proficiency in Python and PySpark.
  • Deep understanding of Spark architecture and its core components.
  • Experience with data warehousing concepts and dimensional modeling.
  • Proficiency in SQL and experience writing complex queries.
  • Experience with data ingestion tools and techniques.
  • Experience with data transformation and cleansing.
  • Experience with data quality monitoring and validation.
  • Experience with workflow management tools (Airflow, Luigi).
  • Experience with version control systems (Git).