Large Scale Data Ingestion Specialist

4 days ago


Anywhere in IndiaMultiple Locations Aventior Digital Private Limited Full time

Large Scale Data Ingestion Specialist

Aventior Digital Private Limited is seeking an experienced Large Scale Data Ingestion Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and managing large-scale data ingestion processes into Microsoft SQL Server.

Key Responsibilities:

  • Design and implement mass data ingestion processes into MSSQL Server from various data sources.
  • Clean, transform, and standardize large data sets to ensure data integrity and consistency.
  • Write and optimize complex stored procedures to process and clean data efficiently.
  • Develop, deploy, and maintain ETL pipelines using SSIS and Azure Data Factory.
  • Build and automate data pipelines using Python for continuous data integration and transformation.
  • Collaborate with stakeholders to define and implement data quality standards and ensure adherence.

Requirements:

  • 7+ years of experience as a data engineer working with large-scale data systems.
  • Strong proficiency in Microsoft SQL Server, including expertise in writing and optimizing stored procedures.


  • India ValueLabs Full time

    Data Ingestion Specialist Wanted for ValueLabs!We are looking for an experienced Data Ingestion Specialist to join our team at ValueLabs. The successful candidate will have a strong understanding of Splunk data ingestion strategies and be able to design and implement efficient data pipelines.In this role, you will work closely with our engineering team to...


  • India hotsourced Full time

    We are looking for a skilled Data Ingestion Specialist to join our team at Hotsourced. As a key member of our engineering team, you will be responsible for implementing, maintaining, and scaling our content ingestion processes.This role is perfect for someone who thrives on building scalable web scraping solutions and maintaining smooth production...


  • India Vision Excel Career Solutions Full time

    Job OverviewWe are seeking a seasoned Data Ingestion Specialist to lead the design, development, and maintenance of scalable data ingestion pipelines using Apache NiFi. This role requires close collaboration with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems.Responsibilities1. Design and...

  • Data Architect Lead

    4 days ago


    Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    Job DescriptionAventior Digital Private Limited is seeking an experienced Data Architect Lead to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and managing large-scale data ingestion processes into Microsoft SQL Server.Key Responsibilities:Design and implement mass data ingestion processes...


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    About the RoleWe are looking for a highly skilled Senior Data Engineering Manager to lead our data engineering team. The successful candidate will have extensive experience in designing and implementing large-scale data ingestion processes, as well as expertise in ETL tools such as SSIS and Azure Data Factory.Key Responsibilities:Manage and lead a team of...


  • Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    About MWIDM Staffing ServicesWe are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.Job Description:The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing...


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    Job Title : Data Architect. Required Experience : 7+ years. We are looking for an experienced Senior Data Architect to join our team. You will be responsible for large-scale data ingestion, cleaning, and standardization from diverse data sources into Microsoft SQL Server. The ideal candidate will have expertise in creating efficient data pipelines, writing...


  • Anywhere in India/Multiple Locations AFFLUENT GLOBAL SERVICES PRIVATE LIMITED Full time

    Job OverviewAffluent Global Services Private Limited is seeking an experienced Enterprise Data Management specialist to join our team. As an Oracle EDMCS Developer, you will be responsible for designing and implementing large-scale Master Data Management (MDM) applications.About the RoleThis role involves working on the design, implementation, and support of...


  • India Vision Excel Career Solutions Full time

    Job locations : Bangalore/ Hyderabad/ Pune/ Greater Noida Experience : 8-16 Yrs We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various...


  • India Vision Excel Career Solutions Full time

    Job locations : Bangalore/ Hyderabad/ Pune/ Greater NoidaExperience : 8-16 YrsWe are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various...


  • Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    About the RoleWe are seeking an Enterprise Data Pipeline Architect to join our team at MWIDM Staffing Services. The ideal candidate will have a strong background in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing ETL processes to ingest, transform, and load data from...

  • Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    Responsibilities :- Design, develop, and maintain efficient and reliable data pipelines using PySpark.- Implement ETL processes to ingest, transform, and load data from various sources.- Optimize PySpark code for performance and scalability.- Work with large datasets and distributed computing frameworks.- Develop and maintain data quality checks and...

  • Big Data Architect

    6 days ago


    Anywhere in India/Multiple Locations Insight Global Full time

    Job DetailsWe are seeking an experienced Data Engineer to join our team at Insight Global. This is a 100% remote position, allowing for flexibility and work-life balance. The ideal candidate will have strong proficiency in Python and SQL, as well as experience with data visualization tools such as Tableau or Looker.Responsibilities:Build, maintain, and scale...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Follex Technology Full time

    Data Engineer : 12+ years of experience)Any Location (Gurgaon, Pune, Bangalore, Chennai, Bhopal, Jaipur)Work Mode: 3 Days / week or 12 Days / Month - Work from OfficeInterview Rounds : 2 TechnicalRole : Sr. Data Engineer Job Description : The Senior Data Engineer will be responsible for developing and managing robust data ingestion pipelines for both...


  • Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full time

    Company Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...


  • Anywhere in India/Multiple Locations Resource Tree Global Services Full time

    Enterprise Data SpecialistWe are seeking an experienced Enterprise Data Specialist to join our team at Resource Tree Global Services. As a key member of our organization, you will play a critical role in building and maintaining the data infrastructure that powers key business decisions across various domains.Your primary responsibility will be to design,...


  • Anywhere in India/Multiple Locations PRONTO CONSULTING SERVICES Full time

    Job Overview We are seeking an exceptional Enterprise Cloud Migration Specialist to join our team at Pronto Consulting Services. In this role, you will lead large-scale cloud migration projects, ensuring seamless transitions to Oracle Cloud Infrastructure for our clients. Key Responsibilities:Plan and execute large-scale cloud migrations to Oracle Cloud...


  • Anywhere in India/Multiple Locations MindBrain Full time

    Job Title : Senior Lead Java Developer - Spark, Azure, Redpanda Expert. Experience Level : Senior/Lead (13+ years of experience). Job Description : We are seeking a highly skilled Senior Lead Java Developer with expertise in Apache Spark, Azure Data Services (ADLS, Azure Blob Storage, Azure Databases), and Redpanda. In this role, you will design, architect,...


  • India Vision Excel Career Solutions Full time

    Job requirements : We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems. The role requires strong...


  • India Vision Excel Career Solutions Full time

    Job Summary: We are seeking a highly skilled Data Ingestion Pipeline Developer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. This role requires strong understanding of data integration, ETL processes, and NiFi architecture.About the Role: As a Data Ingestion Pipeline Developer, you will work closely with data...