Data Ingestion Specialist

5 days ago


India Vision Excel Career Solutions Full time
Job Overview

We are seeking a seasoned Data Ingestion Specialist to lead the design, development, and maintenance of scalable data ingestion pipelines using Apache NiFi. This role requires close collaboration with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems.

Responsibilities
1. Design and Develop Data Pipelines: Create and optimize NiFi data flows to ingest data from diverse sources (e.g., databases, files, APIs) into target systems (e.g., data warehouses, lakes, or processing engines).
2. Configure NiFi Components: Set up and configure NiFi components, including processors, controllers, and services, to guarantee efficient data processing and movement.
3. Implement Data Transformation and Enrichment: Apply data transformation and enrichment techniques using NiFi's built-in processors and custom scripts (e.g., Groovy) to prepare data for target systems.
4. Integrate with Other Systems: Integrate NiFi with other systems, such as data warehouses, lakes, or processing engines, to ensure seamless data flow.
5. Monitor and Troubleshoot: Monitor NiFi data flows and troubleshoot issues, ensuring high availability and performance.
6. Collaborate with Stakeholders: Work closely with data architects, engineers, and stakeholders to understand requirements, design data ingestion pipelines, and ensure successful implementation.
7. Maintain and Update Existing Pipelines: Update and maintain existing NiFi data ingestion pipelines to ensure they remain efficient, scalable, and compliant with changing requirements.

  • India hotsourced Full time

    We are looking for a skilled Data Ingestion Specialist to join our team at Hotsourced. As a key member of our engineering team, you will be responsible for implementing, maintaining, and scaling our content ingestion processes.This role is perfect for someone who thrives on building scalable web scraping solutions and maintaining smooth production...


  • Anywhere in India/Multiple Locations Follex Technology Full time

    About the RoleFollex Technology is seeking a highly skilled Data Ingestion Specialist to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing robust data ingestion pipelines for both structured and unstructured data.ResponsibilitiesDesign and implement data pipelines for unstructured data...


  • India Vision Excel Career Solutions Full time

    Job locations : Bangalore/ Hyderabad/ Pune/ Greater Noida Experience : 8-16 Yrs We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various...


  • India Vision Excel Career Solutions Full time

    Job locations : Bangalore/ Hyderabad/ Pune/ Greater NoidaExperience : 8-16 YrsWe are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various...


  • India AppSierra Solutions Pvt Ltd Full time

    Job Description: We are seeking a highly skilled Data Ingestion Expert with extensive experience in designing and developing robust data pipelines, particularly leveraging technologies such as Kafka, HDFS, and S3. In this role, you will be responsible for managing and optimizing Druid cluster configurations for performance and availability.Key...


  • India Vision Excel Career Solutions Full time

    Job requirements : We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems. The role requires strong...


  • India Vision Excel Career Solutions Full time

    Job Summary: We are seeking a highly skilled Data Ingestion Pipeline Developer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. This role requires strong understanding of data integration, ETL processes, and NiFi architecture.About the Role: As a Data Ingestion Pipeline Developer, you will work closely with data...

  • Data Engineer

    3 hours ago


    India Hexaconcepts Full time

    About HexaconceptsWe are a fast-growing data-science company serving clients across various industries and geographies.Job DescriptionThe ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines for streaming data ingestion. This role involves implementing and managing data processing frameworks using Apache...


  • India Coders Brain Technology Private Limited Full time

    Job SummaryWe are looking for a highly skilled Data Pipeline Specialist to join our team at Coders Brain Technology Private Limited. As a Data Pipeline Specialist, you will be responsible for designing and implementing data pipelines using DBT, Snowflake, and AWS services. The ideal candidate will have experience with data engineering, Snowflake, and AWS...


  • India Data Unveil Full time

    About Data UnveilData Unveil is a cutting-edge technology firm that empowers businesses with innovative data solutions.We are looking for a highly skilled Python Developer to join our team. As a Python Developer at Data Unveil, you will play a key role in developing and optimizing ETL workflows and data pipelines using Python and PySpark.Key...


  • India Cloud 9 Infosystems Full time

    Job DescriptionWe are seeking a skilled Data Engineer Specialist to join our team at Cloud 9 Infosystems. The ideal candidate will have hands-on experience in designing and implementing data solutions using Microsoft Azure Fabric.The successful candidate will be responsible for creating and maintaining scalable and efficient data pipelines using Azure...


  • India Mydbops Full time

    **Job Responsibilities**We are seeking a highly skilled Data Infrastructure Specialist to join our team at Mydbops. This role requires a deep understanding of PostgreSQL internals, strong SQL skills, and a passion for data management best practices.Design, implement, and maintain PostgreSQL databases, including schema design, data modeling, and performance...


  • India Droisys Full time

    Job DescriptionDroisys is a leading provider of data engineering services. We are seeking an experienced Data Engineer Specialist to join our team.The successful candidate will be responsible for designing and building data pipelines that adhere to the Medallion architecture. This includes creating efficient data storage and processing systems using...


  • India Anlage Infotech Pvt Ltd Full time

    Technical ExpertiseAnlage Infotech Pvt Ltd is seeking a highly skilled Data Engineering Specialist to join our team. In this role, you will be responsible for designing and developing scalable frameworks for data processing and transformation using Python and Azure cloud services.The ideal candidate will have hands-on experience with Azure cloud services,...

  • Data Engineer

    4 days ago


    India Tredence Analytics Solutions Private Limited Full time

    Company Overview:">Tredence Analytics Solutions Private Limited is a leading analytics firm that helps businesses make data-driven decisions.">About the Role:">We are seeking an experienced Data Engineer to join our team as a Customer Journey Specialist. As a key member of our analytics team, you will be responsible for designing and implementing customer...


  • India Tek Ninjas Full time

    We're looking for a skilled Senior Data Pipeline Specialist to join our team at Tek Ninjas. In this role, you'll be responsible for designing, developing, and optimizing data pipelines and workflows to support analytics and reporting requirements.Responsibilities:Design and develop data pipelines for efficient data ingestion and transformation.Implement data...


  • India Vishanz Business Services Private Limited Full time

    Job Overview:Vishanz Business Services Private Limited is seeking a Big Data Pipeline Specialist to design, develop, and maintain robust and scalable data pipelines using Google Cloud Platform (GCP) services. The ideal candidate will have extensive experience with GCP data services, including BigQuery, DBT & Streaming, Dataflow, Pub/Sub, Cloud Storage, and...


  • India Loyalytics AI Full time

    Loyalytics AI is looking for a Senior Data Infrastructure Specialist to lead the development and maintenance of our data infrastructure and pipelines. This is a unique opportunity to work with a growing company and make a significant impact on our data engineering team.Responsibilities:Design and Develop Data Pipelines: Create robust and scalable data...


  • India Hudson RPO Full time

    Job OverviewThe Data Analyst III role is a key part of the Commodities Gas & LNG Data group at Hudson RPO. This position involves working closely with Research, Data and Product functions to build, enhance, and maintain data that underpins our unique understanding of the energy and natural resources sectors.Main ResponsibilitiesDevelop a strong understanding...


  • India 1HResource Solutions Full time

    Job SummaryWe are seeking a skilled Data Quality Assurance Specialist to join 1HResource Solutions and ensure the quality and reliability of our Data & Analytics projects. The ideal candidate will have experience in testing data pipelines, ETL processes, data warehouses, and reporting solutions.The successful Quality Engineer for Data Solutions will work...