Data Ingestion Specialist
5 days ago
We are seeking a seasoned Data Ingestion Specialist to lead the design, development, and maintenance of scalable data ingestion pipelines using Apache NiFi. This role requires close collaboration with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems.
Responsibilities
1. Design and Develop Data Pipelines: Create and optimize NiFi data flows to ingest data from diverse sources (e.g., databases, files, APIs) into target systems (e.g., data warehouses, lakes, or processing engines).
2. Configure NiFi Components: Set up and configure NiFi components, including processors, controllers, and services, to guarantee efficient data processing and movement.
3. Implement Data Transformation and Enrichment: Apply data transformation and enrichment techniques using NiFi's built-in processors and custom scripts (e.g., Groovy) to prepare data for target systems.
4. Integrate with Other Systems: Integrate NiFi with other systems, such as data warehouses, lakes, or processing engines, to ensure seamless data flow.
5. Monitor and Troubleshoot: Monitor NiFi data flows and troubleshoot issues, ensuring high availability and performance.
6. Collaborate with Stakeholders: Work closely with data architects, engineers, and stakeholders to understand requirements, design data ingestion pipelines, and ensure successful implementation.
7. Maintain and Update Existing Pipelines: Update and maintain existing NiFi data ingestion pipelines to ensure they remain efficient, scalable, and compliant with changing requirements.
-
Data Ingestion Specialist
7 days ago
India hotsourced Full timeWe are looking for a skilled Data Ingestion Specialist to join our team at Hotsourced. As a key member of our engineering team, you will be responsible for implementing, maintaining, and scaling our content ingestion processes.This role is perfect for someone who thrives on building scalable web scraping solutions and maintaining smooth production...
-
Data Ingestion Specialist
19 hours ago
Anywhere in India/Multiple Locations Follex Technology Full timeAbout the RoleFollex Technology is seeking a highly skilled Data Ingestion Specialist to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing robust data ingestion pipelines for both structured and unstructured data.ResponsibilitiesDesign and implement data pipelines for unstructured data...
-
Data Ingestion Lead/Specialist
5 days ago
India Vision Excel Career Solutions Full timeJob locations : Bangalore/ Hyderabad/ Pune/ Greater Noida Experience : 8-16 Yrs We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various...
-
Data Ingestion Lead/Specialist
2 weeks ago
India Vision Excel Career Solutions Full timeJob locations : Bangalore/ Hyderabad/ Pune/ Greater NoidaExperience : 8-16 YrsWe are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various...
-
Apache Druid Data Ingestion Specialist
19 hours ago
India AppSierra Solutions Pvt Ltd Full timeJob Description: We are seeking a highly skilled Data Ingestion Expert with extensive experience in designing and developing robust data pipelines, particularly leveraging technologies such as Kafka, HDFS, and S3. In this role, you will be responsible for managing and optimizing Druid cluster configurations for performance and availability.Key...
-
NiFi/Data Ingestion Engineer
5 days ago
India Vision Excel Career Solutions Full timeJob requirements : We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems. The role requires strong...
-
Data Ingestion Pipeline Developer
5 days ago
India Vision Excel Career Solutions Full timeJob Summary: We are seeking a highly skilled Data Ingestion Pipeline Developer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. This role requires strong understanding of data integration, ETL processes, and NiFi architecture.About the Role: As a Data Ingestion Pipeline Developer, you will work closely with data...
-
Data Engineer
3 hours ago
India Hexaconcepts Full timeAbout HexaconceptsWe are a fast-growing data-science company serving clients across various industries and geographies.Job DescriptionThe ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines for streaming data ingestion. This role involves implementing and managing data processing frameworks using Apache...
-
Data Pipeline Specialist
4 days ago
India Coders Brain Technology Private Limited Full timeJob SummaryWe are looking for a highly skilled Data Pipeline Specialist to join our team at Coders Brain Technology Private Limited. As a Data Pipeline Specialist, you will be responsible for designing and implementing data pipelines using DBT, Snowflake, and AWS services. The ideal candidate will have experience with data engineering, Snowflake, and AWS...
-
Senior Data Engineer
3 days ago
India Data Unveil Full timeAbout Data UnveilData Unveil is a cutting-edge technology firm that empowers businesses with innovative data solutions.We are looking for a highly skilled Python Developer to join our team. As a Python Developer at Data Unveil, you will play a key role in developing and optimizing ETL workflows and data pipelines using Python and PySpark.Key...
-
Data Engineer Specialist
4 days ago
India Cloud 9 Infosystems Full timeJob DescriptionWe are seeking a skilled Data Engineer Specialist to join our team at Cloud 9 Infosystems. The ideal candidate will have hands-on experience in designing and implementing data solutions using Microsoft Azure Fabric.The successful candidate will be responsible for creating and maintaining scalable and efficient data pipelines using Azure...
-
Data Infrastructure Specialist
4 days ago
India Mydbops Full time**Job Responsibilities**We are seeking a highly skilled Data Infrastructure Specialist to join our team at Mydbops. This role requires a deep understanding of PostgreSQL internals, strong SQL skills, and a passion for data management best practices.Design, implement, and maintain PostgreSQL databases, including schema design, data modeling, and performance...
-
Data Engineer Specialist
6 days ago
India Droisys Full timeJob DescriptionDroisys is a leading provider of data engineering services. We are seeking an experienced Data Engineer Specialist to join our team.The successful candidate will be responsible for designing and building data pipelines that adhere to the Medallion architecture. This includes creating efficient data storage and processing systems using...
-
Data Engineering Specialist
4 days ago
India Anlage Infotech Pvt Ltd Full timeTechnical ExpertiseAnlage Infotech Pvt Ltd is seeking a highly skilled Data Engineering Specialist to join our team. In this role, you will be responsible for designing and developing scalable frameworks for data processing and transformation using Python and Azure cloud services.The ideal candidate will have hands-on experience with Azure cloud services,...
-
Data Engineer
4 days ago
India Tredence Analytics Solutions Private Limited Full timeCompany Overview:">Tredence Analytics Solutions Private Limited is a leading analytics firm that helps businesses make data-driven decisions.">About the Role:">We are seeking an experienced Data Engineer to join our team as a Customer Journey Specialist. As a key member of our analytics team, you will be responsible for designing and implementing customer...
-
Senior Data Pipeline Specialist
4 days ago
India Tek Ninjas Full timeWe're looking for a skilled Senior Data Pipeline Specialist to join our team at Tek Ninjas. In this role, you'll be responsible for designing, developing, and optimizing data pipelines and workflows to support analytics and reporting requirements.Responsibilities:Design and develop data pipelines for efficient data ingestion and transformation.Implement data...
-
Big Data Pipeline Specialist
4 days ago
India Vishanz Business Services Private Limited Full timeJob Overview:Vishanz Business Services Private Limited is seeking a Big Data Pipeline Specialist to design, develop, and maintain robust and scalable data pipelines using Google Cloud Platform (GCP) services. The ideal candidate will have extensive experience with GCP data services, including BigQuery, DBT & Streaming, Dataflow, Pub/Sub, Cloud Storage, and...
-
Senior Data Infrastructure Specialist
5 days ago
India Loyalytics AI Full timeLoyalytics AI is looking for a Senior Data Infrastructure Specialist to lead the development and maintenance of our data infrastructure and pipelines. This is a unique opportunity to work with a growing company and make a significant impact on our data engineering team.Responsibilities:Design and Develop Data Pipelines: Create robust and scalable data...
-
Data Insights Specialist
3 days ago
India Hudson RPO Full timeJob OverviewThe Data Analyst III role is a key part of the Commodities Gas & LNG Data group at Hudson RPO. This position involves working closely with Research, Data and Product functions to build, enhance, and maintain data that underpins our unique understanding of the energy and natural resources sectors.Main ResponsibilitiesDevelop a strong understanding...
-
Data Quality Assurance Specialist
4 days ago
India 1HResource Solutions Full timeJob SummaryWe are seeking a skilled Data Quality Assurance Specialist to join 1HResource Solutions and ensure the quality and reliability of our Data & Analytics projects. The ideal candidate will have experience in testing data pipelines, ETL processes, data warehouses, and reporting solutions.The successful Quality Engineer for Data Solutions will work...