Data Ingestion Lead/Specialist

1 week ago


India Vision Excel Career Solutions Full time

Job locations : Bangalore/ Hyderabad/ Pune/ Greater Noida Experience : 8-16 Yrs We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems. The role requires strong understanding of data integration, ETL processes, and NiFi architecture. Responsibilities : 1. Design and Develop Data Ingestion Pipelines : Create and optimize NiFi data flows to ingest data from various sources (e.g., databases, files, APIs) into target systems (e.g., data warehouses, lakes, or processing engines). 2. Configure NiFi Components : Set up and configure NiFi components, including processors, controllers, and services, to ensure efficient data processing and movement. 3. Implement Data Transformation and Enrichment : Apply data transformation and enrichment techniques using NiFi's built-in processors and custom scripts (e.g., Groovy) to prepare data for target systems. 4. Integrate with Other Systems : Integrate NiFi with other systems, such as data warehouses, lakes, or processing engines, to ensure seamless data flow. 5. Monitor and Troubleshoot : Monitor NiFi data flows and troubleshoot issues, ensuring high availability and performance. 6. Collaborate with Stakeholders : Work closely with data architects, engineers, and stakeholders to understand requirements, design data ingestion pipelines, and ensure successful implementation. 7. Maintain and Update Existing Pipelines : Update and maintain existing NiFi data ingestion pipelines to ensure they remain efficient, scalable, and compliant with changing requirements. (ref:hirist.tech)



  • Anywhere in India/Multiple Locations Follex Technology Full time

    About the RoleFollex Technology is seeking a highly skilled Data Ingestion Specialist to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing robust data ingestion pipelines for both structured and unstructured data.ResponsibilitiesDesign and implement data pipelines for unstructured data...

  • Data Ingestion Expert

    24 hours ago


    India Vision Excel Career Solutions Full time

    Job Overview:Welcome to Vision Excel Career Solutions, where we are seeking an experienced Data Ingestion Engineer to join our team. This role requires a strong understanding of data integration, ETL processes, and NiFi architecture.Key Responsibilities:Design and Develop Data Ingestion Pipelines: Create and optimize NiFi data flows to ingest data from...


  • India AppSierra Solutions Pvt Ltd Full time

    Job Description: We are seeking a highly skilled Data Ingestion Expert with extensive experience in designing and developing robust data pipelines, particularly leveraging technologies such as Kafka, HDFS, and S3. In this role, you will be responsible for managing and optimizing Druid cluster configurations for performance and availability.Key...


  • India Vision Excel Career Solutions Full time

    Job requirements : We are seeking an experienced NiFi Data Ingestion Engineer to design, develop, and maintain scalable data ingestion pipelines using Apache NiFi. The successful candidate will work closely with data architects, engineers, and stakeholders to ensure seamless data flow from various sources to target systems. The role requires strong...

  • Data Engineer

    3 days ago


    India Hexaconcepts Full time

    About HexaconceptsWe are a fast-growing data-science company serving clients across various industries and geographies.Job DescriptionThe ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines for streaming data ingestion. This role involves implementing and managing data processing frameworks using Apache...


  • India Easy Recruit Global Full time

    Job Summary:We are looking for a skilled Cloud Data Architecture Specialist to join our team at Easy Recruit Global. As a key member of our data architecture team, you will be responsible for designing and implementing cloud data platforms that meet our business needs.Your expertise in Microsoft technologies, including ADF, Synapse, Power BI, and Microsoft...


  • India Coders Brain Technology Private Limited Full time

    Job SummaryWe are looking for a highly skilled Data Pipeline Specialist to join our team at Coders Brain Technology Private Limited. As a Data Pipeline Specialist, you will be responsible for designing and implementing data pipelines using DBT, Snowflake, and AWS services. The ideal candidate will have experience with data engineering, Snowflake, and AWS...


  • India Data Unveil Full time

    About Data UnveilData Unveil is a cutting-edge technology firm that empowers businesses with innovative data solutions.We are looking for a highly skilled Python Developer to join our team. As a Python Developer at Data Unveil, you will play a key role in developing and optimizing ETL workflows and data pipelines using Python and PySpark.Key...


  • India Tredence Analytics Solutions Private Limited Full time

    About the Role: ">We are seeking an experienced Data Engineer to join our team as a Customer Journey Specialist. As a key member of our analytics team, you will be responsible for designing and implementing customer journey solutions using Adobe Experience Platform (AEP) and Adobe Journey Optimizer (AJO). The successful candidate will have hands-on...


  • India Cloud 9 Infosystems Full time

    Job DescriptionWe are seeking a skilled Data Engineer Specialist to join our team at Cloud 9 Infosystems. The ideal candidate will have hands-on experience in designing and implementing data solutions using Microsoft Azure Fabric.The successful candidate will be responsible for creating and maintaining scalable and efficient data pipelines using Azure...


  • India Aricent Full time

    About the Role:The IT Data Engineer Manager will be an integral part of an Agile team focused on delivering best-in-class business intelligence. Under the general supervision of senior management and the Data Integration Chapter Lead in the Enterprise Data Product Portfolio, this role will work with key customers to deliver timely and accurate data ingestion...

  • Data Engineer

    7 days ago


    India Tredence Analytics Solutions Private Limited Full time

    Company Overview:">Tredence Analytics Solutions Private Limited is a leading analytics firm that helps businesses make data-driven decisions.">About the Role:">We are seeking an experienced Data Engineer to join our team as a Customer Journey Specialist. As a key member of our analytics team, you will be responsible for designing and implementing customer...


  • India Vishanz Business Services Private Limited Full time

    Company Overview:Vishanz Business Services Private Limited is a leading provider of cloud-based solutions and services. Our team of experts helps clients leverage the power of cloud computing to drive business innovation and growth.We are seeking an experienced Data Engineer Lead to join our team. As a key member of our data engineering team, you will be...


  • India Mydbops Full time

    **Job Responsibilities**We are seeking a highly skilled Data Infrastructure Specialist to join our team at Mydbops. This role requires a deep understanding of PostgreSQL internals, strong SQL skills, and a passion for data management best practices.Design, implement, and maintain PostgreSQL databases, including schema design, data modeling, and performance...


  • India Insight Global Full time

    Job Description:We are seeking a highly skilled Data Governance Specialist to join our team at Insight Global. In this role, you will be responsible for working with both business and technical subject matter experts to ensure standardization of operational information and execution of enterprise-wide data governance policies and procedures.About the...


  • India Applied Data Finance Full time

    At Applied Data Finance, we are looking for a seasoned analytics professional to drive our customer acquisition efforts. As our desired candidate, you will possess a unique blend of analytical acumen and leadership prowess, with a proven track record of delivering high-impact results in a fast-paced environment.The successful candidate will have extensive...

  • Lead Data Architect

    1 week ago


    India Ecode Dash Pvt Ltd Full time

    Role : Lead Data Architect (AWS, Data Lakes, Warehousing, Governance) Job Description : Key Responsibilities : Data Lake & Warehousing Architecture : - Redesign the existing data lake in AWS using Delta Lake or Iceberg architecture. - Optimize the data warehousing layer using technologies such as Redshift, Snowflake, and Databricks. Data Ingestion &...


  • India LEAD School Full time

    Job DescriptionJob Title: SEO SpecialistLocation: MumbaiExperience: 35 YearsType: Full-timeAbout Us:LEAD Group is a leading edtech organization transforming school education in Indiathrough cutting-edge teaching-learning solutions. We are looking for a skilled SEOSpecialist to join our growing marketing team and help drive organic growth andlead generation...


  • India LEAD School Full time

    Company OverviewLEAD School is a leading edtech organization revolutionizing school education in India by providing cutting-edge teaching-learning solutions.Role DescriptionWe are seeking a skilled SEO Specialist to join our growing marketing team and drive organic growth and lead generation for our brand as we continue to scale...


  • India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Job OverviewTalentola Solutions Private Limited is seeking an experienced Data Engineering Lead to spearhead the design, development, and maintenance of robust ETL and ELT pipelines. The ideal candidate will have a strong background in cloud-based data platforms like Snowflake and a passion for building scalable data solutions.As a Data Engineering Lead, you...