Data Ingestion Expert

2 weeks ago


Chennai, India TekPillar Full time

Data Ingestion Expert


We are seeking an experienced Data Ingestion Expert to join our team at TekPillar. This role involves building data flows and data ingestion pipelines using Apache NiFi.

The ideal candidate will have strong hands-on experience with Apache NiFi and proficiency in Java for developing custom NiFi processors.

In addition, a solid understanding of distributed systems and cloud infrastructure, with experience in AWS, Azure, or GCP is required.

The successful candidate will also have experience with database systems like SQL and NoSQL technologies, as well as a solid understanding of the ELK stack (Elasticsearch, Logstash, Kibana).

Key Responsibilities:

  • Design and implement data ingestion pipelines using Apache NiFi
  • Develop custom NiFi processors using Java
  • Work with cloud infrastructure to deploy and manage data pipelines
  • Collaborate with cross-functional teams to ensure data quality and integrity

Requirements:

  • 3-5 years of experience in data ingestion and pipeline development
  • Strong hands-on experience with Apache NiFi
  • Proficiency in Java and experience with database systems
  • Solid understanding of distributed systems and cloud infrastructure

What We Offer:

  • Competitive salary and benefits package
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment
  • Recognition and rewards for outstanding performance


  • Chennai, Tamil Nadu, India Hexaware Technologies Full time

    Job Title: Data Integration ExpertJob Summary: We are seeking a highly skilled Data Integration Expert to join our team at Hexaware Technologies. The ideal candidate will have 4-9 years of experience in developing large-scale data pipelines in a cloud/on-prem environment.Key Responsibilities:Developing data ingest, validation, and transform pipelinesWorking...


  • Chennai, Tamil Nadu, India Hub Work Full time

    Hub Work - Data Architect Job DescriptionHub Work is seeking an experienced Data Architect to join our team. This role is responsible for designing, developing, and implementing end-to-end data ingestion and processing systems on the AWS platform.Key Responsibilities:• Design and develop data pipelines from source systems, including SAP Concur, Veeva...

  • Azure Data Engineer

    2 weeks ago


    Pune/Hyderabad/Bangalore/Chennai, India BSRI Solutions Full time

    Job Title: Azure Data EngineerJob Summary:We are seeking a seasoned Azure Data Engineer to lead our data engineering efforts. The ideal candidate will have a strong background in data engineering with a focus on Microsoft Azure services, specifically Azure Data Factory (ADF), Azure Synapse Analytics, Synapse Pipelines, Synapse Spark, and Synapse SQL...

  • Cloud FinOps Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Comcast Corporation Full time

    We are currently seeking a seasoned Lead Cloud Financial Operations Engineer to join our Cloud Centre of Excellence. The ideal candidate will possess in-depth expertise in leading work on SQL and data ETL pipelines and functions using cloud tools to ingest data from various sources. This role requires advanced understanding of cloud products, their usage,...

  • Decision Point

    3 weeks ago


    Chennai, India Decision Point Full time

    What would a typical day at your work be like :- You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals. - Build & support data ingestion and processing pipelines. This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and technologies. -...


  • Chennai, India RS Blooming Technologies Ltd. Full time

    Job Title: Artificial Intelligence EngineerWe are seeking a highly skilled AI Engineer to join our team at RS Blooming Technologies Ltd.About the RoleThe primary focus of this role is to design and implement solutions that enable seamless data ingestion from various sources and make it communicable with Large Language Models.Key ResponsibilitiesDesign and...

  • Data Modeling Expert

    3 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Modeling Expert to join our team in Chennai, Tamil Nādu (IN), India (IN). As a Scrum Master, you will be responsible for leading our data and analytics team in the development of innovative solutions using the latest technologies and methodologies.Key ResponsibilitiesTransform the application development by...


  • Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Title: Data Engineering ExpertAbout Us: At GAIUS HYPERLOCAL PRIVATE LIMITED, we're committed to harnessing the power of big data to drive innovation and business value.Job Description: We're seeking a highly skilled Data Engineering Expert to design, develop, and maintain scalable big data solutions using Apache Spark and other big data technologies.Key...


  • Chennai, Tamil Nadu, India Aspigile solution Full time

    Data Ingestion and Analytics ExpertKey Responsibilities:Develop and implement data pipelines for ingestion from various sources, including databases, websites, and flat files, into our internal database.Cleanse and preprocess structured and unstructured data to provide high-quality inputs for analytics applications, reports, and models.Create web-based...

  • Decision Point

    3 weeks ago


    Gurgaon/Gurugram/Chennai/Bangalore, IN Decision Point Full time

    What would a typical day at your work be like :- You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals. - Build & support data ingestion and processing pipelines. This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and technologies. -...

  • Data Handling

    5 months ago


    Chennai, India Elitez Recruitment Services Private Limited Full time

    **Roles and Responsibilities**: Prerequisites**:Proficient with PYTHON to handle Data Structures & JSON, CSV file formats**. Comfortable in scripting using **Python**. Bonus: Understands or have experience in **web** **scraping** Responsibilities: Receive & Process data from Internal tools, clean or enrich the data to suit the Deliverables. Update the...

  • Data Visualization

    5 months ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    We are currently seeking a Data Visualization to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). **Must Have** - BI Tool: Quick Sight (2 years ), other BI Tools ( 5 years) ,SQL Scripting Cloud : RDS,S3, IAM, Pipeline monitoring, Security, Logging and monitoring Services. - Database : RDS,SQL, Athena, Flat file - Devops Tools : Terraform ,GIT,GIT...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Altimetrik Full time

    Job Title: Data Engineer - Cloud ExpertWe are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP), particularly in BigQuery and Pub/Sub, coupled with advanced proficiency in Python. As a Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data pipelines, ensuring the smooth flow of data...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionAt NTT DATA, we are seeking an experienced Senior OpenShift Expert to join our team. As a Senior OpenShift Expert, you will be responsible for managing and maintaining Red Hat OpenShift/Kubernetes clusters, with a focus on installation, upgrade, and migration.Key ResponsibilitiesManage and maintain Red Hat OpenShift/Kubernetes clusters,...

  • Data Visualization

    4 months ago


    Chennai, India NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Visualization to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Must HaveBI Tool: Quick Sight...


  • Chennai, Tamil Nadu, India Ciklum Full time

    Data Engineer Expert OpportunityAbout CiklumCiklum, a custom product engineering company, is seeking a highly skilled Data Engineer Expert to join our team in India.We are a global team of over 4,000 developers, consultants, analysts, and product owners who engineer technology that redefines industries and shapes the way people live.About the RoleAs a Data...

  • Data Architect

    2 weeks ago


    Chennai, Tamil Nadu, India Hub Work Full time

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Hub Work. As a key member of our data team, you will be responsible for designing, developing, and implementing end-to-end data ingestion and processing systems on the AWS platform.Key Responsibilities:Design and develop data pipelines from source systems like SAP...

  • Data Architect

    2 weeks ago


    Chennai, Tamil Nadu, India Hub Work Full time

    Unlocking Data PotentialAt Hub Work, we're seeking an experienced Data Architect to lead the design and implementation of our end-to-end data ingestion and processing systems on the AWS platform. With 10+ years of experience in Data Engineering, this role requires a solid understanding of data architecture, lake house, and enterprise data lake concepts.Key...


  • Chennai, Tamil Nadu, India Ciklum Full time

    About the Role:Ciklum is seeking a highly skilled Data Engineering Expert to join our team in India.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges.As a Data Engineering Expert, you will be part of a cross-functional development team engineering...

  • Data Architect

    2 weeks ago


    Chennai, India Hub Work Full time

    10 plus years of experience in Data Engineering with solid experience in design, development and implementation of end-to-end data ingestion and data processing system in AWS platform. 2-3 years of experience in AWS Glue, Lambda, Appflow, EventBridge, Python, PySpark, Lake House, S3, Redshift, Postgres, API Gateway, CloudFormation, Kinesis, Athena, KMS,...