Hive/NiFi Engineer

4 days ago


Anywhere in IndiaMultiple Locations Taggd Full time

Responsibilities :

- Design and develop data pipelines using Apache Nifi for ingesting, transforming, and loading data into our Big Data platform.

- Utilize Apache Hive for efficient data warehousing and querying large datasets.

- Leverage Apache Spark for large-scale data processing and analytics.

- Collaborate directly with clients to understand their business needs and translate those needs into effective Big Data solutions.

- Participate in discussions around data models and architecture for the Spectrum Mobile Data Hub platform.

- Fine-tune Spark-submit scripts for optimal performance and efficiency.

- Continuously optimize Hive SQL queries to ensure fast and reliable data retrieval.

- Create and manage Hive and Kudu tables for efficient data storage and retrieval.

- Utilize XML data sources for effective data loading into Big Data platforms.

Requirements :

- Bachelor's degree in Computer Science, Information Technology, or a related field (preferred).

- 3-4 years of experience working with Big Data technologies like Hive, Nifi, and Spark.

- Strong understanding of data warehousing concepts and data modeling principles.

- Proficiency in SQL and experience with HiveQL for querying large datasets.

- Experience with data ingestion and transformation tools like Apache Nifi.

- Experience with distributed processing frameworks like Apache Spark is a plus.

- Excellent communication and collaboration skills with the ability to interact effectively with clients.

- Strong analytical and problem-solving skills

(ref:hirist.tech)
  • Hive/NiFi Engineer

    6 days ago


    Anywhere in India/Multiple Locations, IN Taggd Full time

    Responsibilities :- Design and develop data pipelines using Apache Nifi for ingesting, transforming, and loading data into our Big Data platform.- Utilize Apache Hive for efficient data warehousing and querying large datasets.- Leverage Apache Spark for large-scale data processing and analytics.- Collaborate directly with clients to understand their business...

  • Hive/NiFi Engineer

    4 days ago


    india Taggd Full time

    Responsibilities :- Design and develop data pipelines using Apache Nifi for ingesting, transforming, and loading data into our Big Data platform.- Utilize Apache Hive for efficient data warehousing and querying large datasets.- Leverage Apache Spark for large-scale data processing and analytics.- Collaborate directly with clients to understand their business...


  • Anywhere in India/Multiple Locations Moback Technologies India Pvt Ltd Full time

    Job Description : We are seeking a talented Integration Engineer to join our team. As an Integration Engineer at Moback, you will play a crucial role in designing, developing, and maintaining robust integration solutions for our clients. You will work closely with cross-functional teams to ensure seamless integration of various systems and applications.Key...


  • india Gama Advisory Services LLP Full time

    Overview :We are seeking a proficient Big Data/ETL Test Engineer with 4-6 years of experience in testing Big Data platforms and ETL processes, specifically using Hadoop and Hive technologies. As a Test Engineer, you will play a critical role in ensuring the quality and reliability of our Big Data solutions by designing and executing comprehensive test...

  • Valiance Solutions

    4 weeks ago


    Anywhere in India/Multiple Locations Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • L2 Senior Associate

    4 weeks ago


    Anywhere in India/Multiple Locations Pylon Management Consulting Full time

    Job Description : Your Skills & Experience :- Minimum 3 years of experience in Big Data technologies- Hands-on experience with the Hadoop stack - HDFS, sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow, and other components required in building end-to-end data pipelines. Working knowledge of real-time data pipelines is...


  • India Moback Technologies India Pvt Ltd Full time

    Job Description : We are seeking a talented Integration Engineer to join our team. As an Integration Engineer at Moback, you will play a crucial role in designing, developing, and maintaining robust integration solutions for our clients. You will work closely with cross-functional teams to ensure seamless integration of various systems and applications.Key...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations/Bangalore, IN Mobile Programming LLC Full time

    Job Description :Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Bangalore Mobile Programming LLC Full time

    Job Description : Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...

  • GCP Data Engineer

    4 weeks ago


    Pune/Hyderabad/Anywhere in India/Multiple Locations Huquo Full time

    Job Description : Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage,...

  • GCP Data Engineer

    1 month ago


    Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...


  • india Digihelic Solutions Pvt. Ltd. Full time

    Key Responsibilities :- Designing, developing, and implementing solutions using MarkLogic, XQuery, Optic query, and Semantic Technologies to address complex data requirements.- Hands-on experience with the datahub framework for managing data ingestion, curation, and mastering processes.- Utilizing Apache NiFi for data integration, streaming, and processing...

  • L2 Senior Associate

    2 weeks ago


    Anywhere in India/Multiple Locations Pylon Management Consulting Full time

    Job Description :Your Skills & Experience : Minimum 3 years of experience in Big Data technologies Handson experience with the Hadoop stack HDFS, sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow, and other components required in building endtoend data pipelines. Working knowledge of realtime data pipelines is added...


  • India Digihelic Solutions Pvt. Ltd. Full time

    Key Responsibilities : Designing, developing, and implementing solutions using MarkLogic, XQuery, Optic query, and Semantic Technologies to address complex data requirements. Handson experience with the datahub framework for managing data ingestion, curation, and mastering processes. Utilizing Apache NiFi for data integration, streaming, and processing...

  • Big Data Architect

    1 month ago


    Metros/Anywhere in India/Multiple Locations, IN Xcel Hire Management Solutions Full time

    Job description : - The decision-making power for data analysis and he/she should also possess the quality of architecting the massive data- Should have skills in big data tools and technologies; it includes technologies like the Hadoop, accumulo, MapReduce, Hive, HBase, panoply and redshift- Overall 10 years of experience as Principal Consultant, Subject...

  • Big Data Architect

    4 weeks ago


    Metros/Anywhere in India/Multiple Locations Xcel Hire Management Solutions Full time

    Job description : - The decision-making power for data analysis and he/she should also possess the quality of architecting the massive data- Should have skills in big data tools and technologies; it includes technologies like the Hadoop, accumulo, MapReduce, Hive, HBase, panoply and redshift- Overall 10 years of experience as Principal Consultant, Subject...


  • india INTELLIGENCE INDIA.COM LIMITED Full time

    Job Description :Role : Senior Data Engineer (Flink + Spark + Kafka)- Minimum 7 years of experience- B.Sc. Of Computer Science or similar- Proficiency in programming languages Java, Python or R- Experience with design and development of ELT workflows and data pipelines for high-volume data systems.- Experience in Data Engineering and implementation of...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Lead Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Responsibilities for this position include :Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies Write and tune complex Java, MapReduce, Pig and Hive jobs Adapt quickly to change...