NIFI Admin and Operations

7 days ago

Chennai, India Dminds Solutions Inc. Full time

· Implemented solutions utilizing Advanced AWS Components: EMR, EC2, etc integrated with Big Data/Hadoop Distribution Frameworks: Zookeeper, Yarn, Spark, Scala, NiFi etc.

· Designed and Implemented Spark Jobs to be deployed and run on existing Active clusters.

· Configured Postgres Database on EC2 instances and made sure application that was created is up and running, Trouble Shooted issues to meet the desired application state.

· Experience in creating and configuring secure VPC, Subnets, and Security Groups through private and public networks.

· Created alarms, alerts, notifications for Spark Jobs to email and slack group message job status and log in CloudWatch.

· NiFi data Pipeline to process large set of data and configured Lookup's for Data Validation and Integrity.

· generation large set of test data with data integrity using java which used in Development and QA Phase.

· Spark Scala, improving the performance and optimized of the existing applications running on EMR cluster.

· Spark Job to Convert CSV data to Custom HL7/FHIR objects using FHIR API's.

· Deployed SNS, SQS, Lambda function, IAM Roles, Custom Policies, EMR with Spark and Hadoop setup and bootstrap scripts to setup additional software's needed to perform the job in QA and Production Environment using Terraform Scripts.

· Spark Job to perform Change Data Capture (CDC) on Postgres Tables and updated target tables using JDBC properties.

· Kafka Publisher integrated in spark job to capture errors from Spark Application and push into Postgres table.

· extensively on building Nifi data pipelines in docker container environment in development phase.

· Devops team to Clusterize NIFI Pipeline on EC2 nodes integrated with Spark, Kafka, Postgres running on other instances using SSL handshakes in QA and Production Environments.

  • Hadoop Admin Professional

    2 days ago

    Bengaluru, Chennai, Gurugram, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Hadoop Admin with 4 to 9 years of experience. The ideal candidate will have expertise in Hadoop administration, CDP distribution, Dataflow, and Big data platform.Roles and ResponsibilityManage and maintain large-scale Hadoop clusters for high availability and performance.Design and implement data pipelines using Kafka and Nifi...

  • Operations/admin Executive

    21 hours ago

    Chennai, Tamil Nadu, India Monsoon bounty Food Manufacturing Private Limited Full time

    MONSOON BOUNTY FOODS MANUFACTURING PVT LTD is a seafood manufacturing ,exporter with office at Anna Nagar, Factory at Gummidipoondi **JOB ROLES**: - Should maintain overall factory operations - Transport management - Dispute solving - Flexible to travel across places if required - purchase management and co ordination - Office assistance - Overall admin...

  • Admin HR Assistant Jobs Opening in Allwin Technologies and Services at Perambur, ChennaiLess

    1 week ago

    Chennai, India Allwin Technologies and Services Full time

    We are currently hiring :  HR/Admin/Accountant/ Logistics Qualifications : MBA-HR/Finance/Marketing/Operations/ Logistics Fresher / Passed-outs (2020 to 2024) Salary 18000/- to 22000/- Contact no: /98408 91896/044-48584278 Allwin Technologies & Services No: 4, Ramamoorthy Colony 1st Cross St, Tiru Vi Ka Nagar, Perambur, Chennai, Tamil Nadu 600082More...

  • Nifi (operation/support/admin) consultant

    5 days ago

    Chennai, India Dminds Solutions Inc. Full time

    About the Company We’re Hiring – Automation Tester (ACCELQ)#ACCELQ #SQL About the Role We are looking for an experienced Automation Tester with expertise in ACCELQ and strong knowledge of self-healing and AI-powered test frameworks to join our team . Responsibilitie s Minimum 6+ years in Automation Testing Hands-on with ACCELQ Automation Platform ...

  • Nifi (Operation/Support/Admin) Consultant

    1 week ago

    Chennai, India Dminds Solutions Inc. Full time

    About the CompanyWe’re Hiring – Automation Tester (ACCELQ)#ACCELQ #SQL About the RoleWe are looking for an experienced Automation Tester with expertise in ACCELQ and strong knowledge of self-healing and AI-powered test frameworks to join our team. ResponsibilitiesMinimum 6+ years in Automation TestingHands-on with ACCELQ Automation PlatformStrong...

  • Nifi (Operation/Support/Admin) Consultant

    3 days ago

    Chennai, India Dminds Solutions Inc. Full time

    About the CompanyWe’re Hiring – Automation Tester (ACCELQ)#ACCELQ #SQLAbout the RoleWe are looking for an experienced Automation Tester with expertise in ACCELQ and strong knowledge of self-healing and AI-powered test frameworks to join our team.Responsibilitie sMinimum 6+ years in Automation TestingHands-on with ACCELQ Automation PlatformStrong...

  • Nifi (Operation/Support/Admin) Consultant

    1 week ago

    Chennai, India Dminds Solutions Inc. Full time

    We’re Hiring – Automation Tester (ACCELQ) #ACCELQ #SQL We are looking for an experienced Automation Tester with expertise in ACCELQ and strong knowledge of self-healing and AI-powered test frameworks to join our team . Minimum 6+ years in Automation Testing Strong understanding of self-healing test frameworks & AI-based testing Knowledge of...

  • Nifi (Operation/Support/Admin) Consultant

    1 week ago

    Chennai, India Dminds Solutions Inc. Full time

    About the CompanyWe’re Hiring – Automation Tester (ACCELQ)#ACCELQ #SQLAbout the RoleWe are looking for an experienced Automation Tester with expertise in ACCELQ and strong knowledge of self-healing and AI-powered test frameworks to join our team.Responsibilitie sMinimum 6+ years in Automation TestingHands-on with ACCELQ Automation PlatformStrong...

  • Nifi (Operation/Support/Admin) Consultant

    1 week ago

    Chennai, India Dminds Solutions Inc. Full time

    About the Company We’re Hiring – Automation Tester (ACCELQ) #ACCELQ #SQL About the Role We are looking for an experienced Automation Tester with expertise in ACCELQ and strong knowledge of self-healing and AI-powered test frameworks to join our team . Responsibilities - Minimum 6+ years in Automation Testing - Hands-on with ACCELQ Automation...

  • Admin

    7 days ago

    Chennai, India Workfreaks Business Services Full time

    We are looking for a proactive Admin Executive to support day-to-day administrative and office operations in the Civil/Construction industry. The candidate will be responsible for handling documentation, coordination across Team.