Big Data DevOps Engineer

2 months ago

Any Location, IN Freelancer Recruiter Full time

Job Requirements :


- 5+ years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase

- A deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run

- Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks

- Experience with middle-layer technologies including web servers (HTTP, ningx), application servers (Jboss, Tomcat), and database systems (Postgres, Mysql)

- Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.

- Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches

- Experience supporting on-premise solutions as well as on AWS cloud

- Experience working with and supporting Spark-based applications on YARN

- Experience with one or more automation tools such as Ansible, Terraform, etc

- Experience working with CI/CD tools like Jenkins and various test report and coverage plugins

- Experience defining and automating the build, versioning, and release processes for complex enterprise products

- Experience supporting clients remotely and on-site

- Experience working with and supporting Java- and Python-based tech stacks would be a plus

(ref:hirist.tech)

  • Big Data Engineer

    1 week ago

    Any Location, IN Programming.com Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...

  • Big Data DevOps Engineer

    4 weeks ago

    Any Location, IN Freelancer Recruiter Full time

    Job Requirements :- 5+ years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase- A deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run- Experience setting up high availability, configuring resource allocation, setting up capacity...

  • Big Data Engineer

    4 weeks ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Engineer

    2 months ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Solutions Engineer

    4 weeks ago

    Bangalore/Any Location, IN Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team.- The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients.- The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Big Data Solutions Engineer

    4 weeks ago

    Bangalore/Any Location, IN Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team.- The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients.- The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Azure Data Engineer

    2 months ago

    Any Location, IN Visionyle Full time

    Position Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...

  • Azure Data Engineer

    4 weeks ago

    Any Location, IN Visionyle Full time

    Position Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...

  • Senior Machine Learning Engineer

    4 weeks ago

    Any Location, IN Tekvaly Full time

    Job Description :As a Senior Machine Learning Engineer, you will be responsible for leading the development and deployment of machine learning models. You will work closely with data scientists, data engineers, and other stakeholders to understand business requirements and translate them into scalable ML solutions.Key Responsibilities :Model Development and...

  • Senior Machine Learning Engineer

    4 weeks ago

    Any Location, IN Tekvaly Full time

    Job Description :As a Senior Machine Learning Engineer, you will be responsible for leading the development and deployment of machine learning models. You will work closely with data scientists, data engineers, and other stakeholders to understand business requirements and translate them into scalable ML solutions.Key Responsibilities :Model Development and...

  • Harmony Data Integration Technologies

    2 months ago

    Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full time

    Job Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • Azure DevOps Engineer

    4 weeks ago

    Any Location, IN Webority Technologies Full time

    Job Description : Azure DevOps Engineer. Position : Azure DevOps Engineer. Experience : 5 to 8 years. Location : Remote.Responsibilities :- Design and manage CI/CD pipelines using Azure DevOps.- Automate build, test, and deployment processes.- Maintain infrastructure as code (IaC) with Terraform, ARM templates, or Azure Bicep.- Monitor system performance...

  • Azure DevOps Engineer

    4 weeks ago

    Any Location, IN Webority Technologies Full time

    Job Description : Azure DevOps Engineer. Position : Azure DevOps Engineer. Experience : 5 to 8 years. Location : Remote.Responsibilities :- Design and manage CI/CD pipelines using Azure DevOps.- Automate build, test, and deployment processes.- Maintain infrastructure as code (IaC) with Terraform, ARM templates, or Azure Bicep.- Monitor system performance...

  • Victrix Systems and Labs

    4 weeks ago

    Any Location, IN Victrix Systems & Labs Full time

    Job Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...

  • Victrix Systems and Labs

    2 months ago

    Any Location, IN Victrix Systems & Labs Full time

    Job Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...

  • Senior DevOps/Site Reliability Engineer

    2 months ago

    Any Location, IN RapidBraiins Full time

    Job Description :We are seeking a highly skilled and experienced Senior DevOps Site Reliability Engineer to join our dynamic team. The ideal candidate will have a proven track record of success in DevOps, Site Reliability Engineering (SRE), or development roles within SaaS-based or enterprise applications. As a Senior DevOps SRE Engineer, you will play a...

  • Senior DevOps/Site Reliability Engineer

    4 weeks ago

    Any Location, IN RapidBraiins Full time

    Job Description :We are seeking a highly skilled and experienced Senior DevOps Site Reliability Engineer to join our dynamic team. The ideal candidate will have a proven track record of success in DevOps, Site Reliability Engineering (SRE), or development roles within SaaS-based or enterprise applications. As a Senior DevOps SRE Engineer, you will play a...

  • Cloud DevOps Automation Engineer

    4 weeks ago

    Any Location, IN Conquest Technology Solutions Pvt Ltd Full time

    About the job :We are hiring for Cloud DevOps Automation Engineer with 10+ years of exp.Location : Remote/WFHDetailed JD :- 15+ years of overall IT experience and 7+ years of AWS cloud tools used for hosting and managing the platform.- Very strong, hands-on experience with Infrastructure as code tools (e.g. AWS CDK, Terraform, Pulumi) and config management...

  • Cloud DevOps Automation Engineer

    4 weeks ago

    Any Location, IN Conquest Technology Solutions Pvt Ltd Full time

    About the job :We are hiring for Cloud DevOps Automation Engineer with 10+ years of exp.Location : Remote/WFHDetailed JD :- 15+ years of overall IT experience and 7+ years of AWS cloud tools used for hosting and managing the platform.- Very strong, hands-on experience with Infrastructure as code tools (e.g. AWS CDK, Terraform, Pulumi) and config management...