Big Data DevOps Engineer
7 days ago
Job Requirements :
- 5+ years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase
- A deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run
- Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks
- Experience with middle-layer technologies including web servers (HTTP, ningx), application servers (Jboss, Tomcat), and database systems (Postgres, Mysql)
- Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.
- Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches
- Experience supporting on-premise solutions as well as on AWS cloud
- Experience working with and supporting Spark-based applications on YARN
- Experience with one or more automation tools such as Ansible, Terraform, etc
- Experience working with CI/CD tools like Jenkins and various test report and coverage plugins
- Experience defining and automating the build, versioning, and release processes for complex enterprise products
- Experience supporting clients remotely and on-site
- Experience working with and supporting Java- and Python-based tech stacks would be a plus
(ref:hirist.tech)
-
Senior Big Data Engineer
1 month ago
Any Location, India Freelancer Recruiter Full timeKey Responsibilities:As a Big Data DevOps Engineer, you will be responsible for managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and HBase. Your tasks will involve configuring resource allocation, setting up high availability, and handling data recovery tasks. Additionally, you will work with middle-layer technologies such as web...
-
Big Data Engineering Specialist
7 days ago
Any Location, India Freelancer Recruiter Full timeJob OverviewWe are seeking an experienced Big Data Engineer to join our team at Freelancer Recruiter. In this role, you will be responsible for managing the Big Data application stack including HDFS, YARN, Spark, Hive and HBase.About the RoleThis is a challenging position that requires a deep understanding of all configurations required for installing and...
-
Senior Network Engineer
1 week ago
Any Location, India Frontline Data Solutions Full timeWho We Are :Frontline Data Solutions provides web-based (SaaS) environmental, health, and safety software to some of the world's leading chemical, oil & gas, and manufacturing companies. Frontline's work culture combines the fast-paced, entrepreneurial culture of a startup software company with the stability and professionalism that reflects our...
-
Data Engineer
1 week ago
Any Location, India Blueridge Global Full timeAre you passionate about building state-of-the-art data platforms and powering the next generation of compute and AI applications, we'd love to hear from you. This is an exciting opportunity to leverage your expertise in distributed computing frameworks to make a significant impact as we push the boundaries of supply chain planning and eventually...
-
Nlineaxis IT Solutions
1 month ago
Any Location, India Nlineaxis Full timeJob Description :We are looking for an experienced AWS DevOps Engineer with 5 years of experience to join our team on a contract basis. The ideal candidate will have strong skills in Terraform and Kubernetes, with extensive experience in providing infrastructure solutions, managing cloud environments, and executing database migrations. This role involves...
-
Senior Network Architect
1 month ago
Any Location, India Frontline Data Solutions Full time**Role Overview**Frontline Data Solutions is seeking a skilled Senior Network Engineer to join our DevOps team. As a critical member of our networking and infrastructure team, you will design and support the operational infrastructure for our products, including security, disaster recovery plans, and backup management.Key ResponsibilitiesDesign and implement...
-
Any Location, India Marsdevs Full timeCompany Description : MarsDevs is a remote-first, offshore digital product development company. We specialize in building MVPs, Mobile and Web Applications, and SaaS Products for Early to Growth Startups, as well as vertical solutions for SMBs. Our commitment lies in providing high-quality code, no-vendor-locking guarantee, speed, and building technical...
-
Data Architect
1 month ago
Any Location, India Blueridge Global Full timeWe are seeking a seasoned Data Engineer to drive the development of a cutting-edge data platform at Blueridge Global. This exciting opportunity involves leveraging distributed computing frameworks like Apache Spark, Databricks, and Snowflake to create a highly scalable, fault-tolerant data platform optimized for large-scale data processing and near real-time...
-
Senior Data Architect
1 month ago
Any Location, India Zorba Consulting India Pvt. Ltd. Full timeJob Title: Lead Data EngineerJob Summary:Zorba Consulting India Pvt. Ltd. is seeking an experienced Lead Data Engineer to drive data-driven initiatives within our organization. The successful candidate will be responsible for designing, developing, and implementing scalable data solutions that support our business objectives.Key Responsibilities:Develop and...
-
TechmSystems Services
21 hours ago
Any Location, India Techmsystems Services Pvt. Ltd. Full timeResponsibilities : Support and help manage the whole AWS infrastructure for all production sites for world-class uptime and resiliency metrics. Help build, scale, and secure application cloud infrastructure using tools like Terraform, Kubernetes, and Docker. Build and maintain robust CI/CD pipelines (for example: with codeDeploy and Bitbucket pipelines)....
-
Network Infrastructure Architect
2 days ago
Any Location, India Frontline Data Solutions Full timeAbout Us">Frontline Data Solutions is a leading provider of web-based environmental, health, and safety software to prominent chemical, oil & gas, and manufacturing companies.We offer an autonomous and entrepreneurial work culture, where our 25-year history provides stability and professionalism. Our fast-paced environment fosters innovation, while our...
-
Lead Azure DevOps Engineer
1 week ago
Any Location/Bangalore, India Mouri Tech (P) Ltd Full timeMOURI Tech is a professional global enterprise solution provider helping its customers transform into intelligent enterprises. It offers comprehensive solutions and world-leading consulting and delivery experience to many fortune 500 companies across the globe.As a lead innovator of NextGen AI solutions, it enables its customers to achieve new business...
-
Any Location, India Techolution Full timeJob Description : We are looking for a Google Cloud Data Engineer who will help us build a highly scalable and reliable platform to match our exponential growth. As a Google Cloud Data Engineer, you will be responsible for building a solid back end infrastructure which will enable data delivery in near real-time using next-gen technologies.Title : Google...
-
DevOps Engineer
7 days ago
Any Location, India Freelancer Recruiter Full time- 4+ years of industry experience in a similar DevOps role, preferably as part of a SaaS product team. You can -demonstrate the significant impact your work has had on the product and/or the team.- Deep knowledge in AWS and the services available. 2+ years of experience in building complex architecture on cloud infrastructure.- Exceptional understanding of...
-
Enterprise Data Integration Specialist
1 week ago
Any Location, India Liveconnections Full timeJob Title: Enterprise Data Integration Specialist About the Role:We are seeking a seasoned Ab Initio Developer with strong expertise in the Ab Initio suite and related technologies to join our team at Liveconnections. The ideal candidate will have deep experience in working with GDE components, metadata management, and advanced data processing. Key...
-
Engineering Manager
1 month ago
Any Location, India Insightsquared Full timeRole Details : - Build vision and direction for the solutions delivery & implementations and POC's.- Participate in solution calls and build features needed for the market needs.- Oversee the execution of delivery, ensuring high-quality outcomes and client satisfaction.- Implement best practices for project management and delivery to streamline...
-
Bandgi Technologies
1 month ago
Hyderabad/Any Location, India Bandgi Technologies Pvt Ltd Full timeJob Description : Company Overview :Bandgi Technologies is a SaaS product development company which provides niche technology skills and help organizations in innovation. Our specialization is on Industry 4.0 /IIOT and we provide solutions to clients in US, Canada and Europe. We are Innovation Enablers and have offices in India (Hyderabad) and in the UK...
-
MLOps Engineer
1 week ago
Any Location, India HuMetis Technologies Inc. Full timeJob Description : Skills : Must Have Skills :- AWS- Azure Cloud Platform- GCP- DevOps- Kubernetes- Docker- JenkinsResponsibilities : Model Deployment and Automation : - Develop and maintain automated pipelines for model deployment, monitoring, and scaling, ensuring efficient and robust integration into production systems.- Implement best practices for...
-
Cloud Data Engineer
1 week ago
Any Location, India Techolution Full timeJob OverviewWe are seeking a seasoned Cloud Data Engineer to join our team at Techolution, where we harness expertise in novel technologies to deliver innovative solutions for our enterprise clients. This role will involve designing and developing highly scalable data pipelines on Google Cloud Platform (GCP).About the RoleThis is an excellent opportunity for...
-
Highly Skilled Azure DevOps Engineer Leader
7 days ago
Any Location/Bangalore, India Mouri Tech (P) Ltd Full timeMouri Tech (P) Ltd is a global enterprise solution provider, helping its customers transform into intelligent enterprises. With comprehensive solutions and world-leading consulting and delivery experience, it supports many Fortune 500 companies across the globe.As a leader in NextGen AI solutions, Mouri Tech enables its customers to achieve new business...