Only 24h Left Elastic Data Engineer

Who We Are At Kyndryl we design build manage and modernize the mission-critical technology systems that the world depends on every day So why work at Kyndryl We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable inclusive world for our employees our customers and our communities The Role Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl As a Data Engineer you ll be the visionary behind our data platforms crafting them into powerful tools for decision-makers Your role Ensuring a treasure trove of pristine harmonized data is at everyone s fingertips As a Data Engineer at Kyndryl you ll be at the forefront of the data revolution crafting and shaping data platforms that power our organization s success This role is not just about code and databases it s about transforming raw data into actionable insights that drive strategic decisions and innovation As an ELK Elastic Logstash Kibana Data Engineer you would be responsible for developing implementing and maintaining the ELK stack-based solutions for Kyndryl s clients This role would be responsible to develop efficient and effective data log ingestion processing indexing and visualization for monitoring troubleshooting and analysis purposes Responsibilities Design implement and maintain scalable data pipelines using ELK Stack Elasticsearch Logstash Kibana and Beats for monitoring and analytics Develop data processing workflows to handle real-time and batch data ingestion transformation and visualization Implement techniques like grok patterns regular expressions and plugins to handle complex log formats and structures Configure and optimize Elasticsearch clusters for efficient indexing searching and performance tuning Collaborate with business users to understand their data integration visualization needs and translate them into technical solutions Create dynamic and interactive dashboards in Kibana for data visualization and insights that can enable to detect the root cause of the issue Leverage open-source tools such as Beats and Python to integrate and process data from multiple sources Collaborate with cross-functional teams to implement ITSM solutions integrating ELK with tools like ServiceNow and other ITSM platforms Anomaly detection using Elastic ML and create alerts using Watcher functionality Extract data by Python programming using API Build and deploy solutions in containerized environments using Kubernetes Monitor Elasticsearch clusters for health performance and resource utilization Automate routine tasks and data workflows using scripting languages such as Python or shell scripting Provide technical expertise in troubleshooting debugging and resolving complex data and system issues Create and maintain technical documentation including system diagrams deployment procedures and troubleshooting guides In this role you ll be engineering the backbone of our data infrastructure ensuring the availability of pristine refined data sets With a well-defined methodology critical thinking and a rich blend of domain expertise consulting finesse and software engineering prowess you ll be the mastermind of data transformation Your journey begins by understanding project objectives and requirements from a business perspective converting this knowledge into a data puzzle You ll be delving into the depths of information to uncover quality issues and initial insights setting the stage for data excellence But it doesn t stop there You ll be the architect of data pipelines using your expertise to cleanse normalize and transform raw data into the final dataset a true data alchemist Armed with a keen eye for detail you ll scrutinize data solutions ensuring they align with business and technical requirements Your work isn t just a means to an end it s the foundation upon which data-driven decisions are made - and your lifecycle management expertise will ensure our data remains fresh and impactful So if you re a technical enthusiast with a passion for data we invite you to join us in the exhilarating world of data engineering at Kyndryl Let s transform data into a compelling story of innovation and growth Your Future at Kyndryl Every position at Kyndryl offers a way forward to grow your career We have opportunities that you won t find anywhere else including hands-on experience learning opportunities and the chance to certify in all four major platforms Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector you can find your opportunity here Who You Are You re good at what you do and possess the required experience to prove it However equally as important - you have a growth mindset keen to drive your own personal and professional development You are customer-focused - someone who prioritizes customer success in their work And finally you re open and borderless - naturally inclusive in how you work with others Required Technical and Professional Expertise At least 3 years of experience with ELK Stack and Python programming along with a minimum of 10 years overall experience in the IT industry ELK Stack Deep expertise in Elasticsearch Logstash Kibana Beats and Anomaly detection Programming Proficiency in Python for scripting and automation ITSM Platforms Hands-on experience with ServiceNow or similar ITSM tools Containerization Experience with Kubernetes and containerized applications Operating Systems Strong working knowledge of Windows Linux and AIX environments Open Source Tools Familiarity with various open-source data integration and monitoring tools Additional Skills Knowledge of network protocols log management and system performance optimization Experience in integrating ELK solutions with enterprise IT environments Strong analytical and problem-solving skills with attention to detail Knowledge in MySQL or NoSQL Databases will be added advantage Fluent in English written and spoken Preferred Technical and Professional Experience Graduate Postgraduate in computer science computer engineering Elastic Certified Analyst or Elastic Certified Engineer certification is preferrable Familiarity with additional monitoring tools like Prometheus Grafana or Splunk Knowledge of cloud platforms AWS Azure or GCP Experience with DevOps methodologies and tools Being You Diversity is a whole lot more than what we look like or where we come from it s how we think and who we are We welcome people of all cultures backgrounds and experiences But we re not doing it single-handily Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work individually and collectively and support the activation of our equitable culture That s the Kyndryl Way What You Can Expect With state-of-the-art resources and Fortune 100 clients every day is an opportunity to innovate build new capabilities new relationships new processes and new value Kyndryl cares about your well-being and prides itself on offering benefits that give you choice reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey Our employee learning programs give you access to the best learning in the industry to receive certifications including Microsoft Google Amazon Skillsoft and many more Through our company-wide volunteering and giving platform you can donate start fundraisers volunteer and search over 2 million non-profit organizations At Kyndryl we invest heavily in you we want you to succeed so that together we will all succeed Get Referred If you know someone that works at Kyndryl when asked How Did You Hear About Us during the application process select Employee Referral and enter your contact s Kyndryl email address