ELK Logstash Developer

2 weeks ago

Bengaluru, Karnataka, India HR Aspiration Full time

Job Description :

Role Overview :

As a Logstash Developer, you will play a pivotal role in the data processing pipeline by designing, developing, and maintaining Logstash configurations to extract, transform, and enrich data from diverse sources.

Your expertise in Logstash and data parsing will be critical in ensuring that the organization can efficiently ingest and analyse data for various purposes.

Key Responsibilities :

  • Logstash Configuration: Develop and maintain Logstash configuration files (Logstash pipelines) to ingest data from sources like log files, message queues, databases, and APIs.
  • Data Parsing: Create Logstash filter configurations to parse raw data into structured formats using techniques such as grok patterns, regular expressions, and custom filters.
  • Data Transformation: Implement data transformation logic within Logstash to ensure that data is standardized and suitable for downstream processing and analysis.
  • Data Enrichment: Enrich parsed data by adding contextual information, geolocation data, or other relevant metadata to enhance its value for analytics and reporting.
  • Error Handling: Implement error-handling mechanisms to identify and address issues related to data ingestion, parsing, and transformation.
  • Performance Optimization: Continuously optimize Logstash configurations for resource utilization and data processing speed, considering scalability and efficiency.
  • Monitoring and Troubleshooting: Monitor Logstash pipelines, set up alerts, and troubleshoot any performance or data quality issues that may arise.
  • Documentation: Maintain comprehensive and up-to-date documentation for Logstash configurations, filter patterns, and data processing workflows.
  • Collaboration: Collaborate closely with cross-functional teams, including DevOps, SysOps, Data Engineers, and Analysts, to ensure seamless data integration and delivery.
  • Security: Implement security best practices to protect sensitive data during ingestion and processing.

Requirements :

  • Proven experience as a Logstash Developer or similar role with a focus on Logstash configuration and data parsing.
  • Expertise in Logstash filter configuration, including grok patterns, regex, and custom filters.
  • Strong knowledge of data parsing, transformation, and enrichment techniques.
  • Familiarity with Opensearch/Elasticsearch or other data storage and analytics platforms.
  • Proficiency in scripting and automation for Logstash pipeline management.
  • Strong analytical and problem-solving skills.
  • Effective communication skills and the ability to work collaboratively in a team environment.
  • Knowledge of data security best practices.
  • Experience with monitoring and troubleshooting Logstash pipelines is a plus.

Technical Skills - Logtash, DevOps, scripting languages like Ruby or Python to automate Logstash , Experience with cloud platforms like AWS or Azure

Skills : elasticsearch, logstash, data transformation

)

  • ELK Stack Developer

    2 weeks ago

    Bengaluru, Karnataka, India PITCS Full time

    Key Responsibilities : ELK Development: Design, implement, and maintain advanced ELK Stack solutions for log and data analysis, including custom pipelines and data enrichment. Log Ingestion: Develop efficient log ingestion pipelines using Logstash, ensuring data is parsed, transformed, and normalized for effective analysis. Elasticsearch Management:...

  • Lead ELK Developer

    2 weeks ago

    Bengaluru, Karnataka, India PITCS Full time

    Summary : We are seeking an experienced ELK Level 2 Developer to join our team. The ideal candidate should have a deep understanding of the ELK Stack and its components, with a focus on log and data analysis, infrastructure monitoring, and system optimization. As an ELK Level 2 Developer, you will play a crucial role in architecting and managing our...

  • Logstash Developer

    2 weeks ago

    Bengaluru, Karnataka, India HR Aspiration Full time

    Job Title : Logstash DeveloperJob Description :Role Overview : As a Logstash Developer, you will play a pivotal role in the data processing pipeline by designing, developing, and maintaining Logstash configurations to extract, transform, and enrich data from diverse sources. Your expertise in Logstash and data parsing will be critical in ensuring that the...

  • ELK Developer

    2 weeks ago

    Bengaluru, Karnataka, India AQUASoft Full time

    Company DescriptionAQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses. Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art...

  • ELK Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Responsibilities • Desired knowledge of Elastic Search & secondary will be Logstash/Kibana. • Good to have hands on experience in public cloud environments. • Experience in Event Stream data model, data ingestion and data storage Experience working with Event Stream tools. • ELK(Elastic Search), Kafka, Stream Set. • Experience in design and...

  • ELK Admin

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Join an innovative teamAt o9 Solutions, we are driven by our goal to become the Most Valuable Platform (MVP) for enterprises. Our cutting-edge AI-driven platform, the o9 Digital Brain, is designed to harmonize planning processes across global enterprises, uncovering significant value opportunities worth millions, and even billions, of dollars. Additionally,...

  • ELK Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Responsibilities Desired knowledge of Elastic Search & secondary will be Logstash/Kibana. Good to have hands on experience in public cloud environments. Experience in Event Stream data model, data ingestion and data storage Experience working with Event Stream tools. ELK(Elastic Search), Kafka, Stream Set. Experience in design and develop Event Activity...

  • Java ELK Developer

    2 weeks ago

    Bengaluru, Karnataka, India Quess Full time

    About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...

  • Java ELK Developer

    2 weeks ago

    Bengaluru, Karnataka, India Quess Full time

    About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...

  • ELK Admin

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Be part of something revolutionaryAt o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't...

  • ELK Admin

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't...

  • Elk Administrator

    2 weeks ago

    Bengaluru, Karnataka, India Cranium IT Inc Full time

    Skill: ELK AdministratorExperience: 4-7 yrsJD:ELK Administrator - ElasticsearchWe are looking for a motivated software development engineer who can utilize his Programming knowledge &skill sets to implement high-quality solutions. Strong analytical, programming, and troubleshooting skills tounderstand, analyse business requirements and build quality...

  • Senior ELK Administrator

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Be part of something revolutionaryAt o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't...

  • Senior ELK Administrator

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Be part of something revolutionaryAt o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't...

  • Senior ELK Administrator

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Be part of something revolutionary At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't...

  • Only 24h Left: ELK Admin

    2 weeks ago

    Bengaluru, Karnataka, India o9 Solutions, Inc. Full time

    Be part of something revolutionaryAt o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't...

  • Lead ELK AWS Infrastructure Engineer

    2 weeks ago

    Bengaluru, Karnataka, India INES EIT Services India P. Ltd [Formerly Hewlett Packard Global Soft India P] Full time

    Job Description: Lead ELK AWS Infrastructure Engineer Job Location: Hyderabad / Bangalore / Chennai / Noida/ Gurgaon / Pune / Indore / Mumbai/ Kolkata Responsibilities: 12+ years of overall experience working on any cloud technology. 1. Design, implement, and maintain AWS infrastructure solutions to meet business requirements. 2. Lead...

  • Java Developer

    2 weeks ago

    Bengaluru, Karnataka, India Direct Client Full time

    Java+ Elastic Search EngineerBengaluru, DigitalJOB DESCRIPTIONRoles & Responsibilities· At least 5 years of experience, with 3 years of relevant experience· Proficient in Elasticsearch – Essential· Develop and deploy scalable ELK (Elasticsearch, Logstash, Kibana) stack and Elastic Cache solutions· Design data structures using Elasticsearch and...

  • Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India Synez Technologies Full time

    Company DescriptionSynez Technologies is a technology solutions provider based in Noida, Uttar Pradesh, India. We specialize in providing IT solutions to businesses to help them succeed in the digital age. We understand the importance of effective communication and engagement tools for our customers, whether they are large corporations or small/medium...

  • Elk Admin

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Must have : At least 2 years of experience with ELK in a Big Data environment. At least 2 years of experience as a Linux system administrator or similar work experience Expert knowledge of Elastic architecture. Experience installing, upgrading, and maintaining Multiple Production, Test and -Development environments.Good to have : Knowledge and understanding...