Logstash Developer

2 weeks ago


Bengaluru, Karnataka, India HR Aspiration Full time

Job Title :
Logstash Developer

Job Description :

Role Overview :

  • As a Logstash Developer, you will play a pivotal role in the data processing pipeline by designing, developing, and maintaining Logstash configurations to extract, transform, and enrich data from diverse sources. Your expertise in Logstash and data parsing will be critical in ensuring that the organization can efficiently ingest and analyse data for various purposes.

Key Responsibilities :

Logstash Configuration :

Develop and maintain Logstash configuration files (Logstash pipelines) to ingest data from sources like log files, message queues, databases, and APIs.


Data Parsing :

Create Logstash filter configurations to parse raw data into structured formats using techniques such as grok patterns, regular expressions, and custom filters.


Data Transformation :

Implement data transformation logic within Logstash to ensure that data is standardized and suitable for downstream processing and analysis.


Data Enrichment :

Enrich parsed data by adding contextual information, geolocation data, or other relevant metadata to enhance its value for analytics and reporting.


Error Handling :
Implement error-handling mechanisms to identify and address issues related to data ingestion, parsing, and transformation.

Performance Optimization :
Continuously optimize Logstash configurations for resource utilization and data processing speed, considering scalability and efficiency.

Monitoring and Troubleshooting :
Monitor Logstash pipelines, set up alerts, and troubleshoot any performance or data quality issues that may arise.

Documentation :
Maintain comprehensive and up-to-date documentation for Logstash configurations, filter patterns, and data processing workflows.

Collaboration :

Collaborate closely with cross-functional teams, including DevOps, SysOps, Data Engineers, and Analysts, to ensure seamless data integration and delivery.


Security :
Implement security best practices to protect sensitive data during ingestion and processing.

Requirements :

  • Proven experience as a Logstash Developer or similar role with a focus on Logstash configuration and data parsing.
  • Expertise in Logstash filter configuration, including grok patterns, regex, and custom filters.
  • Strong knowledge of data parsing, transformation, and enrichment techniques.
  • Familiarity with Opensearch/Elasticsearch or other data storage and analytics platforms.
  • Proficiency in scripting and automation for Logstash pipeline management.
  • Strong analytical and problemsolving skills.
  • Effective communication skills and the ability to work collaboratively in a team environment.
  • Knowledge of data security best practices.
  • Experience with monitoring and troubleshooting Logstash pipelines is a plus.
)

  • Bengaluru, Karnataka, India HR Aspiration Full time

    Job Description : Role Overview : As a Logstash Developer, you will play a pivotal role in the data processing pipeline by designing, developing, and maintaining Logstash configurations to extract, transform, and enrich data from diverse sources. Your expertise in Logstash and data parsing will be critical in ensuring that the organization can efficiently...

  • ELK Developer

    2 weeks ago


    Bengaluru, Karnataka, India AQUASoft Full time

    Company DescriptionAQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses. Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art...

  • ELK Developer

    2 weeks ago


    Bengaluru, Karnataka, India Tech Mahindra Full time

    Responsibilities • Desired knowledge of Elastic Search & secondary will be Logstash/Kibana. • Good to have hands on experience in public cloud environments. • Experience in Event Stream data model, data ingestion and data storage Experience working with Event Stream tools. • ELK(Elastic Search), Kafka, Stream Set. • Experience in design and...

  • ELK Stack Developer

    2 weeks ago


    Bengaluru, Karnataka, India PITCS Full time

    Key Responsibilities : ELK Development: Design, implement, and maintain advanced ELK Stack solutions for log and data analysis, including custom pipelines and data enrichment. Log Ingestion: Develop efficient log ingestion pipelines using Logstash, ensuring data is parsed, transformed, and normalized for effective analysis. Elasticsearch Management:...

  • Lead ELK Developer

    2 weeks ago


    Bengaluru, Karnataka, India PITCS Full time

    Summary : We are seeking an experienced ELK Level 2 Developer to join our team. The ideal candidate should have a deep understanding of the ELK Stack and its components, with a focus on log and data analysis, infrastructure monitoring, and system optimization. As an ELK Level 2 Developer, you will play a crucial role in architecting and managing our...

  • Java Developer

    2 weeks ago


    Bengaluru, Karnataka, India Direct Client Full time

    Java+ Elastic Search EngineerBengaluru, DigitalJOB DESCRIPTIONRoles & Responsibilities· At least 5 years of experience, with 3 years of relevant experience· Proficient in Elasticsearch – Essential· Develop and deploy scalable ELK (Elasticsearch, Logstash, Kibana) stack and Elastic Cache solutions· Design data structures using Elasticsearch and...

  • ELK Developer

    2 weeks ago


    Bengaluru, Karnataka, India Tech Mahindra Full time

    Responsibilities Desired knowledge of Elastic Search & secondary will be Logstash/Kibana. Good to have hands on experience in public cloud environments. Experience in Event Stream data model, data ingestion and data storage Experience working with Event Stream tools. ELK(Elastic Search), Kafka, Stream Set. Experience in design and develop Event Activity...


  • Bengaluru, Karnataka, India timesjobs Full time

    ### Requirement Candidate should have with 4 to 6 years of experience in end to end system development using Javascript, Nodejs, JQuery, MySql, Semantic UI, Sequelize and AWS server (mandatory). Experience with B2C internet technology platform development like eCommerce is preferred. Must have excellent programming aptitude and problemsolving skills. Should...


  • Bengaluru, Karnataka, India timesjobs Full time

    ### Requirement Candidate should have with 4 to 6 years of experience in end to end system development using Javascript, Nodejs, JQuery, MySql, Semantic UI, Sequelize and AWS server (mandatory). Experience with B2C internet technology platform development like eCommerce is preferred. Must have excellent programming aptitude and problemsolving skills. Should...

  • Java ELK Developer

    2 weeks ago


    Bengaluru, Karnataka, India Quess Full time

    About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...

  • Java ELK Developer

    2 weeks ago


    Bengaluru, Karnataka, India Quess Full time

    About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...

  • Senior Java Developer

    2 weeks ago


    Bengaluru, Karnataka, India CliqHR Full time

    Responsibilities : Design, develop, and maintain Javabased microservices and applications with a focus on observability and telemetry. Implement best practices for instrumenting, collecting, analyzing, and visualizing telemetry data (metrics, logs, traces) to monitor and troubleshoot system behavior and performance. Collaborate with crossfunctional teams to...


  • Bengaluru, Karnataka, India iQuanti Full time

    Job Description: Elasticsearch ArchitectImmediate joiner preferred. Interested candidates can send their resume on iQuanti is looking for an Elasticsearch Architect. You will be responsible for the development and implementation of Elasticsearch solutions across client projects. Your expertise in search engine technologies and database design will be...

  • Senior Java Developer

    2 weeks ago


    Bengaluru, Karnataka, India Boolean Staffing and Recruitment Solutions Pvt Ltd Full time

    Responsibilities : Design, develop, and maintain Javabased microservices and applications with a focus on observability and telemetry. Implement best practices for instrumenting applications to collect metrics, logs, and traces (including distributed tracing). Develop and maintain robust pipelines for collecting, aggregating, analyzing, and visualizing...


  • Bengaluru, Karnataka, India iQuanti Full time

    Job Description: Elasticsearch Architect (Freelancing Opportunity)Immediate joiner preferred. Interested candidates can send their resume on iQuanti is looking for an Elasticsearch Architect. You will be responsible for the development and implementation of Elasticsearch solutions across client projects. Your expertise in search engine technologies and...


  • Bengaluru, Karnataka, India iQuanti Full time

    Job Description: Elasticsearch Architect Immediate joiner preferred. Interested candidates can send their resume on iQuanti is looking for an Elasticsearch Architect. You will be responsible for the development and implementation of Elasticsearch solutions across client projects. Your expertise in search engine technologies and database design will be...


  • Bengaluru, Karnataka, India ACL Digital Full time

    Now Hiring: Senior/Lead Software Engineer - OMC Design & Development (Python Backend) About the Company: Our company is a leading tech firm with a focus on cutting-edge projects and innovation in the tech industry. Key Requirements:Master's/Bachelor's degree (4+ years) in Computer Science or related field from a top-tier institutionProficiency in developing...


  • Bengaluru, Karnataka, India iQuanti Full time

    Job Opening: Elasticsearch ArchitectiQuanti is in search of a talented professional to join their team as an Elasticsearch Architect. In this role, you will play a crucial part in developing and implementing Elasticsearch solutions for various client projects. Your expertise in search engine technologies and database design will be pivotal in creating...


  • Bengaluru, Karnataka, India timesjobs Full time

    Senior DevOps EngineerLocation: BengaluruEmployment Type: Full TimeRoles and ResponsibilitiesWe are looking for an experienced Senior DevOps Engineer with over 10 years of professional experience. This role requires extensive knowledge in deploying, managing, and scaling applications in AWS cloud environments, as well as mastery of a range of DevOps tools...

  • Senior DevOps Engineer

    2 months ago


    Bengaluru, Karnataka, India timesjobs Full time

    Senior DevOps EngineerLocation: BengaluruEmployment Type: Full TimeRoles and ResponsibilitiesWe are looking for an experienced Senior DevOps Engineer with over 10 years of professional experience. This role requires extensive knowledge in deploying, managing, and scaling applications in AWS cloud environments, as well as mastery of a range of DevOps tools...