Uploaded image for project: 'Skara'
  1. Skara
  2. SKARA-971

Stop clumping up logs in logstash

    XMLWordPrintable

    Details

    • Type: Enhancement
    • Status: Resolved
    • Priority: P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9
    • Component/s: bots
    • Labels:
      None

      Description

      I would like to change how we send logs to logstash so each log message is stored as an individual document. To make this more practical, we need to add some more meta data to each message so we can properly filter them. I suggest adding the following:

      instance_start_time: An ISO_INSTANT time stamp string indicating when this JVM instance was started.
      work_id: A running counter generated ID for each work item, rest request or periodic check, which was previously clumped up in one log message.
      work_item: For work items, store the item toString()

      By combining these in different ways, we get a very powerful way of filtering log messages in Kibana to help drill down when looking for problems.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              erikj Erik Joelsson
              Reporter:
              erikj Erik Joelsson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: