Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-38314

External Build Log storage for Jenkins. Prototype #1

    XMLWordPrintable

Details

    • External Build Log storage for Jenkins. Prototype #1

    Description

      We would like to have a prototype of Build External Logging system.

      Concept:

      • External Storage: Elasticsearch-Logstash-Kibana stack
      • Jenkins agents report their log events directly to system without passing master
      • Do not store logs on a system disk
      • Users are able to see build logs from Jenkins web UI
      • Nice2Have: visualization does not require much resources from Jenkins (e.g. client-side implementation with a simple routing of requests for security purposes)

      Attachments

        Issue Links

          blocks

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. JENKINS-38313 External Build Log storage for Jenkins

          • Major - Major loss of function.
          • In Progress

          Activity

            Ascending order - Click to sort in descending order
            jglick Jesse Glick added a comment -

            FTR seems to consist of core plus workflow-job plus logstash.

            jglick Jesse Glick added a comment - FTR seems to consist of core plus workflow-job plus logstash .
            oleg_nenashev Oleg Nenashev added a comment -

            jglick exactly. The top-level description of the prototype is here: https://speakerdeck.com/onenashev/jw2016-hackathon-external-build-logging-prototype-demo . Maybe next versions will get another structure since I may need additional API plugins for LogBrowsers/Storages, etc.

            oleg_nenashev Oleg Nenashev added a comment - jglick exactly. The top-level description of the prototype is here: https://speakerdeck.com/onenashev/jw2016-hackathon-external-build-logging-prototype-demo . Maybe next versions will get another structure since I may need additional API plugins for LogBrowsers/Storages, etc.
            oleg_nenashev Oleg Nenashev added a comment -

            The design is in progress

            oleg_nenashev Oleg Nenashev added a comment - The design is in progress
            oleg_nenashev Oleg Nenashev added a comment -

            I think the first prototyping phase is done. If somebody have time and interest to proceed, see the linked issues

            oleg_nenashev Oleg Nenashev added a comment - I think the first prototyping phase is done. If somebody have time and interest to proceed, see the linked issues

            People

              oleg_nenashev Oleg Nenashev
              oleg_nenashev Oleg Nenashev
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: