Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-52522

Display more than 100 records in the workflow api

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Blocker Blocker
    • workflow-api-plugin
    • None

       In general, we have a pipeline that generates 400+ stageFlowNodes. We have about 5 stages, each with a varying about of stageFlowNodes. In specific, we have a pipeline that spawns 48 parallel branches, each includes 8 steps, which show up as stageFlowNodes under a stage. 

      Our issue here is that we cannot query the pipeline beyond the first 100 stageFlowNodes using the workflow api (wfapi/describe) - more specifically using http://<jenkins_url>/<build_number>/execution/node/<stage_id>/wfapi/describe

      Using this information, we are able to extract how long each test ran. 

      I have been trying to find a way to query beyond the 100 stageFlowNodes, but have been unsuccessful - being able to see more than the first 100 would benefit us greatly.

      The priority is a blocker as we have had to stop development because this issue is stopping us from extracting all the data. 

      I am currently not aware of a pagination endpoint that can be used to display more results.

      What we are requesting is more results be displayed by the API, specifically under the stageFlowNodes under each stage.

          [JENKINS-52522] Display more than 100 records in the workflow api

          Ken Lamb added a comment -

          We have the same issue. I have a pipeline that generates more than 100 stageFlowNodes. I had always assumed there was a pagination API that I needed to utilize to get the remaining information. However, I just went looking for it and could not find it. Then, I found this.
          The fact that it has sat here for 6 months doesn't give me much hope that a resolution is soon to come.
          If there is a cap, can it be raised?
          If it cannot be raised, can the API be extended so that we can get access to the information in another way?

          Ken Lamb added a comment - We have the same issue. I have a pipeline that generates more than 100 stageFlowNodes. I had always assumed there was a pagination API that I needed to utilize to get the remaining information. However, I just went looking for it and could not find it. Then, I found this. The fact that it has sat here for 6 months doesn't give me much hope that a resolution is soon to come. If there is a cap, can it be raised? If it cannot be raised, can the API be extended so that we can get access to the information in another way?

          Hey Ken,

          I made a post in their Google Groups and they said that the WorkFlowPluginAPI will be not be maintained soon. They suggested I use the BlueOcean Plugin API. 

          I was able to use the Blue Ocean API and produce the same results as the WorkFlowStagePlugin would have. I hope that helps!

           

          Natesh Kukreja added a comment - Hey Ken, I made a post in their Google Groups and they said that the WorkFlowPluginAPI will be not be maintained soon. They suggested I use the BlueOcean Plugin API.  I was able to use the Blue Ocean API and produce the same results as the WorkFlowStagePlugin would have. I hope that helps!  

          Ken Lamb added a comment -

          Thanks for the info.
          Does the Blue Ocean API have the 100 record limit? Or is it fixed there?

          Ken Lamb added a comment - Thanks for the info. Does the Blue Ocean API have the 100 record limit? Or is it fixed there?

          There's a pagination feature with the the Blue Ocean API, "?start=<int>". If you have 200 records, per say, you'd add this endpoint, after you've retrieved the first 100, and would include "?start=100" at the end of your request to retrieve the next 100 records.

          Natesh Kukreja added a comment - There's a pagination feature with the the Blue Ocean API, "?start=<int>". If you have 200 records, per say, you'd add this endpoint, after you've retrieved the first 100, and would include "?start=100" at the end of your request to retrieve the next 100 records.

          Ken Lamb added a comment -

          Cool. Thanks again for the info!

          Ken Lamb added a comment - Cool. Thanks again for the info!

            Unassigned Unassigned
            nateshkukreja Natesh Kukreja
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: