We are using Jenkins to test code running on embedded devices.
We have multiple nodes in our setup, each one has only one (1) embedded device attached to it.

We have two types of Jobs:

1. Some of our jobs require an embedded devices, they run tests on them. This type of jobs are matrix configurations because there are many versions of the embedded devices to test.
2. Some of our jobs do not require the embedded devices, they only compile code, they don't run any tests.

When tests are running on an embedded device (Job type 1), the node's CPU is mostly free. However, we cannot take advantage of this free CPU to run type 2 jobs because we can only have one executor per node.

We cannot have more then one executor per node because we don't have the "ability to throttle number of concurrent builds of matrix configurations per node" for type 1 jobs.

We need the "ability to throttle number of concurrent builds of matrix configurations per node" so that different configurations of a type 1 Job are not concurrently run on one node as each node only has one embedded device.

This would improvement would greatly increase the effectiveness of our continuous integration setup.

Do we have any improvements on this? We also need to throttle our matrix jobs.

Is there something I can help?

Would this work?
https://wiki.jenkins-ci.org/display/JENKINS/Throttle+Concurrent+Builds+Plugin

It appears that the Throttle Concurrent Builds Plugin only works at the parent level, which isn't what is wanted here.

I've raised an issue to fix this bug in the Throttle Concurrent Builds Plugin:

https://issues.jenkins-ci.org/browse/JENKINS-16521

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleJobProperty.java
src/main/java/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions.java
src/main/resources/hudson/plugins/throttleconcurrents/Messages.properties
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleJobProperty/config.jelly
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions/config.jelly
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions/config.properties
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/c8280ad3ac3c4faf9b69e0401800813a5953dcfa
Log:
JENKINS-13619 - Added configuration options for Matrix project's throttling

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

I've tested your branch (https://github.com/jenkinsci/throttle-concurrent-builds-plugin/tree/multiconfig_throttle_support), just had to rebase and remove the ifs that prevent matrix jobs and it works well for me.

I've also seen this pull request done 5 months ago:
https://github.com/jenkinsci/throttle-concurrent-builds-plugin/pull/11

But haven't tested it yet.

Is there anything I can do to get it done faster? Should I just send a pull request with the rebased code? Or should I reuse the pull request? If so, what's missing there?

Thanks!!

@David
Thanks for the reminder.
I'll merge one of two branches soon

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions.java
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions/config.jelly
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/bdad9a686a8ecf66aad00d17b85388520e935b58
Log:
JENKINS-13619 - Display default values in multi-config checkboxes

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/739c4a737841c822edae313a1081b6d9cdc91de9
Log:
JENKINS-13619 - Check configured options for multi-config throttling

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

Conflicts:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/610834a0b68d5ce7489cfaa45193402ea5eb27cb
Log:
JENKINS-13619 - Committed missing changes

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

Conflicts:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions.java
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions/config.jelly
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/400e7e9f3c67b088e8664d7c89afd7ba70e11dba
Log:
JENKINS-13619 - Display default values in multi-config checkboxes

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/6afbb76840be76864a464fbbb1ecf60ac497e13a
Log:
JENKINS-13619 - Check configured options for multi-config throttling

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

Code changed in jenkins
User: Oleg Nenashev
Path:
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/8962bbbf73909f7835af77bde391987c150a2fca
Log:
JENKINS-13619 - Committed missing changes

Signed-off-by: Oleg Nenashev <o.v.nenashev@gmail.com>

Compare: https://github.com/jenkinsci/throttle-concurrent-builds-plugin/compare/c8280ad3ac3c...8962bbbf7390

Code changed in jenkins
User: Oleg Nenashev
Path:
pom.xml
src/main/java/hudson/plugins/throttleconcurrents/ThrottleJobProperty.java
src/main/java/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions.java
src/main/java/hudson/plugins/throttleconcurrents/ThrottleQueueTaskDispatcher.java
src/main/resources/hudson/plugins/throttleconcurrents/Messages.properties
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleJobProperty/config.jelly
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions/config.jelly
src/main/resources/hudson/plugins/throttleconcurrents/ThrottleMatrixProjectOptions/config.properties
src/test/java/hudson/plugins/throttleconcurrents/ThrottleJobPropertyTest.java
http://jenkins-ci.org/commit/throttle-concurrent-builds-plugin/abd999baf869d0bc598ed6fc522303c629117ed3
Log:
Merge pull request #18 from jenkinsci/throttle-matrix-configurations

JENKINS-13619 - Throttle matrix configurations

Compare: https://github.com/jenkinsci/throttle-concurrent-builds-plugin/compare/4fa0bb541fbb...abd999baf869

Attached the plugin package from https://jenkins.ci.cloudbees.com/job/plugins/job/throttle-concurrent-builds-plugin/33/org.jenkins-ci.plugins$throttle-concurrents/

Marking as resolved (1.8.3). There will be several improvements in 1.8.4

Sorry to re-surface such an old thread. I am trying to do exactly the same thing. I have a matrix build of N child jobs, and M nodes. Each node can only execute one child job at the same time, while child jobs on different nodes don't interfere with each other. Child jobs from different builds don't interfere with each other as long as they don't run on the same node.

Is there any example that shows how this can be set up? Right now I observe multiple child jobs being scheduled on the same node. My current configuration (in groovy DSL) is like this (I deleted a bunch of unrelated stuff to make it clearer). Thanks.

def numShards = 5
matrixJob('XXXX') {
  description('XXXX')
  axes {
    text('SHARD', (0..(numShards - 1)).collect { it.toString() })
    label('slaves', "some-label")
  }
  concurrentBuild()
  throttleConcurrentBuilds {
    maxPerNode(1)
  }
  steps {
    shell('some command')
  }
}