Queues thread definition vs max_threads

[jamesst20]

Hi,

By reading the README, I was unable to answer myself the following questions

If I define the following

  config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;-ai,pull,enqueue,push"
  config.good_job.max_threads = 5

How many threads in total will it use? Is it 5 or is it 5+2+1+1 (+5?)
How many threads will -ai,pull,enqueue,push (any queue but ai, pull, enqueue and push) use?

What is the difference between

  config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;-ai,pull,enqueue,push"

and

  config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;*"

Thank you

[bensheldon]

"max_threads" today means "default (max) threads per pool"

So this:

config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;-ai,pull,enqueue,push"
config.good_job.max_threads = 5

...is equivalent to:

config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;-ai,pull,enqueue,push:5" #<-- adds the '5' to that last group

So that would be 14 threads total: 5 + 2 + 1 + 1 + 5

[jamesst20]

This make sense!

Could you also tell me the difference between these 2?

config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;-ai,pull,enqueue,push:5"
config.good_job.queues = "ai:5;pull:2;+enqueue,pull:1;push:1;*:5"

I'm wondering if by declaring a wildcard * this means ai or pull or enqueue will also go into that group or if it is equivalent

[hungmi]

@jamesst20
You can try to puts those info at the parsed_queues

def parsed_queues
  @_parsed_queues ||= GoodJob::Execution.queue_parser(queue_string)
  puts "-----------------------------"
  puts queue_string
  puts @_parsed_queues
  puts "-----------------------------"
  @_parsed_queues
end

and start GoodJob on your local machine with the queue you want to test:
GOOD_JOB_QUEUES="ai:5;pull:2;+enqueue,pull:1;push:1;-ai,pull,enqueue,push:5" bundle exec good_job

For example, the above will output:

[GoodJob] [23462] GoodJob 3.21.5 started scheduler with queues=ai max_threads=5.
[GoodJob] [23462] GoodJob 3.21.5 started scheduler with queues=pull max_threads=2.
[GoodJob] [23462] GoodJob 3.21.5 started scheduler with queues=+enqueue,pull max_threads=1.
[GoodJob] [23462] GoodJob 3.21.5 started scheduler with queues=push max_threads=1.
[GoodJob] [23462] GoodJob 3.21.5 started scheduler with queues=-ai,pull,enqueue,push max_threads=5.
[GoodJob] Notifier subscribed with LISTEN
-----------------------------
ai
{:include=>["ai"]}
-----------------------------
-----------------------------
push
{:include=>["push"]}
-----------------------------
-----------------------------
-ai,pull,enqueue,push
{:exclude=>["ai", "pull", "enqueue", "push"]}
-----------------------------
-----------------------------
pull
{:include=>["pull"]}
-----------------------------
-----------------------------
+enqueue,pull
{:include=>["enqueue", "pull"], :ordered_queues=>true}
-----------------------------
...

This way, you can read the parsed results and sum all the threads of the schedulers.