High redis commands/second on parallelization > 1 about rspecq

[siassaj]

Figured it out, It's partly my own fault;

Calling an rspecq worker with an empty file string is what causes it.

My script looks a bit like below, and where $FILES is empty it passes "" to rspecq, which doesn't handle it well.

for i in $range; do
  bundle exec rspecq --worker=$i "$FILES"
end

It causes most of rspecq's workers to just loop endlessly without any pause/sleep while (I think) 1 worker actually does run the test suite. Not sure why, I didn't dive in, but I think it's not populating redis properly. I can take a look later although at a glance it looks like perhaps there are no guards for empty ARGV members, I noticed

# bin/rspecq

...

worker.files_or_dirs_to_run = ARGV if ARGV.any?

...

so [""] would be passed along.

EDIT:
To add, when timings aren't accurate & some workers are "done" but others still have work the "done" workers may start to show the same behaviour, so it looks like a defensive return/sleep might be necessary for the loop.

I can put together a PR if you're likely to review it?

[fragoulis]

Hello @siassaj.

That is indeed very interesting. I just want you to know that unfortunately at the time we do not have the resources to catch up on rspecq, so this is going to have to wait. Thank you for the report however. It will be on our radar.

In the meantime, post your rspecq & redis configurations in order to cross-check them with ours, in case there is something obvious we can point you at.