public inbox for goredo-devel@lists.stargrave.org
Atom feed
From: Sergey Matveev <stargrave@stargrave•org>
To: goredo-devel@lists.cypherpunks.su
Subject: Re: Memory exhaustion issues
Date: Sun, 8 Sep 2024 13:11:45 +0300 [thread overview]
Message-ID: <Zt14eg2FXPciEzsK@stargrave.org> (raw)
In-Reply-To: <1e69002a-0717-4a1b-a38f-b38d43de9a63@spacefrogg.net>
[-- Attachment #1: Type: text/plain, Size: 1403 bytes --]
Greetings!
*** goredo [2024-09-05 21:49]:
>Right now redo is free to run anyone of targets 10-19. Let's say it picks target 10. Starts executing until it hits redo-ifchange 100 ... 109. Blocks again. Now, redo can pick any target from 11-19 and 100-109. We have two more processes open.
I see you point, ok. But how can we run targets in parallel? The very
first process has redo-ifchange with 10 targets. It runs one of them.
But it does not know when (or if at all) that running job will run any
other targets further. So if we want to build two jobs in parallel, when
we should run the second job? We do not know if already running one will
run jobs further. If we will wait for its completion, then all spent
time we were running only a single target, without even trying to run
another job, wasted time.
If goredo runs redo-ifchange with thousand of targets, then it runs
runScript() function inside itself for each of those target. But it does
not create additional process until it gets the job token. If we run
with two jobs (-j 2) at most, and if already two jobs are running, then
no additional process will be created, until any of those jobs finishes
and returns job token back. Of course all of that will not work, if
number of allowed jobs is infinite.
--
Sergey Matveev (http://www.stargrave.org/)
OpenPGP: 12AD 3268 9C66 0D42 6967 FD75 CB82 0563 2107 AD8A
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]
next prev parent reply other threads:[~2024-09-08 10:12 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-08-19 10:12 Memory exhaustion issues spacefrogg
2024-09-05 18:49 ` Sergey Matveev
2024-09-05 19:49 ` goredo
2024-09-08 10:11 ` Sergey Matveev [this message]
2024-09-09 10:49 ` spacefrogg
2024-09-10 6:50 ` Sergey Matveev