public inbox for goredo-devel@lists.stargrave.org
Atom feed
From: Sergey Matveev <stargrave@stargrave•org>
To: goredo-devel@lists.cypherpunks.ru
Subject: Re: Slow/buffered output of targets finished messages
Date: Sat, 23 Sep 2023 22:17:00 +0300 [thread overview]
Message-ID: <ZQ85rMpVN5AhY_mn@stargrave.org> (raw)
In-Reply-To: <3029e69b0d59a814b5bf23c0b4a8e4df@spacefrogg.net>
[-- Attachment #1: Type: text/plain, Size: 1354 bytes --]
Greetings!
*** spacefrogg [2023-09-21 19:12]:
>3. The output of redo has become useless for larger amounts of targets that
>can run in parallel.
Although I use goredo everyday with projects of at least dozens of
dependencies, they build pretty quickly so I did not notice that
behaviour. I created 1k of targets with sleep 0.1 and indeed I see the
progress bar constantly refreshing, but no "redo" lines appearing until
they all printed at once at the very end.
That was not about buffering, but when goredo make the list of targets
needed to be done, it starts them in a for-loop. runScript() is not a
very quick operation itself. So just running each target takes
relatively considerable amount of time. And only after all of targets
are started, next for-loop starts collecting their results, collecting
either they succeeded or not. When that loop is started, actually most
of the targets can be already done, but the code that prints that
information just was not started at all.
In 1.31.0 release I moved that status-collecting code to a separate
goroutine working in parallel with targets running. Now it will show
success/failure message about the finished target nearly instantly.
Thanks for the report!
--
Sergey Matveev (http://www.stargrave.org/)
OpenPGP: 12AD 3268 9C66 0D42 6967 FD75 CB82 0563 2107 AD8A
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]
next prev parent reply other threads:[~2023-09-23 19:17 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-09-21 19:12 Several issues since 1.30 spacefrogg
2023-09-23 19:16 ` resource deadlock avoided messages Sergey Matveev
2023-09-24 11:17 ` goredo
2023-09-25 16:14 ` Sergey Matveev
2023-09-23 19:16 ` Target runs multiple times in single session Sergey Matveev
2023-09-23 19:17 ` Sergey Matveev [this message]
2023-09-23 19:17 ` Unclear what target the output relates to Sergey Matveev
2023-09-24 11:10 ` goredo
2023-09-25 16:20 ` Sergey Matveev
2023-09-28 13:55 ` spacefrogg
2023-09-30 16:57 ` Sergey Matveev
2023-10-16 13:24 ` Sergey Matveev