public inbox for goredo-devel@lists.stargrave.org
Atom feed
From: Sergey Matveev <stargrave@stargrave•org>
To: goredo-devel@lists.cypherpunks.ru
Subject: Re: Unclear what target the output relates to
Date: Sat, 23 Sep 2023 22:17:10 +0300 [thread overview]
Message-ID: <ZQ85t03AQr4vkNo0@stargrave.org> (raw)
In-Reply-To: <3029e69b0d59a814b5bf23c0b4a8e4df@spacefrogg.net>
[-- Attachment #1: Type: text/plain, Size: 2134 bytes --]
Greetings!
*** spacefrogg [2023-09-21 19:12]:
>3. The output of redo has become useless for larger amounts of targets that
>can run in parallel. [...]
>4. In light of no. 3, I have a small feature request: The output of targets
>can be very confusing, because it is unclear at first, what target the
>output relates to.
Do I correctly understand that by "target's output" you mean stderr's
output of the running target? I understand that target's stdout will be
saved in file, but just asking for correct understanding.
By default stderr is not intercepted at all -- if target write something
to it, then it just passes as is transparently to goredo. If you enable
logs keeping (-k/REDO_LOGS=1), then goredo will intercept stderr, saving
it to the file of the corresponding target (.redo/TGT.log), and each
read line is immediately also printed to goredo's stderr, without any
long-term buffering at all too.
But I do not understand how anything can be human readable if you run
many targets in parallel. You can buffer their stderr output in memory
and print only after they are finished -- but in that case you won't see
their real-time instantly written lines. As far as I remember,
apenwarr/redo can show kept logs grouped together and ordered in
chronological order. I made that in goredo's "redo-log -r" command the
same way. You can watch kept logs after the build in a friendly and sane
manner. I think that you need either convenient, properly ordered
(linearized, https://apenwarr.ca/log/20181106) logs viewing, that
"redo-log -r" tries to give, or you need instant unbuffered output just
to understand how that the progress of your build is going further,
nothing is stuck. Imagine hundreds of targets printing to stderr in
parallel, where each line of the output can be produced by different
target.
Maybe (optional) prepending of target's name to each stderr's line may
be enough convenient to watch the progress? I hope I will try to check
its usefulness tomorrow.
--
Sergey Matveev (http://www.stargrave.org/)
OpenPGP: 12AD 3268 9C66 0D42 6967 FD75 CB82 0563 2107 AD8A
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]
next prev parent reply other threads:[~2023-09-23 19:17 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-09-21 19:12 Several issues since 1.30 spacefrogg
2023-09-23 19:16 ` resource deadlock avoided messages Sergey Matveev
2023-09-24 11:17 ` goredo
2023-09-25 16:14 ` Sergey Matveev
2023-09-23 19:16 ` Target runs multiple times in single session Sergey Matveev
2023-09-23 19:17 ` Slow/buffered output of targets finished messages Sergey Matveev
2023-09-23 19:17 ` Sergey Matveev [this message]
2023-09-24 11:10 ` Unclear what target the output relates to goredo
2023-09-25 16:20 ` Sergey Matveev
2023-09-28 13:55 ` spacefrogg
2023-09-30 16:57 ` Sergey Matveev
2023-10-16 13:24 ` Sergey Matveev