Is logging within circus multiprocess safe?

[varunbpatil]

If I have numprocesses > 1, do the logs from each of those processes get written to StdoutStream or *FileStream in a multiprocess-safe manner ? i.e, do the outputs from each of the processes interfere with each other and become garbled? I don't see any locking in the implementation of the streams.

If it is not multiprocess-safe, how do I go about making it multiprocess-safe? Do I have to implement a new stream like a SocketStream on the lines of this example?

[biozz]

Hi @varunbpatil.

There is no locking mechanisms in circus, several processes will just output when they are ready. This means that you can expect having things like this in your log files (latest entry has earlier timestamp):

2020-10-01T23:30:56.422724 - 41023:13
2020-10-01T23:30:56.422717 - 41028:12

I don't have much experience making multiprocess-safe stuff, so I couldn't advise you on how to implement this. You are always welcome to submit PRs to add this functionality in circus.