LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Newbie (https://www.linuxquestions.org/questions/linux-newbie-8/)
-   -   system.journal grows about 1 MB/min, and filled with nonsence (https://www.linuxquestions.org/questions/linux-newbie-8/system-journal-grows-about-1-mb-min-and-filled-with-nonsence-4175725110/)

ShadowWizard 05-15-2023 11:42 PM

system.journal grows about 1 MB/min, and filled with nonsence
 
So I am using a nas based on Debian, OMV specifically, however since I think this question is related to the underlying OS, I thought I would ask here.
My system.journal file is growing by about 1 MB/min. Now its not like I can check it every minute and see it has gone up by 1 MB. It comes in bursts. 58 MB. 10 or so min later 64 MB. And it is filled with nonsencial garbage. I have tried to tails the last 20 lines, and it clears my screen and prints nonsence. I have downloaded it and looked at the file with Windows Notepad++ and it is filled with characters identified as "NUL" There are other random characters in there as well. Here is a small snipit (it seems to look much better here then in notepad++)
:
u#h 9 w24#h 9 i["*jnހ9 0OÈ 9 BةO\@9 R{X9 rLa9 o PX9 3) d9 R!^9 "(G `@9 D!DUAe 9 &
9 gp 0PT9>)*q jg-"y  m RȲ* q *q  MESSAGE=rrdcached plugin: rrdc_update (/var/lib/rrdcached/db/localhost/cpu-2/cpu-interrupt.rrd, [1684210457.413449:0], 1) failed: rrdcached@unix:/run/rrdcached.sock: illegal attempt to update using time 1684210457.413449 when last update time is 2632896112.000000 (minimum one second step) (status=-1)  k $O= *q *q  _SOURCE_REALTIME_TIMESTAMP=1684210457419991    \
  :


Is this just normal? Or is, as I suspect, an issue? And any idea how to track the issue down?
A bit more details in case it matters. I place them at the bottom as people only seem to read the first very little bit and then start answering.

I have been having a bit of issues with it lately. I ended up switching kernels, and that made the log files grow MUCH faster (100 GB in a few hours) but when I realised I was using the wrong kernel, I switched back to the other one. Don't know if that matters, thought I would mention it in case.

chrism01 05-15-2023 11:53 PM

Well, it's https://oss.oetiker.ch/rrdtool/doc/rrdcached.en.html , https://oss.oetiker.ch/rrdtool/doc/rrdtool.en.html, so it's trying to log data for display in graphs eg Cacti.
This first bit likely binary info used by the rrdtool.

ShadowWizard 05-15-2023 11:55 PM

So, I will repeat the question, and add a new one.

Is this normal?

And if not, how do I fix it?

lvm_ 05-16-2023 12:26 AM

Are you trying to view raw journal files? They are binary databases, well, key-value stores anyway, you should use journalctl to view them.

MadeInGermany 05-16-2023 12:28 AM

Yes it is likely a misconfigured rrdtool.
Check/reconfigure it!

syg00 05-16-2023 01:03 AM

Specifically the time. As a wild guess let's assume those cited time values are seconds since epoch. The last updated one is in 2053. The "attempt to update" one and the realtime clock are seemingly valid times today.

michaelk 05-16-2023 06:52 AM

I agree with MadeInGermany, it is a rrdtool problem. I do not know if this is your exact problem but it may help.

https://forum.openmediavault.org/ind...603#post196603

ShadowWizard 05-20-2023 09:02 PM

Thank you for clarifying it was a binary file. I assumed as a log file it was text, and was somehow being corrupted. Although I have it resolved, it is important information to have for next time I need to troubleshoot something.
Yes, that did seem to be the issue. I remember finding a post on the OMV forum that lead me to delete some files related to it (I can't remember where) and that resolved the issue. Everything has been working wonderfully for several days now.
Thank you to all those that posted to assist.


All times are GMT -5. The time now is 03:07 AM.