在使用CentOS7.9.x的時候發現一個問題，經常受到一些關於SystemD的郵件, 內容在文章末尾。這個問題似乎與XFS或者BTRFS的文件系統有關：https://github.com/coreos/bugs/issues/263 ，推薦更換爲EXT4文件系統！
From [email protected] Tue Apr 9 20:53:32 2019
Return-Path: <[email protected]>
X-Original-To: root@localhost
Delivered-To: [email protected]
Received: by media.localdomain (Postfix, from userid 0)
id 58B3320DDD38; Tue, 9 Apr 2019 20:53:32 +0800 (CST)
Date: Tue, 09 Apr 2019 20:53:32 +0800
From: [email protected]
To: [email protected]
Subject: [abrt] systemd: systemd-journald killed by SIGABRT
Message-ID: <5cac95cc.fMOFNdCqdjcBcPWZ%user@localhost>
User-Agent: Heirloom mailx 12.5 7/5/10
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
reason: systemd-journald killed by SIGABRT
cmdline: /usr/lib/systemd/systemd-journald
executable: /usr/lib/systemd/systemd-journald
package: systemd-219-62.el7_6.5
component: systemd
pid: 3319
pwd: /
hostname: media
count: 1
abrt_version: 2.1.11
analyzer: CCpp
architecture: x86_64
event_log:
global_pid: 3319
kernel: 3.10.0-957.10.1.el7.x86_64
last_occurrence: 1554814410
os_release: CentOS Linux release 7.6.1810 (Core)
pkg_arch: x86_64
pkg_epoch: 0
pkg_fingerprint: 24C6 A8A7 F4A8 0EB5
pkg_name: systemd
pkg_release: 62.el7_6.5
pkg_vendor: CentOS
pkg_version: 219
runlevel: N 3
time: Tue 09 Apr 2019 08:53:30 PM CST
type: CCpp
uid: 0
username: root
uuid: 8890ac70ca361632cdfa28d528610e1d8d106c11
core_backtrace:
:{ "signal": 6
:, "executable": "/usr/lib/systemd/systemd-journald"
:, "stacktrace":
: [ { "crash_thread": true
: , "frames":
: [ { "address": 139965039475793
: , "build_id": "a644e865a1f672b46a1232f7c275f53b06042696"
: , "build_id_offset": 1363025
: , "function_name": "__memcpy_ssse3"
: , "file_name": "/usr/lib64/libc-2.17.so"
: }
: , { "address": 94581787583865
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 87417
: , "function_name": "journal_file_append_data"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787590060
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 93612
: , "function_name": "journal_file_append_entry"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787545656
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 49208
: , "function_name": "dispatch_message_real"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787556047
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 59599
: , "function_name": "server_dispatch_message"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787526330
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 29882
: , "function_name": "server_read_dev_kmsg"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787646832
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 150384
: , "function_name": "source_dispatch"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787650362
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 153914
: , "function_name": "sd_event_dispatch"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: }
: , { "address": 94581787523917
: , "build_id": "e5310ce4d2a8eed32cac75ef9cf414f81fd4ac52"
: , "build_id_offset": 27469
: , "function_name": "main"
: , "file_name": "/usr/lib/systemd/systemd-journald"
: } ]
: } ]
:}
cgroup:
:11:pids:/
:10:hugetlb:/
:9:perf_event:/
:8:devices:/
:7:freezer:/
:6:cpuset:/
:5:memory:/
:4:net_prio,net_cls:/
:3:blkio:/
:2:cpuacct,cpu:/
:1:name=systemd:/system.slice/systemd-journald.service
dso_list:
:/usr/lib64/libgcc_s-4.8.5-20150702.so.1 libgcc-4.8.5-36.el7_6.1.x86_64 (CentOS) 1554756542
:/usr/lib64/liblzma.so.5.2.2 xz-libs-5.2.2-1.el7.x86_64 (CentOS) 1554755661
:/usr/lib64/libc-2.17.so glibc-2.17-260.el7_6.3.x86_64 (CentOS) 1554756555
:/usr/lib64/libattr.so.1.1.0 libattr-2.4.46-13.el7.x86_64 (CentOS) 1554755657
:/usr/lib/systemd/systemd-journald systemd-219-62.el7_6.5.x86_64 (CentOS) 1554756562
:/usr/lib64/ld-2.17.so glibc-2.17-260.el7_6.3.x86_64 (CentOS) 1554756555
:/usr/lib64/liblz4.so.1.7.5 lz4-1.7.5-2.el7.x86_64 (CentOS) 1554755675
:/usr/lib64/libpcre.so.1.2.0 pcre-8.32-17.el7.x86_64 (CentOS) 1554755658
:/usr/lib64/libacl.so.1.1.0 libacl-2.2.51-14.el7.x86_64 (CentOS) 1554755657
:/usr/lib64/libgcrypt.so.11.8.2 libgcrypt-1.5.3-14.el7.x86_64 (CentOS) 1554755662
:/usr/lib64/libdl-2.17.so glibc-2.17-260.el7_6.3.x86_64 (CentOS) 1554756555
:/usr/lib64/librt-2.17.so glibc-2.17-260.el7_6.3.x86_64 (CentOS) 1554756555
:/usr/lib64/libselinux.so.1 libselinux-2.5-14.1.el7.x86_64 (CentOS) 1554755658
:/usr/lib64/libgpg-error.so.0.10.0 libgpg-error-1.12-3.el7.x86_64 (CentOS) 1554755662
:/usr/lib64/libpthread-2.17.so glibc-2.17-260.el7_6.3.x86_64 (CentOS) 1554756555
environ:
:LANG=en_US.UTF-8
:PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
:NOTIFY_SOCKET=/run/systemd/notify
:LISTEN_PID=3319
:LISTEN_FDS=3
:WATCHDOG_PID=3319
:WATCHDOG_USEC=180000000
limits:
:Limit Soft Limit Hard Limit Units
:Max cpu time unlimited unlimited seconds
:Max file size unlimited unlimited bytes
:Max data size unlimited unlimited bytes
:Max stack size 8388608 unlimited bytes
:Max core file size 0 unlimited bytes
:Max resident set unlimited unlimited bytes
:Max processes 7838 7838 processes
:Max open files 16384 16384 files
:Max locked memory 65536 65536 bytes
:Max address space unlimited unlimited bytes
:Max file locks unlimited unlimited locks
:Max pending signals 7838 7838 signals
:Max msgqueue size 819200 819200 bytes
:Max nice priority 0 0
:Max realtime priority 0 0
:Max realtime timeout unlimited unlimited us
machineid:
:systemd=a6aca66421814b6faca31d93bfda5e9e
:sosreport_uploader-dmidecode=63389bc031ea8073e8bd792e33cdcb530b3a3c11cde634206993ce5e77485665
maps:
:560589d89000-560589dda000 r-xp 00000000 08:02 272931 /usr/lib/systemd/systemd-journald
:560589fd9000-560589fdb000 r--p 00050000 08:02 272931 /usr/lib/systemd/systemd-journald
:560589fdb000-560589fdc000 rw-p 00052000 08:02 272931 /usr/lib/systemd/systemd-journald
:56058a5ec000-56058a66b000 rw-p 00000000 00:00 0 [heap]
:7f4c2559b000-7f4c25d9b000 rw-s 00000000 00:14 9694 /run/log/journal/a6aca66421814b6faca31d93bfda5e9e/system.journal
:7f4c25d9b000-7f4c25d9f000 r-xp 00000000 08:02 50517885 /usr/lib64/libattr.so.1.1.0
:7f4c25d9f000-7f4c25f9e000 ---p 00004000 08:02 50517885 /usr/lib64/libattr.so.1.1.0
:7f4c25f9e000-7f4c25f9f000 r--p 00003000 08:02 50517885 /usr/lib64/libattr.so.1.1.0
:7f4c25f9f000-7f4c25fa0000 rw-p 00004000 08:02 50517885 /usr/lib64/libattr.so.1.1.0
:7f4c25fa0000-7f4c26000000 r-xp 00000000 08:02 50386221 /usr/lib64/libpcre.so.1.2.0
:7f4c26000000-7f4c26200000 ---p 00060000 08:02 50386221 /usr/lib64/libpcre.so.1.2.0
:7f4c26200000-7f4c26201000 r--p 00060000 08:02 50386221 /usr/lib64/libpcre.so.1.2.0
:7f4c26201000-7f4c26202000 rw-p 00061000 08:02 50386221 /usr/lib64/libpcre.so.1.2.0
:7f4c26202000-7f4c26204000 r-xp 00000000 08:02 50517381 /usr/lib64/libdl-2.17.so
:7f4c26204000-7f4c26404000 ---p 00002000 08:02 50517381 /usr/lib64/libdl-2.17.so
:7f4c26404000-7f4c26405000 r--p 00002000 08:02 50517381 /usr/lib64/libdl-2.17.so
:7f4c26405000-7f4c26406000 rw-p 00003000 08:02 50517381 /usr/lib64/libdl-2.17.so
:7f4c26406000-7f4c2640a000 r-xp 00000000 08:02 50403516 /usr/lib64/libgpg-error.so.0.10.0
:7f4c2640a000-7f4c26609000 ---p 00004000 08:02 50403516 /usr/lib64/libgpg-error.so.0.10.0
:7f4c26609000-7f4c2660a000 r--p 00003000 08:02 50403516 /usr/lib64/libgpg-error.so.0.10.0
:7f4c2660a000-7f4c2660b000 rw-p 00004000 08:02 50403516 /usr/lib64/libgpg-error.so.0.10.0
:7f4c2660b000-7f4c267cd000 r-xp 00000000 08:02 50517375 /usr/lib64/libc-2.17.so
:7f4c267cd000-7f4c269cd000 ---p 001c2000 08:02 50517375 /usr/lib64/libc-2.17.so
:7f4c269cd000-7f4c269d1000 r--p 001c2000 08:02 50517375 /usr/lib64/libc-2.17.so
:7f4c269d1000-7f4c269d3000 rw-p 001c6000 08:02 50517375 /usr/lib64/libc-2.17.so
:7f4c269d3000-7f4c269d8000 rw-p 00000000 00:00 0
:7f4c269d8000-7f4c269ef000 r-xp 00000000 08:02 50517720 /usr/lib64/libpthread-2.17.so
:7f4c269ef000-7f4c26bee000 ---p 00017000 08:02 50517720 /usr/lib64/libpthread-2.17.so
:7f4c26bee000-7f4c26bef000 r--p 00016000 08:02 50517720 /usr/lib64/libpthread-2.17.so
:7f4c26bef000-7f4c26bf0000 rw-p 00017000 08:02 50517720 /usr/lib64/libpthread-2.17.so
:7f4c26bf0000-7f4c26bf4000 rw-p 00000000 00:00 0
:7f4c26bf4000-7f4c26c09000 r-xp 00000000 08:02 50357600 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
:7f4c26c09000-7f4c26e08000 ---p 00015000 08:02 50357600 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
:7f4c26e08000-7f4c26e09000 r--p 00014000 08:02 50357600 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
:7f4c26e09000-7f4c26e0a000 rw-p 00015000 08:02 50357600 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
:7f4c26e0a000-7f4c26e11000 r-xp 00000000 08:02 50517725 /usr/lib64/librt-2.17.so
:7f4c26e11000-7f4c27010000 ---p 00007000 08:02 50517725 /usr/lib64/librt-2.17.so
:7f4c27010000-7f4c27011000 r--p 00006000 08:02 50517725 /usr/lib64/librt-2.17.so
:7f4c27011000-7f4c27012000 rw-p 00007000 08:02 50517725 /usr/lib64/librt-2.17.so
:7f4c27012000-7f4c27019000 r-xp 00000000 08:02 50517887 /usr/lib64/libacl.so.1.1.0
:7f4c27019000-7f4c27219000 ---p 00007000 08:02 50517887 /usr/lib64/libacl.so.1.1.0
:7f4c27219000-7f4c2721a000 r--p 00007000 08:02 50517887 /usr/lib64/libacl.so.1.1.0
:7f4c2721a000-7f4c2721b000 rw-p 00008000 08:02 50517887 /usr/lib64/libacl.so.1.1.0
:7f4c2721b000-7f4c2723f000 r-xp 00000000 08:02 50386230 /usr/lib64/libselinux.so.1
:7f4c2723f000-7f4c2743e000 ---p 00024000 08:02 50386230 /usr/lib64/libselinux.so.1
:7f4c2743e000-7f4c2743f000 r--p 00023000 08:02 50386230 /usr/lib64/libselinux.so.1
:7f4c2743f000-7f4c27440000 rw-p 00024000 08:02 50386230 /usr/lib64/libselinux.so.1
:7f4c27440000-7f4c27442000 rw-p 00000000 00:00 0
:7f4c27442000-7f4c274bf000 r-xp 00000000 08:02 50403530 /usr/lib64/libgcrypt.so.11.8.2
:7f4c274bf000-7f4c276be000 ---p 0007d000 08:02 50403530 /usr/lib64/libgcrypt.so.11.8.2
:7f4c276be000-7f4c276bf000 r--p 0007c000 08:02 50403530 /usr/lib64/libgcrypt.so.11.8.2
:7f4c276bf000-7f4c276c2000 rw-p 0007d000 08:02 50403530 /usr/lib64/libgcrypt.so.11.8.2
:7f4c276c2000-7f4c276c3000 rw-p 00000000 00:00 0
:7f4c276c3000-7f4c276d7000 r-xp 00000000 08:02 50474667 /usr/lib64/liblz4.so.1.7.5
:7f4c276d7000-7f4c278d6000 ---p 00014000 08:02 50474667 /usr/lib64/liblz4.so.1.7.5
:7f4c278d6000-7f4c278d7000 r--p 00013000 08:02 50474667 /usr/lib64/liblz4.so.1.7.5
:7f4c278d7000-7f4c278d8000 rw-p 00014000 08:02 50474667 /usr/lib64/liblz4.so.1.7.5
:7f4c278d8000-7f4c278fd000 r-xp 00000000 08:02 50403202 /usr/lib64/liblzma.so.5.2.2
:7f4c278fd000-7f4c27afc000 ---p 00025000 08:02 50403202 /usr/lib64/liblzma.so.5.2.2
:7f4c27afc000-7f4c27afd000 r--p 00024000 08:02 50403202 /usr/lib64/liblzma.so.5.2.2
:7f4c27afd000-7f4c27afe000 rw-p 00025000 08:02 50403202 /usr/lib64/liblzma.so.5.2.2
:7f4c27afe000-7f4c27b20000 r-xp 00000000 08:02 50517367 /usr/lib64/ld-2.17.so
:7f4c27d0e000-7f4c27d16000 rw-p 00000000 00:00 0
:7f4c27d1d000-7f4c27d1e000 rw-s 00000000 00:14 9687 /run/systemd/journal/kernel-seqnum
:7f4c27d1e000-7f4c27d1f000 rw-p 00000000 00:00 0
:7f4c27d1f000-7f4c27d20000 r--p 00021000 08:02 50517367 /usr/lib64/ld-2.17.so
:7f4c27d20000-7f4c27d21000 rw-p 00022000 08:02 50517367 /usr/lib64/ld-2.17.so
:7f4c27d21000-7f4c27d22000 rw-p 00000000 00:00 0
:7fffb6a70000-7fffb6a91000 rw-p 00000000 00:00 0 [stack]
:7fffb6baa000-7fffb6bac000 r-xp 00000000 00:00 0 [vdso]
:ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
open_fds:
:0:/dev/null
:pos: 0
:flags: 0100000
:mnt_id: 20
:1:/dev/null
:pos: 0
:flags: 0100001
:mnt_id: 20
:2:/dev/null
:pos: 0
:flags: 0100001
:mnt_id: 20
:3:socket:[11417]
:pos: 0
:flags: 02004002
:mnt_id: 7
:4:socket:[11420]
:pos: 0
:flags: 02004002
:mnt_id: 7
:5:socket:[11422]
:pos: 0
:flags: 02004002
:mnt_id: 7
:6:/dev/kmsg
:pos: 0
:flags: 02100001
:mnt_id: 20
:7:anon_inode:[eventpoll]
:pos: 0
:flags: 02000002
:mnt_id: 10
:tfd: 16 events: 19 data: 56058a5f67d0
:tfd: 19 events: 19 data: 56058a5f7570
:tfd: 15 events: 19 data: 56058a5f60b0
:tfd: 18 events: 19 data: 56058a5f6410
:tfd: 17 events: 19 data: 56058a5f61b0
:tfd: 5 events: 19 data: 56058a5ee470
:tfd: 4 events: 19 data: 56058a5ee570
:tfd: 3 events: 19 data: 56058a5ee370
:tfd: 20 events: 19 data: 56058a5f7760
:tfd: 24 events: 19 data: 56058a5fcfc0
:tfd: 9 events: 18 data: 56058a5ee770
:tfd: 8 events: 19 data: 56058a5ee670
:tfd: 12 events: 19 data: 3
:tfd: 21 events: 19 data: 56058a5f79c0
:tfd: 10 events: 19 data: 6
:tfd: 14 events: 19 data: 56058a5f7d60
:tfd: 23 events: 19 data: 56058a5fbd20
:8:/dev/kmsg
:pos: 0
:flags: 02104002
:mnt_id: 20
:9:/proc/sys/kernel/hostname
:pos: 0
:flags: 02104000
:mnt_id: 19
:10:anon_inode:[signalfd]
:pos: 0
:flags: 02004002
:mnt_id: 10
:sigmask: 0000000000004a02
:11:socket:[20468]
:pos: 0
:flags: 02004002
:mnt_id: 7
:12:anon_inode:[timerfd]
:pos: 0
:flags: 02004002
:mnt_id: 10
:clockid: 1
:ticks: 0
:settime flags: 01
:it_value: (139, 270842763)
:it_interval: (0, 0)
:13:/run/log/journal/a6aca66421814b6faca31d93bfda5e9e/system.journal
:pos: 0
:flags: 02100002
:mnt_id: 24
:14:socket:[33546]
:pos: 0
:flags: 02004002
:mnt_id: 7
:15:socket:[32825]
:pos: 0
:flags: 02004002
:mnt_id: 7
:16:socket:[23725]
:pos: 0
:flags: 02004002
:mnt_id: 7
:17:socket:[33025]
:pos: 0
:flags: 02004002
:mnt_id: 7
:18:socket:[33059]
:pos: 0
:flags: 02004002
:mnt_id: 7
:19:socket:[33068]
:pos: 0
:flags: 02004002
:mnt_id: 7
:20:socket:[33121]
:pos: 0
:flags: 02004002
:mnt_id: 7
:21:socket:[33172]
:pos: 0
:flags: 02004002
:mnt_id: 7
os_info:
:NAME="CentOS Linux"
:VERSION="7 (Core)"
:ID="centos"
:ID_LIKE="rhel fedora"
:VERSION_ID="7"
:PRETTY_NAME="CentOS Linux 7 (Core)"
:ANSI_COLOR="0;31"
:CPE_NAME="cpe:/o:centos:centos:7"
:HOME_URL="https://www.centos.org/"
:BUG_REPORT_URL="https://bugs.centos.org/"
:
:CENTOS_MANTISBT_PROJECT="CentOS-7"
:CENTOS_MANTISBT_PROJECT_VERSION="7"
:REDHAT_SUPPORT_PRODUCT="centos"
:REDHAT_SUPPORT_PRODUCT_VERSION="7"
:
proc_pid_status:
:Name: systemd-journal
:Umask: 0022
:State: S (sleeping)
:Tgid: 3319
:Ngid: 0
:Pid: 3319
:PPid: 1
:TracerPid: 0
:Uid: 0 0 0 0
:Gid: 0 0 0 0
:FDSize: 64
:Groups:
:VmPeak: 47676 kB
:VmSize: 39456 kB
:VmLck: 0 kB
:VmPin: 0 kB
:VmHWM: 5484 kB
:VmRSS: 880 kB
:RssAnon: 112 kB
:RssFile: 20 kB
:RssShmem: 748 kB
:VmData: 604 kB
:VmStk: 132 kB
:VmExe: 324 kB
:VmLib: 3464 kB
:VmPTE: 96 kB
:VmSwap: 240 kB
:Threads: 1
:SigQ: 0/7838
:SigPnd: 0000000000000000
:ShdPnd: 0000000000000000
:SigBlk: 0000000000004a02
:SigIgn: 0000000000001000
:SigCgt: 0000000180000040
:CapInh: 0000000000000000
:CapPrm: 00000005402800cf
:CapEff: 00000005402800cf
:CapBnd: 00000005402800cf
:CapAmb: 0000000000000000
:Seccomp: 0
:Speculation_Store_Bypass: vulnerable
:Cpus_allowed: ffffffff,ffffffff,ffffffff,ffffffff
:Cpus_allowed_list: 0-127
:Mems_allowed: 00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000000,00000001
:Mems_allowed_list: 0
:voluntary_ctxt_switches: 2676
:nonvoluntary_ctxt_switches: 43
var_log_messages:
:[System Logs]:
:Apr 09 19:40:59 media systemd-journald[104]: Received SIGTERM from PID 1 (systemd).
:Apr 09 20:53:02 media systemd[1]: systemd-journald.service watchdog timeout (limit 3min)!
:Apr 09 20:53:30 media abrt-hook-ccpp[30227]: Process 3319 (systemd-journald) of user 0 killed by SIGABRT - dumping core:[User Logs]:
:Apr 09 20:53:02 media systemd[1]: systemd-journald.service watchdog timeout (limit 3min)!
:Apr 09 20:53:30 media abrt-hook-ccpp[30227]: Process 3319 (systemd-journald) of user 0 killed by SIGABRT - dumping core