Hi everyone,
OK it may be a long story… I’m using Virtuoso open source 06.01.3127 on Ubuntu
12.04.1 LTS (GNU/Linux 3.2.0-29-virtual x86_64). It had been running fine for
nearly two years until recently I setup hourly backup through System Admin in
Virtuoso Conductor. The regular backup worked fine for one day or two, then the
server began to crash with errors like:
15:55:26 INFO: Checkpoint finished, log reused
16:24:43 INFO: virtuoso-t() [0x8016c8]
16:24:43 INFO: virtuoso-t() [0x801736]
16:24:43 INFO: virtuoso-t() [0x74c88f]
16:24:43 INFO: virtuoso-t() [0x74d64f]
16:24:43 INFO: virtuoso-t() [0x4d6711]
16:24:43 INFO: virtuoso-t(insert_node_run+0x10c) [0x5820bc]
16:24:43 INFO: virtuoso-t(insert_node_input+0x96) [0x5841d6]
16:24:43 INFO: virtuoso-t() [0x55e540]
16:24:43 INFO: virtuoso-t() [0x560110]
16:24:43 INFO: virtuoso-t() [0x582b86]
16:24:43 INFO: virtuoso-t() [0x587a78]
16:24:43 INFO: virtuoso-t() [0x55c452]
16:24:43 INFO: virtuoso-t() [0x5600e6]
16:24:43 INFO: virtuoso-t() [0x582b86]
16:24:43 INFO: virtuoso-t() [0x587a78]
16:24:43 INFO: virtuoso-t() [0x55c452]
16:24:43 INFO: virtuoso-t() [0x5600e6]
16:24:43 INFO: virtuoso-t() [0x582c68]
16:24:43 INFO: virtuoso-t() [0x55da05]
16:24:43 INFO: virtuoso-t() [0x55da9b]
16:24:43 INFO: virtuoso-t() [0x56013a]
16:24:43 INFO: virtuoso-t() [0x582b86]
16:24:43 INFO: virtuoso-t() [0x58923c]
16:24:43 INFO: virtuoso-t() [0x59150c]
16:24:43 INFO: virtuoso-t(sf_sql_execute_w+0x7f) [0x591b4f]
16:24:43 INFO: virtuoso-t() [0x805918]
16:24:43 INFO: virtuoso-t() [0x8095ff]
16:24:43 INFO: /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7fa37de30e9a]
16:24:43 INFO: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fa37d6604bd]
16:24:43 ERROR: GPF: bitmap.c:693 singleton bm not in use
Restarting the database only let the database run for several hours then the
same error.
I thought it might just be some corrupt data so just did a crash dump and
restored the database and it was running fine again. I then turned on hourly
backup in Conductor again, after a day, it gave me a different error
09:46:00 INFO: Backing up page 2490000
09:46:00 INFO: Backing up page 2500000
09:46:00 INFO: Backing up page 2510000
09:46:00 INFO: Backing up page 2520000
09:46:00 ERROR: Exceeded maximum number of file descriptors in FD_SET.
09:46:00 INFO: Backed up pages: [7469]
09:46:20 ERROR: Exceeded maximum number of file descriptors in FD_SET.
09:46:40 ERROR: Exceeded maximum number of file descriptors in FD_SET.
09:47:00 ERROR: Exceeded maximum number of file descriptors in FD_SET.
09:47:20 ERROR: Exceeded maximum number of file descriptors in FD_SET.
09:47:40 ERROR: Exceeded maximum number of file descriptors in FD_SET.
*** buffer overflow detected ***: virtuoso-t terminated
*** buffer overflow detected ***: virtuoso-t terminated
======= Backtrace: =========
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x37)[0x7fc6245a5007]
…
…
It seemed the backup finished successfully(?) but the database became
unresponsive when the FD_SET error showed. Could it be that the database just
got too busy to serve both query requests and hot backup?
Googled the FD_SET error, someone sugguested it may be ServerThreads config is
too high. But i’m just using the default 100 setting.
I then restarted the database, logged into Conductor, System Admin, the server
reported error
10:06:40 INFO: Server online at 1111 (pid 5948)
*** glibc detected *** virtuoso-t: free(): invalid next size (normal):
0x00007fcef00819d0 ***
*** glibc detected *** virtuoso-t: malloc(): memory corruption:
0x00007fcef0082980 ***
I then restarted the database again for now it is running fine.
It’ll be nice if someone can give me advice to get around the FD_SET error.
BTW, is the backup function in this version of virtuoso buggy anyway? Hope I
don’t miss something. It’ll also be nice if someone can explain the previous
"singleton bm not in use” error.
Thank you very much.
------------------------------------------------------------------------------
Dive into the World of Parallel Programming! The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
