Hi, Chris, First, I had to fix an error in your test by adding " PetscCallA(MatSetFromOptions(AA,ierr))" at line 254.
[0]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [0]PETSC ERROR: Object is in wrong state [0]PETSC ERROR: Mat object's type is not set: Argument # 1 ... [0]PETSC ERROR: #1 MatSetValues() at /scratch/jczhang/petsc/src/mat/interface/matrix.c:1503 [0]PETSC ERROR: #2 ex2f.F90:258 Then I could ran the test without problems mpirun -n 2 ./ex2f -pc_type jacobi -ksp_monitor_short -ksp_gmres_cgs_refinement_type refine_always 0 KSP Residual norm 1.11803 1 KSP Residual norm 0.591608 2 KSP Residual norm 0.316228 3 KSP Residual norm < 1.e-11 0 KSP Residual norm 0.707107 1 KSP Residual norm 0.408248 2 KSP Residual norm < 1.e-11 Norm of error < 1.e-12 iterations 3 I used petsc-3.22.4, gcc-11.3, openmpi-5.0.6 and configured with ./configure --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-openmpi --with-ssl=0 --with-shared-libraries=1 CFLAGS="-std=gnu11 -Wall -funroll-all-loops -O3 -DNDEBUG" CXXFLAGS="-std=gnu++14 -Wall -funroll-all-loops -O3 -DNDEBUG " COPTFLAGS="-std=gnu11 -Wall -funroll-all-loops -O3 -DNDEBUG" CXXOPTFLAGS="-std=gnu++14 -Wall -funroll-all-loops -O3 -DNDEBUG " FCFLAGS="-Wall -funroll-all-loops -ffree-line-length-0 -Wno-maybe-uninitialized -Wno-target-lifetime -Wno-unused-function -O3 -DNDEBUG" F90FLAGS="-Wall -funroll-all-loops -ffree-line-length-0 -Wno-maybe-uninitialized -Wno-target-lifetime -Wno-unused-function -O3 -DNDEBUG" FOPTFLAGS="-Wall -funroll-all-loops -ffree-line-length-0 -Wno-maybe-uninitialized -Wno-target-lifetime -Wno-unused-function -O3 -DNDEBUG" Could you fix the error and retry? --Junchao Zhang On Sun, Jul 6, 2025 at 12:57 PM Klaij, Christiaan via petsc-users < petsc-users@mcs.anl.gov> wrote: > Attached is a standalone example of the issue described in the > earlier thread "problem with nested logging". The issue appeared > somewhere between petsc 3.19.4 and 3.23.4. > > The example is a variation of ../ksp/tutorials/ex2f.F90, where > I've added the nested log viewer with one event as well as the > solution of a small system on rank zero. > > When running on mulitple procs the example hangs during > PetscLogView with the backtrace below. The configure.log is also > attached in the hope that you can replicate the issue. > > Chris > > > #0 0x000015554c84ea9e in mca_pml_ucx_recv (buf=0x7fffffff9e30, count=1, > datatype=0x15554c9ef900 <ompi_mpi_2dblprec>, src=1, tag=-12, > comm=0x7f1e30, mpi_status=0x0) at pml_ucx.c:700 > #1 0x000015554c65baff in ompi_coll_base_allreduce_intra_recursivedoubling ( > sbuf=0x7fffffff9e20, rbuf=0x7fffffff9e30, count=1, > dtype=0x15554c9ef900 <ompi_mpi_2dblprec>, > op=0x15554ca28980 <ompi_mpi_op_maxloc>, comm=0x7f1e30, module=0xaec630) > at base/coll_base_allreduce.c:247 > #2 0x000015554c6a7e40 in ompi_coll_tuned_allreduce_intra_do_this ( > sbuf=0x7fffffff9e20, rbuf=0x7fffffff9e30, count=1, > dtype=0x15554c9ef900 <ompi_mpi_2dblprec>, > op=0x15554ca28980 <ompi_mpi_op_maxloc>, comm=0x7f1e30, module=0xaec630, > algorithm=3, faninout=0, segsize=0) at coll_tuned_allreduce_decision.c:142 > #3 0x000015554c6a054f in ompi_coll_tuned_allreduce_intra_dec_fixed ( > sbuf=0x7fffffff9e20, rbuf=0x7fffffff9e30, count=1, > dtype=0x15554c9ef900 <ompi_mpi_2dblprec>, > op=0x15554ca28980 <ompi_mpi_op_maxloc>, comm=0x7f1e30, module=0xaec630) > at coll_tuned_decision_fixed.c:216 > #4 0x000015554c68e160 in mca_coll_hcoll_allreduce (sbuf=0x7fffffff9e20, > rbuf=0x7fffffff9e30, count=1, dtype=0x15554c9ef900 <ompi_mpi_2dblprec>, > op=0x15554ca28980 <ompi_mpi_op_maxloc>, comm=0x7f1e30, module=0xaecb80) > at coll_hcoll_ops.c:217 > #5 0x000015554c59811a in PMPI_Allreduce (sendbuf=0x7fffffff9e20, > recvbuf=0x7fffffff9e30, count=1, datatype=0x15554c9ef900 > <ompi_mpi_2dblprec>, op=0x15554ca28980 <ompi_mpi_op_maxloc>, comm=0x7f1e30) > at allreduce.c:123 > #6 0x0000155553eabede in MPIU_Allreduce_Private () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #7 0x0000155553e50d08 in PetscPrintXMLNestedLinePerfResults () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #8 0x0000155553e5123e in PetscLogNestedTreePrintLine () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #9 0x0000155553e51f3a in PetscLogNestedTreePrint () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #10 0x0000155553e51e96 in PetscLogNestedTreePrint () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #11 0x0000155553e51e96 in PetscLogNestedTreePrint () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #12 0x0000155553e52142 in PetscLogNestedTreePrintTop () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #13 0x0000155553e5257b in PetscLogHandlerView_Nested_XML () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #14 0x0000155553e4e5a0 in PetscLogHandlerView_Nested () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #15 0x0000155553e56232 in PetscLogHandlerView () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #16 0x0000155553e588c3 in PetscLogView () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #17 0x0000155553e40eb5 in petsclogview_ () from > /home/cklaij/ReFRESCO/trunk/install/extLibs/lib/libpetsc.so.3.22 > #18 0x0000000000402c8b in MAIN__ () > #19 0x00000000004023df in main () > dr. ir. Christiaan Klaij | senior researcher > Research & Development | CFD Development > T +31 317 49 33 44 <+31%20317%2049%2033%2044> | > https://urldefense.us/v3/__http://www.marin.nl__;!!G_uCfscf7eWS!ZHsZOjVtZW563bLFZCYkP0mARgO90Fn8zT_BWJ4h6gc-X9izzpyCqZ13ci6S6dNQXmutKi_6BIx2wmwGEBYl5mDNm02m$ > > <https://urldefense.us/v3/__https://www.marin.nl/__;!!G_uCfscf7eWS!dAFNrWR8FzE9RrQXQAlok1iR_fA-rZdm9JAi-dlnKTnbdNTOTCViw0Nc-jjU4g72I-mhE1x1MZaf8imk4ivm_tE$> > [image: Facebook] > <https://urldefense.us/v3/__https://www.facebook.com/marin.wageningen__;!!G_uCfscf7eWS!dAFNrWR8FzE9RrQXQAlok1iR_fA-rZdm9JAi-dlnKTnbdNTOTCViw0Nc-jjU4g72I-mhE1x1MZaf8imkLNCvsiI$> > [image: LinkedIn] > <https://urldefense.us/v3/__https://www.linkedin.com/company/marin__;!!G_uCfscf7eWS!dAFNrWR8FzE9RrQXQAlok1iR_fA-rZdm9JAi-dlnKTnbdNTOTCViw0Nc-jjU4g72I-mhE1x1MZaf8imkrb79Ay4$> > [image: YouTube] > <https://urldefense.us/v3/__https://www.youtube.com/marinmultimedia__;!!G_uCfscf7eWS!dAFNrWR8FzE9RrQXQAlok1iR_fA-rZdm9JAi-dlnKTnbdNTOTCViw0Nc-jjU4g72I-mhE1x1MZaf8imkJiCoeLw$> > >
