Hello Marc, upstream has worked on this regard[1] and have asked if you can run your tests on the git version of psutil - is that something you can do?
[1] https://github.com/giampaolo/psutil/issues/556#issuecomment-68595246 Thanks in advance, Sandro On Tue, Dec 16, 2014 at 9:27 AM, Marc Leeman <marc.lee...@gmail.com> wrote: > patch. Testing it now. > > On 16 December 2014 at 09:22, Marc Leeman <marc.lee...@gmail.com> wrote: >> Just to let you know that the current version upstream is not enough >> to solve the problem. I copied their version in the jessie release, >> backported it to wheezy and tried it. >> >> After less than 24h, the system is stuck again, The problem can be traced to: >> >> @wrap_exceptions >> def threads(self): >> >> Where there is still an open that does not close properly: >> >> 2014-12-16 09:21:21,185 - com.barco.mgs.TeamMgrM56094 - INFO - start - >> Received request to start a team sid T10621 - wid W90616 >> 2014-12-16 09:21:21,185 - com.barco.mgs.TeamMgrM56094 - ERROR - start >> - [' File "/usr/lib/pymodules/python2.7/Mgs2/Team/TeamMgr.py", line >> 831, in start\n limit = status.cpu_percent\n', ' File >> "/usr/lib/pymodules/python2.7/Mgs2/SystemStatusBase.py", line 346, in >> cpu_percent\n', ' File >> "/usr/lib/pymodules/python2.7/Mgs2/SystemStatusBase.py", line 349, in >> get_cpu_percent\n', ' File >> "/usr/lib/python2.7/dist-packages/psutil/__init__.py", line 1509, in >> cpu_percent\n _last_cpu_times = cpu_times()\n', ' File >> "/usr/lib/python2.7/dist-packages/psutil/__init__.py", line 1439, in >> cpu_times\n return _psplatform.cpu_times()\n', ' File >> "/usr/lib/python2.7/dist-packages/psutil/_pslinux.py", line 215, in >> cpu_times\n with open(\'/proc/stat\', \'rb\') as f:\n'] >> 2014-12-16 09:21:21,186 - com.barco.mgs.TeamMgrM56094 - ERROR - start >> - [Errno 24] Too many open files: '/proc/stat' >> 2014-12-16 09:21:21,186 - com.barco.mgs.TeamMgrM56094 - ERROR - start >> - Error during worker creation [Errno 24] Too many open files: >> '/proc/stat' >> >> >> >> <...snip...> >> rtsp_mgs. 26609 29136 root txt unknown >> /proc/26609/task/29136/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29136 root NOFD >> /proc/26609/task/29136/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29144 root cwd unknown >> /proc/26609/task/29144/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29144 root rtd unknown >> /proc/26609/task/29144/root (readlink: Permission denied) >> rtsp_mgs. 26609 29144 root txt unknown >> /proc/26609/task/29144/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29144 root NOFD >> /proc/26609/task/29144/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29147 root cwd unknown >> /proc/26609/task/29147/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29147 root rtd unknown >> /proc/26609/task/29147/root (readlink: Permission denied) >> rtsp_mgs. 26609 29147 root txt unknown >> /proc/26609/task/29147/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29147 root NOFD >> /proc/26609/task/29147/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29148 root cwd unknown >> /proc/26609/task/29148/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29148 root rtd unknown >> /proc/26609/task/29148/root (readlink: Permission denied) >> rtsp_mgs. 26609 29148 root txt unknown >> /proc/26609/task/29148/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29148 root NOFD >> /proc/26609/task/29148/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29149 root cwd unknown >> /proc/26609/task/29149/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29149 root rtd unknown >> /proc/26609/task/29149/root (readlink: Permission denied) >> rtsp_mgs. 26609 29149 root txt unknown >> /proc/26609/task/29149/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29149 root NOFD >> /proc/26609/task/29149/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29152 root cwd unknown >> /proc/26609/task/29152/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29152 root rtd unknown >> /proc/26609/task/29152/root (readlink: Permission denied) >> rtsp_mgs. 26609 29152 root txt unknown >> /proc/26609/task/29152/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29152 root NOFD >> /proc/26609/task/29152/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29153 root cwd unknown >> /proc/26609/task/29153/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29153 root rtd unknown >> /proc/26609/task/29153/root (readlink: Permission denied) >> rtsp_mgs. 26609 29153 root txt unknown >> /proc/26609/task/29153/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29153 root NOFD >> /proc/26609/task/29153/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29155 root cwd unknown >> /proc/26609/task/29155/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29155 root rtd unknown >> /proc/26609/task/29155/root (readlink: Permission denied) >> rtsp_mgs. 26609 29155 root txt unknown >> /proc/26609/task/29155/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29155 root NOFD >> /proc/26609/task/29155/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29157 root cwd unknown >> /proc/26609/task/29157/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29157 root rtd unknown >> /proc/26609/task/29157/root (readlink: Permission denied) >> rtsp_mgs. 26609 29157 root txt unknown >> /proc/26609/task/29157/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29157 root NOFD >> /proc/26609/task/29157/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29161 root cwd unknown >> /proc/26609/task/29161/cwd (readlink: Permission denied) >> rtsp_mgs. 26609 29161 root rtd unknown >> /proc/26609/task/29161/root (readlink: Permission denied) >> rtsp_mgs. 26609 29161 root txt unknown >> /proc/26609/task/29161/exe (readlink: Permission denied) >> rtsp_mgs. 26609 29161 root NOFD >> /proc/26609/task/29161/fd (opendir: Permission denied) >> rtsp_mgs. 26609 29165 root cwd unknown >> /proc/26609/task/29165/cwd (readlink: Permission denied) >> <...snip...> >> >> On 8 December 2014 at 17:33, Sandro Tosi <mo...@debian.org> wrote: >>> control: forward -1 https://github.com/giampaolo/psutil/issues/556 >>> >>> On Mon, Dec 8, 2014 at 4:28 PM, Marc Leeman <marc.lee...@gmail.com> wrote: >>>>> it seems those were addressed in >>>>> https://github.com/giampaolo/psutil/commit/3760d9593524e553e9e012c6b63cd802e3b25a46 >>>>> but it was not released in the last upstream version - asked upstream >>>>> for clarification on when they will be released. >>>> >>>> I don't think the commit solves all the problems: when looking at the >>>> commit, I still see a lot of returns in a try block, while the file >>>> handle is only closed in the finally block. This means that the >>>> control flow returns before closing. It does seem to solve some open >>>> file handles when something fails in the try. >>>> >>>> The problem here popped up after a weekend and there were no errors to >>>> be seen during operation before hitting the file handle limit. >>> >>> yup agreed, reported upstream as referred above. >>> >>> Regards, >>> -- >>> Sandro Tosi (aka morph, morpheus, matrixhasu) >>> My website: http://matrixhasu.altervista.org/ >>> Me at Debian: http://wiki.debian.org/SandroTosi -- Sandro Tosi (aka morph, morpheus, matrixhasu) My website: http://matrixhasu.altervista.org/ Me at Debian: http://wiki.debian.org/SandroTosi -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org
