Dear Everyone,
It is now 12AM here (GMT +0600) and very peak time for our ISP. Most of our
users are now online. I took a snapshot from my cachemgr to show you guys.
Squid Object Cache: Version 3.1.10
Start Time:Mon, 24 Jan 2011 13:58:44 GMT
Current Time:Mon, 24 Jan 2011 18:04:49 GMT
Connection information for squid:
Number of clients accessing cache: 570
Number of HTTP requests received: 1468986
Number of ICP messages received: 0
Number of ICP messages sent: 0
Number of queued ICP replies: 0
Number of HTCP messages received: 0
Number of HTCP messages sent: 0
Request failure ratio: 0.00
Average HTTP requests per minute since start: 5969.4
Average ICP messages per minute since start: 0.0
Select loop called: 36711620 times, 0.402 ms avg
Cache information for squid:
Hits as % of all requests: 5min: 35.1%, 60min: 35.6%
Hits as % of bytes sent: 5min: 25.6%, 60min: 31.4%
Memory hits as % of hit requests: 5min: 4.5%, 60min: 3.9%
Disk hits as % of hit requests: 5min: 63.3%, 60min: 65.4%
Storage Swap size: 142110940 KB
Storage Swap capacity: 90.0% used, 10.0% free
Storage Mem size: 152228 KB
Storage Mem capacity: 100.1% used, 0.0% free
Mean Object Size: 18.00 KB
Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
HTTP Requests (All): 0.44492 0.44492
Cache Misses: 0.76407 0.80651
Cache Hits: 0.01309 0.01745
Near Hits: 0.35832 0.37825
Not-Modified Replies: 0.00000 0.00000
DNS Lookups: 0.06963 0.09971
ICP Queries: 0.00000 0.00000
Resource usage for squid:
UP Time: 14765.225 seconds
CPU Time: 2012.280 seconds
CPU Usage: 13.63%
CPU Usage, 5 minute avg: 14.37%
CPU Usage, 60 minute avg: 15.29%
Process Data Segment Size via sbrk(): 1778280 KB
Maximum Resident Size: 7213216 KB
Page faults with physical i/o: 3
Memory usage for squid via mallinfo():
Total space in arena: 1778412 KB
Ordinary blocks: 1750711 KB 20784 blks
Small blocks: 0 KB 0 blks
Holding blocks: 44844 KB 13 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 27700 KB
Total in use: 1795555 KB 98%
Total free: 27700 KB 2%
Total size: 1823256 KB
Memory accounted for:
Total accounted: 1325755 KB 73%
memPool accounted: 1325755 KB 73%
memPool unaccounted: 497500 KB 27%
memPoolAlloc calls: 373493434
memPoolFree calls: 375838488
File descriptor usage for squid:
Maximum number of file descriptors: 65535
Largest file desc currently in use: 4467
Number of file desc currently in use: 3790
Files queued for open: 0
Available number of file descriptors: 61745
Reserved number of file descriptors: 100
Store Disk files open: 60
Internal Data Structures:
7896282 StoreEntries
16070 StoreEntries with MemObjects
15496 Hot Object Cache Items
7895225 on-disk objects
Please see and check if there is anything which is not NORMAL, or might be
reason for problems discussed below.
Regards
Saiful
----------------------------------------
> From: [email protected]
> To: [email protected]
> Subject: RE: [squid-users] Some pages loading very slow in 3.1.10 Stable
> Date: Tue, 25 Jan 2011 05:00:30 +1100
>
>
> Hi Amor,
> I have recompiled Squid with the following parameters.
>
> ./configure --prefix=/usr/local/squid --enable-async-io=8
> --enable-storeio="ufs,aufs,diskd" --enable-removal-policies="lru,heap"
> --enable-delay-pools --enable-cache-digests --enable-underscores
> --enable-icap-client --enable-follow-x-forwarded-for --enable-arp-acl
> --enable-esi --enable-zph-qos --disable-translation --with-large-files
> --with-filedescriptors=65536 --disable-ipv6 --enable-linux-netfilter
>
> DISK I/O is just like before, on average 5% I would say.
> I am using the default removal policy, not heap.
>
> Well after recompiling it, I can see the Median DNS Lookup time reduced by 10
> times are the browsing experience is improved than before. Thank you for
> that. But those two domains i.e www.music.com.bd and www.djmaza.com problem
> is not solved. I cannot determine exactly what is stopping it to load the
> site fast, indeed it loads may be 10 minutes later. To my (amateur)
> understanding, the problem is with the ads.clicksor.com and the facebook
> widgets it tries to load, but I am not 100% sure.
>
> Can anyone try to load the site again and see if the problem persists, or how
> should I exempt those URLs from being caching.
>
> I think the URLS are :-
> 1) http://ads.clicksor.com/showAd.php?pid=102683&adtype=1&sid=152482&zone=
> 2) http://ads.clicksor.com/showAd.php?pid=102683&adtype=9&sid=152482&zone=
> 3)
> http://www.facebook.com/ajax/connect/activity_widget.php?__a=1&site=www.music.com.bd&width=350&height=225&header=false&colorscheme=light&border_color=%23006a4e&post_form_id=7c21c99b9bd83930bb871649bf465fcf&user=505688880&nb_activities=5&newest=0
>
> URL 3 waiting time sometimes goes more than 800ms. Please advise.
>
> Regards,
> Shishir
>
>
> ----------------------------------------
> > Date: Tue, 25 Jan 2011 01:33:10 +1300
> > From: [email protected]
> > To: [email protected]
> > Subject: Re: [squid-users] Some pages loading very slow in 3.1.10 Stable
> >
> > On 24/01/11 23:09, Michael Hendrie wrote:
> > >
> > > On 24/01/2011, at 8:17 PM, Saiful Alam wrote:
> > >
> > >>
> > >> OK I have kept your suggestion in my mind, but right now I'm not in
> > >> a position to buy two HDD's. May be I can afford to buy 15 days
> > >> later. For the time being, my prime problem is the loading of two
> > >> major sites from where my users download mp3. Those are
> > >>
> > >> www.music.com.bd and www.djmaza.com
> > >>
> > >
> > > Seems to load fine for me but that doesn't mean your slow = my fine.
> > >
> > > I had issues with some random sites being "slow" with 3.1.10 and
> > > tracked it down to squid trying to get AAAA records for the problem
> > > sites (or objects pulled from other sites). Not sure why this was
> > > occurring as IPv6 is not enabled on the OS. I didn't investigate too
> > > much and just recompiled with --disable-ipv6 as it wasn't needed.
> > > Doing so resolved my slow sites issue.
> > >
> >
> > Seems like you actually had IPv6 partially enabled in the OS, and maybe
> > a break in DNS or MTU.
> >
> > When Squid 3.1.10 starts up it probes the OS network capabilities to see
> > if IPv6 connections can be made. When they are possible it enables
> > things like AAAA to use those connections. --disable-ipv6 merely sets
> > the result of that test to always be false.
> >
> > With a reasonably fast DNS response time (under a half second) AAAA
> > lookups will not be noticeable.
> >
> > With working MTU there will be almost zero lag from opening and
> > attempting IPv6 connections on an IPv4-only network.
> >
> > >
> > >> Don't know the reason, but music.com.bd loads very slow. And in
> > >> firebug i see that the problem persists while loading 3 ads from
> > >> ads.clicksor.com and some facebook widgets. Can you please check
> >
> > There you have the problem by the looks of it.
> >
> > Ad servers are very bad for being slow. They usually do a lot of
> > processing or slow operations in the background before replying. Due to
> > their tracking desires they do not permit proxies to cache and speed up
> > their results. Some are more noticeable than others.
> >
> > Facebook is designed in a similar way which also suffers from these
> > heavy processing delay problems on the APIs. But they do seem to be
> > emitting useful cache controls on the static bits to avoid that.
> >
> > You have a choice:
> > put up with it
> > or
> > block those URL from being fetched.
> >
> > >> and try to load these two domains if you're running a Squid 3.1.X
> > >> version and see if everything is alright from your end.
> > >>
> >
> > Amos
> > --
> > Please be using
> > Current Stable Squid 2.7.STABLE9 or 3.1.10
> > Beta testers wanted for 3.2.0.4
>
