Nothing fancy here. Parse the Apache log for /catalog/ to get catalog sizes though you may need to tweak what you're logging, I'm using the following, but only %b is needed to get bytes of the request. http://httpd.apache.org/docs/current/mod/mod_log_config.html

LogFormat "%v %V %{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\" %D" combined
  CustomLog /var/log/httpd/<%= @vhostname %>-access_log combined

File service metadata requests is parsing for "GET /$some_env/file_metadata/". BTW in my stats that was 23k req/s if that wasn't clear.

tx/rx is just from the interface. Nothing else on the box so it's all Puppet plus general system stats collection, etc.

Ramin

On 7/8/17 8:25 AM, Soham Chakraborty wrote:
Ramin,

I am interested to know how did you do the tests? I want to run a simulation myself.

On Saturday, July 8, 2017 at 3:44:26 AM UTC+5:30, Ramin K wrote:

    On 7/7/17 9:52 AM, Peter Berghold wrote:
     > Has anybody out there done any sort of study on what Puppet
    produces in
     > terms of I/O packet rate?  I'm being asked to fill in a
    spreadsheet with
     > that information....

    I can share some rough numbers. We do a lot of files so the numbers are
    weird and inefficient. Puppet 3.8.7/Passenger 5.1.5/Ruby 2.0/Apache 2.4
    on the server side.

    avg file metadata per puppetserver: 25k/s
    avg hosts per puppetserver: 1200

    avg catalog size: 15MB (lots and lots of files)

    Peak TX rate: 4MB/s
    Peak RX rate: 1.5MB/s

    I'd suspect the average Puppetserver to be a fraction of that bandwidth
    for the same number of hosts.

    Ramin

--
You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected] <mailto:[email protected]>. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/61e5dc0f-a791-4eb9-89e8-714014404cb1%40googlegroups.com <https://groups.google.com/d/msgid/puppet-users/61e5dc0f-a791-4eb9-89e8-714014404cb1%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Puppet 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/8c78c0a3-0e74-533b-92db-f2a64ae0fdad%40badapple.net.
For more options, visit https://groups.google.com/d/optout.

Reply via email to