Hi Casey,
  Great job.

  Regards,
  James

-----Original Message-----
From: Casey Bodley [mailto:[email protected]] 
Sent: Tuesday, September 29, 2015 1:06 PM
To: James (Fei) Liu-SSI
Cc: [email protected]
Subject: Re: Backend ObjectStore engine performance bench with FIO

Hi James/Haomai/Xiaoxi,

I spent some more time on the fio-objectstore branch, and pushed an update.

In testing, I realized that it was using the io_unit's start time to name the 
objects, which meant that every write operation was creating a separate object.
In addition to fixing this to use fio's filenames for object names, I also 
added support for the open_file() and close_file() functions. It now creates 
objects of the proper size on startup, so read-only jobs will work normally.
It also removes its objects on exit.

On startup, it no longer calls create_collection() if it already exists, so I 
was able to re-run fio jobs over and over again without having to clear the 
data directory (tested with FileStore and KeyValueStore).

Casey

----- Original Message -----
> Great work James!
> 
> ----- Original Message -----
> > From: "James (Fei) Liu-SSI" <[email protected]>
> > To: "Xiaoxi Chen" <[email protected]>, "Casey Bodley"
> > <[email protected]>
> > Cc: "Sage Weil" <[email protected]>, [email protected]
> > Sent: Friday, September 25, 2015 1:55:29 PM
> > Subject: Backend ObjectStore engine performance bench with FIO
> > 
> > Hi Xiaoxi,
> > 
> >    With changing the IO mode from aio to sync, we make fio against newstore
> >    works. Even  with sync engine(I am still debugging the aio engine in
> >    newstore with Xiaoxi) in newstore, Newstore still performing the best
> >    among all of backstore engine with our initial setup(Thoroughly test
> >    will
> >    be run soon). Attachment is the initial data we collected for your
> >    reference. Thanks for great help from Xiaoxi from regarding to Newstore
> >    development to support FIO.
> > 
> > Hi Casey,
> >   Let me know if you need any help to put fio-ceph-objectstore into
> >   upstream.
> >   After then , I can commit all of mine into upstream.
> 
> My pull request at https://github.com/ceph/ceph/pull/5943 is still pending.
> If you have patches that you'd like included, I would be happy to pull 
> them in; just point me to a branch.
> 
> > 
> >   Thanks,
> >   James
> > 
> 
> Thanks,
> Casey
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" 
> in the body of a message to [email protected] More majordomo 
> info at  http://vger.kernel.org/majordomo-info.html
> 

Reply via email to