Re: Storing videos in cassandra

2016-11-20 Thread vvshvv
I have a requirement to store images of different sizes somewhere and display images of same size in grid (up to 50), and looking at Pithos architecture, relatively large files will be divided in small chunks and they will not be combined into one file quickly. Sent from my Mi phoneOn Benjamin R

Re: Storing videos in cassandra

2016-11-20 Thread Benjamin Roth
I haven't had the chance to test Pithos but from an architectural view it MUST be slower than a haystack-like architecture ( https://code.facebook.com/posts/685565858139515/needle-in-a-haystack-efficient-storage-of-billions-of-photos/). This is why we decided to move to SeaweedFS ( https://github.c

Re: Storing videos in cassandra

2016-11-20 Thread DuyHai Doan
No idea, just contact them On Sun, Nov 20, 2016 at 5:45 AM, vvshvv wrote: > Hi Doan, > > Is there any performance test of Pithos? > > > > Sent from my Mi phone > On DuyHai Doan , Nov 19, 2016 6:46 PM wrote: > > There is a project Pithos that stores blob in Cassandra and exposes them > via S3 com

Re: Storing videos in cassandra

2016-11-19 Thread DuyHai Doan
There is a project Pithos that stores blob in Cassandra and exposes them via S3 compatible API: https://www.exoscale.ch/syslog/2016/08/15/object-storage-cassandra-pithos/ On Sat, Nov 19, 2016 at 1:36 PM, Kai Wang wrote: > IIRC, I watched a presentation where they said Netflix store almost > eve

Re: Storing videos in cassandra

2016-11-19 Thread Kai Wang
IIRC, I watched a presentation where they said Netflix store almost everything in C* *except* video content and payment stuff. That was 1-2 years ago. Not sure if it's still the case. On Nov 14, 2016 12:03 PM, "raghavendra vutti" wrote: > Hi, > > Just wanted to know How does hulu or netflix st

Re: Storing videos in cassandra

2016-11-14 Thread Johan Edstrom
URI comes in pretty handy ; video://videoprovider:codecSomething:myConverter:videoId Or XRI but what Michael said. > On Nov 14, 2016, at 11:59 AM, Michael Shuler wrote: > > Forward thinking, I would also suggest not storing the full URL, just > the video ID of some sort. The application cod

Re: Storing videos in cassandra

2016-11-14 Thread Michael Shuler
Forward thinking, I would also suggest not storing the full URL, just the video ID of some sort. The application code can create the URL as needed, using the ID. If the full URL is stored in Cassandra and some day in the future, the video file storage system needs to be changed, this would require

Re: Storing videos in cassandra

2016-11-14 Thread Paulo Motta
For the record, there is an interesting use case of globo.com using Cassandra to store video payload and stream live video at scale (in particular, the FIFA World Cup + Olympics), but it's a pretty non-conventional/advanced use case: - https://leandromoreira.com.br/2015/04/26/fifa-2014-world-cup-li

Re: Storing videos in cassandra

2016-11-14 Thread Benjamin Roth
Some time ago, I stumbled across this: https://github.com/chrislusf/seaweedfs It is an open source implementation of Facebooks Haystack design. Have no experience yet but we will evaluate it as a blob-store to replace our Mogile-FS installation which stores over one billion images. From my point of

Re: Storing videos in cassandra

2016-11-14 Thread Ali Akhtar
I am truly sorry, Raghavendra. It didn't occur to me that you could be a beginner. On Mon, Nov 14, 2016 at 11:46 PM, Jon Haddad wrote: > Think about it like this. You just started using Cassandra for the first > time. You have a question, you find there’s a mailing list, and you ask. > You hav

Re: Storing videos in cassandra

2016-11-14 Thread Jon Haddad
While Cassandra *can* be used this way, I don’t recommend it. It’s going to be far cheaper and easier to maintain to store data in an Object store like S3, like Oskar recommended. > On Nov 14, 2016, at 10:16 AM, l...@airstreamcomm.net wrote: > > We store videos and files in Cassandra by chunki

Re: Storing videos in cassandra

2016-11-14 Thread Jon Haddad
Think about it like this. You just started using Cassandra for the first time. You have a question, you find there’s a mailing list, and you ask. You have zero experience with the DB and are an outsider to a community. You ask anyways, because it’s where the Apache website says to go. You g

Re: Storing videos in cassandra

2016-11-14 Thread l...@airstreamcomm.net
Seconded. It is completely unhelpful to spam this list. Please stop. > On Nov 14, 2016, at 12:21 PM, Jon Haddad wrote: > > You’ve asked a lot of questions on this mailing list, and you’ve gotten help > on a ton of beginner issues. Making fun of someone for asking similar > beginner question

Re: Storing videos in cassandra

2016-11-14 Thread Jon Haddad
You’ve asked a lot of questions on this mailing list, and you’ve gotten help on a ton of beginner issues. Making fun of someone for asking similar beginner questions is not cool at all. Cut it out. > On Nov 14, 2016, at 10:13 AM, Ali Akhtar wrote: > > Another solution could be to print the

Re: Storing videos in cassandra

2016-11-14 Thread Ali Akhtar
Excuse me? I did not make fun of anyone. I gave valid suggestions that are all theoretically possible. If it came off in a condescending way, i am genuinely sorry. On 14 Nov 2016 11:22 pm, "Jon Haddad" wrote: > You’ve asked a lot of questions on this mailing list, and you’ve gotten > help on a

Re: Storing videos in cassandra

2016-11-14 Thread l...@airstreamcomm.net
We store videos and files in Cassandra by chunking them into small portions and saving them as blobs. As for video you could track the file byte offset of each chunk and request the relevant pieces when scrubbing to a particular portion of the video. > On Nov 14, 2016, at 11:02 AM, raghavend

Re: Storing videos in cassandra

2016-11-14 Thread Ali Akhtar
Another solution could be to print the raw bytes to paper, and write the page numbers to cassandra. Playback will be challenging with this method however, unless interns are available to transcribe the papers back to a digital format. On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar wrote: > The vid

Re: Storing videos in cassandra

2016-11-14 Thread Ali Akhtar
The video can be written to floppy diskettes, and the serial numbers of the diskettes can be written to cassandra. On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin wrote: > The actual video is not stored in Cassandra. You need to use a proper > origin like s3. > > Although you can probably store

Re: Storing videos in cassandra

2016-11-14 Thread Oskar Kjellin
The actual video is not stored in Cassandra. You need to use a proper origin like s3. Although you can probably store it in Cassandra, it's not a good idea. Sent from my iPhone > On 14 nov. 2016, at 18:02, raghavendra vutti > wrote: > > Hi, > > Just wanted to know How does hulu or netfli

Storing videos in cassandra

2016-11-14 Thread raghavendra vutti
Hi, Just wanted to know How does hulu or netflix store videos in cassandra. Do they just use references to the video files in the form of URL's and store in the DB?? could someone please me on this. Thanks, Raghavendra.