Re: Indexing documents from S3 bucket

2018-10-08 Thread ☼ R Nair
S3 gives listeners. So tap those listeners when objects are added, updated or deleted and use Solr API to push. That's high level, but I believe doable. I worked on Minio, an open source object storage supporting S3 and could do this because Minio gives me good and stable listeners. Best, Ravion

Indexing documents from S3 bucket

2018-10-08 Thread marotosg
Hi, At the moment I have a SolrCloud Cluster with a documents collection being populated indexing documents coming from a DFS server. Linux boxes are mounting that DFS server using samba. There is a request to move that DFS server to a AWS S3 bucket. Does anyone have previous experience about it