Jack, I didn't know this concept, but indeed, it seems like a good way to define our application, and also opens possibilities of improvement. Thanks for the link!
Best regards, Marcelo. 2013/2/21 Jack Park <jackp...@topicquests.org> > Marcelo > > In some sense, it sounds like you are aiming at building a topic map > of all your resources. > > Jack > > On Thu, Feb 21, 2013 at 11:54 AM, Marcelo Elias Del Valle > <marc...@s1mbi0se.com.br> wrote: > > Hello David, > > > > First of all, thanks for answering! > > > > 2013/2/21 David Quarterman <da...@corexe.com> > > > >> Looked through your site and the framework looks very powerful as an > >> aggregator. We do a lot of data aggregation from many different sources > in > >> many different formats (XML, JSON, text, CSV, etc) using RDBMS as the > main > >> repository for eventual SOLR indexing. A 'one-stop-shop' for all this > would > >> be very appealing. > >> > > > > Actually, just to clarify, it uses Cassandra as repository, not an > > RDMS. We want to use it for large scale, so you could import entire > company > > databases into the repo and relate the data from one another. However, > If I > > understood you right, you got the idea, an intermediate repo before > > indexing, so you could postpone decisions about what to index and how... > > > > > >> Have you looked at products like Talend & Jitterbit? These offer > >> transformation from almost anything to almost anything using graphical > >> interfaces (Jitterbit is better) and a PHP-like coding format for > trickier > >> work. If you (or somebody) could add a graphical interface, the world > would > >> beat a path to your door! > > > > > > This is very interesting, actually! We considered using Talend when > we > > started our business, but we decided to go ahead with the development of > a > > new product. The reason was: Talend is great, but it limits a good > > programmer, if he is more agile coding than using graphical interfaces. > > Have user interfaces as a possibility is nice, but as something you HAVE > TO > > use is awful. Besides, it has a learning curve and seems to run better > and > > you hire their own platform, and we wanted to choose the fine grain of > our > > platform. > > However, your question made me think a lot about it. Do you think > > integrating to jitterbit or talend could be interesting? Or did you mean > > developing a new user interface? The bad thing I see in integrating with > a > > talend like program is that you start to be dependent on the graphical > > interface, I feel it's hard to use my own java code... I might be wrong. > > Anyway, I will consider this possibility, but if you could explain > > better why you think one or other could be such a good idea would help > us a > > lot. Would you be interested in using such a tool yourself? > > > > Best regards, > > Marcelo. >