Marcelo In some sense, it sounds like you are aiming at building a topic map of all your resources.
Jack On Thu, Feb 21, 2013 at 11:54 AM, Marcelo Elias Del Valle <marc...@s1mbi0se.com.br> wrote: > Hello David, > > First of all, thanks for answering! > > 2013/2/21 David Quarterman <da...@corexe.com> > >> Looked through your site and the framework looks very powerful as an >> aggregator. We do a lot of data aggregation from many different sources in >> many different formats (XML, JSON, text, CSV, etc) using RDBMS as the main >> repository for eventual SOLR indexing. A 'one-stop-shop' for all this would >> be very appealing. >> > > Actually, just to clarify, it uses Cassandra as repository, not an > RDMS. We want to use it for large scale, so you could import entire company > databases into the repo and relate the data from one another. However, If I > understood you right, you got the idea, an intermediate repo before > indexing, so you could postpone decisions about what to index and how... > > >> Have you looked at products like Talend & Jitterbit? These offer >> transformation from almost anything to almost anything using graphical >> interfaces (Jitterbit is better) and a PHP-like coding format for trickier >> work. If you (or somebody) could add a graphical interface, the world would >> beat a path to your door! > > > This is very interesting, actually! We considered using Talend when we > started our business, but we decided to go ahead with the development of a > new product. The reason was: Talend is great, but it limits a good > programmer, if he is more agile coding than using graphical interfaces. > Have user interfaces as a possibility is nice, but as something you HAVE TO > use is awful. Besides, it has a learning curve and seems to run better and > you hire their own platform, and we wanted to choose the fine grain of our > platform. > However, your question made me think a lot about it. Do you think > integrating to jitterbit or talend could be interesting? Or did you mean > developing a new user interface? The bad thing I see in integrating with a > talend like program is that you start to be dependent on the graphical > interface, I feel it's hard to use my own java code... I might be wrong. > Anyway, I will consider this possibility, but if you could explain > better why you think one or other could be such a good idea would help us a > lot. Would you be interested in using such a tool yourself? > > Best regards, > Marcelo.
