Hello David,
First of all, thanks for answering!
2013/2/21 David Quarterman <da...@corexe.com>
> Looked through your site and the framework looks very powerful as an
> aggregator. We do a lot of data aggregation from many different sources in
> many different formats (XML, JSON, text, CSV, etc) using RDBMS as the main
> repository for eventual SOLR indexing. A 'one-stop-shop' for all this would
> be very appealing.
>
Actually, just to clarify, it uses Cassandra as repository, not an
RDMS. We want to use it for large scale, so you could import entire company
databases into the repo and relate the data from one another. However, If I
understood you right, you got the idea, an intermediate repo before
indexing, so you could postpone decisions about what to index and how...
> Have you looked at products like Talend & Jitterbit? These offer
> transformation from almost anything to almost anything using graphical
> interfaces (Jitterbit is better) and a PHP-like coding format for trickier
> work. If you (or somebody) could add a graphical interface, the world would
> beat a path to your door!
This is very interesting, actually! We considered using Talend when we
started our business, but we decided to go ahead with the development of a
new product. The reason was: Talend is great, but it limits a good
programmer, if he is more agile coding than using graphical interfaces.
Have user interfaces as a possibility is nice, but as something you HAVE TO
use is awful. Besides, it has a learning curve and seems to run better and
you hire their own platform, and we wanted to choose the fine grain of our
platform.
However, your question made me think a lot about it. Do you think
integrating to jitterbit or talend could be interesting? Or did you mean
developing a new user interface? The bad thing I see in integrating with a
talend like program is that you start to be dependent on the graphical
interface, I feel it's hard to use my own java code... I might be wrong.
Anyway, I will consider this possibility, but if you could explain
better why you think one or other could be such a good idea would help us a
lot. Would you be interested in using such a tool yourself?
Best regards,
Marcelo.
