Hi Mike,
Bit late on this, but just saw it...
Using streaming to ingest has occurred to me too but I think it's not
really right for that except in fairly trivial cases. The very first big
problem you will have in the example you give is that you won't be able to
mark things as already ingested,
Unfortunately there currently isn't a way to split a field. But this would
be nice functionality to add.
The approach would be to an add a split operation that would be used by the
select() function. It would look like this:
select(jdbc(...), split(fieldA, delim=","), ...)
This would make a good
