mhamedbenjmaa commented on issue #6876:
URL: https://github.com/apache/hop/issues/6876#issuecomment-4137918743
Ok here the objective
this is source
ID ATTR1 ATTR2
K10 A X
K20 B Y
K30 C Z
let's say in the dimension Lookup/Update you set Key to ID and both fields
are set to INSERT
the destination will be
ID ATTR1 ATTR2 SK version date_from date_to
K10 A X 1 1 1900 2199
K20 B Y 2 1 1900 2199
K30 C Z 3 1 1900 2199
so if i change an attribute in the source, it will be lets say
ID ATTR1 ATTR2
K10 A X
K20 B T
K30 C Z
the destination will be
ID ATTR1 ATTR2 SK version date_from date_to
K10 A X 1 1 1900 2199
K20 B Y 2 1 1900 2199
K30 C Z 3 1 1900 2199
K20 B T 4 2 1900 today
so far so good this is how all of them works
Now, lets say I remove K30 from the source , all ETL in the world will
leave K30 unchanged in the destination,so is hop as of today, here where we
could shine with just a little checkbox that says invalidate_missing record and
the result would be
ID ATTR1 ATTR2 SK version date_from date_to
K10 A X 1 1 1900 2199
K20 B Y 2 1 1900 2199
**K30 C Z 3 1 1900
today**
K20 B T 4 2 1900 today
that's it , this is how i see it , or it can be another binary column that
says suppresed_from_source , it up to you
see how nice this is ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
