mleh-komsa opened a new issue, #6984:
URL: https://github.com/apache/hop/issues/6984
### Apache Hop version?
2.17
### Java version?
17.0.15 (Microsoft)
### Operating system
Windows
### What happened?
Hi everyone,
we want to migrate from Pentaho to Apache Hop and want to use the Table
Compare transform to validate our migration of pipelines by testing the data in
the "old"-pentaho-table and "new" apachehop-table. All tables are stored in the
same sql server database and we use the native driver to connect from hop to
sql server.
I tested this component for such a few cases. When my tables have a primary
key on a nvarchar column the result is fine. But when the tables have an
integer column as primary key then all non-matching rows will be shown as
nrErrorsRightJoin even if the record exists only on the "left" side of the join.
To better understand the issue i've created following example:
```
create table dbo.TestTableOld (
Id int not null
, TextColumn nvarchar(30) collate Latin1_General_BIN not null
)
alter table dbo.TestTableOld add constraint TestTableOld_PK primary key
clustered (Id)
create table dbo.TestTableNew (
Id int not null
, TextColumn nvarchar(30) collate Latin1_General_BIN not null
)
alter table dbo.TestTableNew add constraint TestTableNew_PK primary key
clustered (Id)
insert into dbo.TestTableOld (Id, TextColumn)
values (1, N'First')
, (2, N'Second')
, (3, N'Third');
insert into dbo.TestTableNew (Id, TextColumn)
values (2, N'Second')
, (3, N'3.')
, (4, 'Fourth')
, (5, 'Fith')
```
Here is the structure of my pipeline:
<img width="1091" height="1081" alt="Image"
src="https://github.com/user-attachments/assets/cf703e6c-8fcd-4bed-bc62-f012a1899de7";
/>
As you can see the merge rows diff shows the correct differences.
The result of the Table Compare is not correct:
<img width="1663" height="393" alt="Image"
src="https://github.com/user-attachments/assets/3050c1b8-ade8-4445-9efe-5797220e5a47";
/>
Additional Information: The behavior in Pentaho is the same.
### Issue Priority
Priority: 3
### Issue Component
Component: Transforms
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
