Pentaho:Cleanser:Output Filter

← Data Quality Components for Pentaho

The Cleanser Component will output records in up to four streams. The Output Filter tab allows you to control which records go to which stream. Names and usage can be done in any manner. Filters are evaluated from the top down.

Result Codes

The output status of a record is returned via result codes returned by the underlying objects. The Component will combine them into a single, comma-delimited string and write them to the field mapped here. New field names can be created by typing the name into the Output Results Code box.

• Cleanser Component Result Codes

Output Filter

Select a filter to determine which records will be directed to a particular output stream. A custom filter may be created based on individual need, each pin filters the records in a cascading effect, where the results code is compared against the first expression (Pin 1) and then compared against Pin 2, and so on.

No Filter

All records are written to a single output stream.

Pre-built Filter

The Component comes with several pre-built filters for common applications:

1. Abbreviation operation executed, input value was changed. - [KA01]
2. Casing operation executed, input value was changed. - [KC01]
3. Transform Expression operation executed, input value was changed. - [KE01]
4. Punctuation operation executed, input value was changed. - [KP01]
5. Regular Expression operation executed, input value was changed. - [KR01]
6. Text Search N Replace operation executed, input value was changed. - [KS01]
7. Abbreviation operation was not executed, input value was not changed. - [KA02]
8. Casing operation was not executed, input value was not changed. - [KC02]
9. Transform Expression operation was not executed, input value was not changed. - [KE02]
10. Punctuation operation was not executed, input value was not changed. - [KP02]
11. Regular Expression operation was not executed, input value was not changed. - [KR02]
12. Text Search N Replace operation was not executed, input value was not changed. - [KS02]

Custom Filter Expression

Records matching the filter will be directed to the designated file.

For more information, see Custom Output Filters below.

Custom Output Filter

Custom rules are an advanced subject. You should be comfortable with Boolean operations before using custom rules in a production environment.

For more information see Custom Output Filter.