Pentaho/Contact Zone:Cleanser:Output Filter

From Melissa Data Wiki
Jump to navigation Jump to search

← Contact Zone

← Data Quality Components for Pentaho

Cleanser Navigation
Overview
Tutorial
Advanced Configuration
Cleanser Tabs
Input Fields
Output Filter
Expression Builder
Result Codes



PENT Cleanser OutputFilter.png

The Cleanser Component will output records in up to four streams. The Output Filter tab allows you to control which records go to which stream. Names and usage can be done in any manner. Filters are evaluated from the top down.


Result Codes

The output status of a record is returned via result codes returned by the underlying objects. The Component will combine them into a single, comma-delimited string and write them to the field mapped here. New field names can be created by typing the name into the Output Results Code box.


Output Filter

Select a filter to determine which records will be directed to a particular output stream. A custom filter may be created based on individual need, each pin filters the records in a cascading effect, where the results code is compared against the first expression (Pin 1) and then compared against Pin 2, and so on.

No Filter
All records are written to a single output stream.
Pre-built Filter
The Component comes with several pre-built filters for common applications:
  1. Abbreviation operation executed, input value was changed. - [KA01]
  2. Casing operation executed, input value was changed. - [KC01]
  3. Transform Expression operation executed, input value was changed. - [KE01]
  4. Punctuation operation executed, input value was changed. - [KP01]
  5. Regular Expression operation executed, input value was changed. - [KR01]
  6. Text Search N Replace operation executed, input value was changed. - [KS01]
  7. Abbreviation operation was not executed, input value was not changed. - [KA02]
  8. Casing operation was not executed, input value was not changed. - [KC02]
  9. Transform Expression operation was not executed, input value was not changed. - [KE02]
  10. Punctuation operation was not executed, input value was not changed. - [KP02]
  11. Regular Expression operation was not executed, input value was not changed. - [KR02]
  12. Text Search N Replace operation was not executed, input value was not changed. - [KS02]
Custom Filter Expression
Records matching the filter will be directed to the designated file.
For more information, see Custom Output Filters below.


Custom Output Filter

Custom rules are an advanced subject. You should be comfortable with Boolean operations before using custom rules in a production environment.

For more information see Custom Output Filter.