SSIS:Generalized Cleanser:Component: Difference between revisions

From Melissa Data Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(3 intermediate revisions by the same user not shown)
Line 8: Line 8:


==Cleansing Details==
==Cleansing Details==
These are the rules you are creating to cleanse your data. The following rules are available for your use:
These are the operations you are creating to cleanse your data. The following operations are available for your use:


;Case
;Case
:Cleanses the casing for your data (e.x. MeLiSa DaTA Melissa Data)
:Cleanses the casing for your data (e.x. MeLiSa DaTA → Melissa Data)


;Punctuation
;Punctuation
Line 20: Line 20:


;Regular Expression Search Replace
;Regular Expression Search Replace
:Searches for an expression and will replace that expression with another expression or data. (E.x. Resumé Resum)
:Searches for an expression and will replace that expression with another expression or data. (E.x. Resumé → Resum)
 
<h3 class="productfield">Adding a Search & Replace Table</h3>
:The Text Search Replace Operation has the functionality to add a Search & Replace table.
 
:The Search & Replace table is used as a dictionary that contains the values to search for and the values to replace them with. Generalized Cleanser will then use the Search & Replace table during processing to make the updates to the values contained in the table. It must adhere to the following format:
 
:*Regular Search Expression, followed by a TAB, the replace expression and a CR/LF.
 
:See the example below:  It contains vehicle models to search for and the values to replace it with.
 
::[[File:SSIS_GC_SearchReplaceExample.png|link=]]
 
:#Select the Source Field you would like to apply the Search & Replace table to.
:#Press the + sign to add an Operation and Select the Operation Text Search Replace.
:#Then select the Use Search & Replace Table File option.
:#Enter the path to the search & replace table or select using the Folder option.
:#Once added and the options are selected, press ok.


;Text Search Replace
;Text Search Replace
:Searches for a string to replace with another string. (E.x. Volvo &rarr; Toyota)
:Searches for a string to replace with another string. (E.x. Volvo &rarr; Toyota)
The Generalized Cleanser takes into account order of operations.  Meaning it will execute all operations in a rule in order from top to bottom.  Once you’ve finished creating your operations, we suggest you save your operations within a rule with a name and short description for future use.





Latest revision as of 00:32, 27 August 2022

← SSIS:Data Quality Components

Generalized Cleanser Navigation
Overview
Tutorial
Advanced Configuration
Component
Expression Builder
Result Codes




Cleansing Details

These are the operations you are creating to cleanse your data. The following operations are available for your use:

Case
Cleanses the casing for your data (e.x. MeLiSa DaTA → Melissa Data)
Punctuation
Cleanses the punctuation for your data (e.x. FIND EXAMPLE)
Expression
Removes your data and replaces with an expression
Regular Expression Search Replace
Searches for an expression and will replace that expression with another expression or data. (E.x. Resumé → Resum)

Adding a Search & Replace Table

The Text Search Replace Operation has the functionality to add a Search & Replace table.
The Search & Replace table is used as a dictionary that contains the values to search for and the values to replace them with. Generalized Cleanser will then use the Search & Replace table during processing to make the updates to the values contained in the table. It must adhere to the following format:
  • Regular Search Expression, followed by a TAB, the replace expression and a CR/LF.
See the example below: It contains vehicle models to search for and the values to replace it with.
  1. Select the Source Field you would like to apply the Search & Replace table to.
  2. Press the + sign to add an Operation and Select the Operation Text Search Replace.
  3. Then select the Use Search & Replace Table File option.
  4. Enter the path to the search & replace table or select using the Folder option.
  5. Once added and the options are selected, press ok.
Text Search Replace
Searches for a string to replace with another string. (E.x. Volvo → Toyota)


The Generalized Cleanser takes into account order of operations. Meaning it will execute all operations in a rule in order from top to bottom. Once you’ve finished creating your operations, we suggest you save your operations within a rule with a name and short description for future use.


Triggers

There are 3 triggers that you can use to determine whether or not a rule should be used for a record:

None
This will trigger on every record.
Expression
Only trigger when a record matches this expression.
Regular Expression
Only trigger when a record matches this regular expression.