SSIS:Fuzzy Match:Matching Algorithms - Revision history

Admin at 00:07, 14 November 2015

2015-11-14T00:07:40Z

← Older revision		Revision as of 00:07, 14 November 2015
Line 1:		Line 1:
	~~[[SSIS:Reference\|← SSIS Reference]]~~		{{SSISFuzzyMatchNav}}

	{~~\| class="mw-collapsible" cellspacing="2" style="background-color:#f9f9f9; border:1px solid #aaaaaa; font-size:9pt; color:#0645ad; padding:8px 8px;"~~
	~~! style="text-align:left; color:black; border-bottom:1px solid #aaaaaa;"\|'''Fuzzy Match Navigation'''~~
	\|-
	~~\| style="padding-right:220px;"\|~~
	\|-
	~~\|[[SSIS:Fuzzy Match\|Overview]]~~
	\|-
	~~\|[[SSIS:Fuzzy Match Tutorial\|Tutorial]]~~
	\|-
	\|
	{~~\| class="mw-collapsible mw-collapsed" style="width:100%;"~~
	~~\|- align="left"~~
	~~! style="color:black;"\|[[SSIS:Fuzzy Match:Advanced Configuration\|Advanced Configuration]]~~
	\|-
	~~\|[[SSIS:Fuzzy Match:Advanced Configuration#On-Premise\|On-Premise]]~~
	\|}
	\|-
	\|
	~~{\| class="mw-collapsible mw-collapsed" style="width:100%;"~~
	~~\|- align="left"~~
	~~! style="color:black;"\|Fuzzy Match Tabs~~
	\|-
	~~\|[[SSIS:Fuzzy Match:Matches\|Matches]]~~
	\|-
	~~\|[[SSIS:Fuzzy Match:Advanced Options\|Advanced Options]]~~
	\|-
	~~\|[[SSIS:Fuzzy Match:Source Pass-Through Columns\|Source Pass-Through Columns]]~~
	\|-
	~~\|[[SSIS:Fuzzy Match:Compare Pass-Through Columns\|Compare Pass-Through Columns]]~~
	\|}
	\|-
	~~\|[[SSIS:Fuzzy Match:Matching Algorithms\|Matching Algorithms]]~~
	\|-
	\|
	~~{\| class="mw-collapsible mw-collapsed" style="width:100%;"~~
	~~\|- align="left"~~
	~~! style="color:black;"\|[[SSIS:Fuzzy Match:Result Codes\|Result Codes]]~~
	\|-
	~~\|[[Returned Result Codes:Enterprise Solutions#Data Quality Components for SSIS\|Returned Result Codes]]~~
	\|-
	~~\|[[Result Codes]]~~
	\|}
	\|}

Admin at 00:02, 13 November 2014

2014-11-13T00:02:10Z

← Older revision		Revision as of 00:02, 13 November 2014
Line 1:		Line 1:
			[[SSIS:Reference\|← SSIS Reference]]

			{\| class="mw-collapsible" cellspacing="2" style="background-color:#f9f9f9; border:1px solid #aaaaaa; font-size:9pt; color:#0645ad; padding:8px 8px;"
			! style="text-align:left; color:black; border-bottom:1px solid #aaaaaa;"\|'''Fuzzy Match Navigation'''
			\|-
			\| style="padding-right:220px;"\|
			\|-
			\|[[SSIS:Fuzzy Match\|Overview]]
			\|-
			\|[[SSIS:Fuzzy Match Tutorial\|Tutorial]]
			\|-
			\|
			{\| class="mw-collapsible mw-collapsed" style="width:100%;"
			\|- align="left"
			! style="color:black;"\|[[SSIS:Fuzzy Match:Advanced Configuration\|Advanced Configuration]]
			\|-
			\|[[SSIS:Fuzzy Match:Advanced Configuration#On-Premise\|On-Premise]]
			\|}
			\|-
			\|
			{\| class="mw-collapsible mw-collapsed" style="width:100%;"
			\|- align="left"
			! style="color:black;"\|Fuzzy Match Tabs
			\|-
			\|[[SSIS:Fuzzy Match:Matches\|Matches]]
			\|-
			\|[[SSIS:Fuzzy Match:Advanced Options\|Advanced Options]]
			\|-
			\|[[SSIS:Fuzzy Match:Source Pass-Through Columns\|Source Pass-Through Columns]]
			\|-
			\|[[SSIS:Fuzzy Match:Compare Pass-Through Columns\|Compare Pass-Through Columns]]
			\|}
			\|-
			\|[[SSIS:Fuzzy Match:Matching Algorithms\|Matching Algorithms]]
			\|-
			\|
			{\| class="mw-collapsible mw-collapsed" style="width:100%;"
			\|- align="left"
			! style="color:black;"\|[[SSIS:Fuzzy Match:Result Codes\|Result Codes]]
			\|-
			\|[[Returned Result Codes:Enterprise Solutions#Data Quality Components for SSIS\|Returned Result Codes]]
			\|-
			\|[[Result Codes]]
			\|}
			\|}


			{{CustomTOC}}

			==Matching Algorithms==
	The Fuzzy Match Component can use any of the following matching algorithms on any column in your database:		The Fuzzy Match Component can use any of the following matching algorithms on any column in your database:

Admin: Admin moved page Matching Algorithms to SSIS:Fuzzy Match:Matching Algorithms without leaving a redirect

2014-11-12T23:59:20Z

Admin moved page Matching Algorithms to SSIS:Fuzzy Match:Matching Algorithms without leaving a redirect

← Older revision	Revision as of 23:59, 12 November 2014
(No difference)

Admin at 21:18, 5 October 2012

2012-10-05T21:18:37Z

← Older revision		Revision as of 21:18, 5 October 2012
Line 1:		Line 1:
	~~==Matching Algorithms==~~
	The Fuzzy Match Component can use any of the following matching algorithms on any column in your database:		The Fuzzy Match Component can use any of the following matching algorithms on any column in your database:

Admin: Created page with "==Matching Algorithms== The Fuzzy Match Component can use any of the following matching algorithms on any column in your database: ;Exact Matching :Determines whether two str..."

2012-10-05T21:17:56Z

Created page with "==Matching Algorithms== The Fuzzy Match Component can use any of the following matching algorithms on any column in your database: ;Exact Matching :Determines whether two str..."

New page

==Matching Algorithms==
The Fuzzy Match Component can use any of the following matching algorithms on any column in your database:

;Exact Matching
:Determines whether two strings are identical.

;Jaro
:Gathers common characters (in order) between the two strings, then counts transpositions between the two common strings.

;Jaro-Winkler
:A variation to the Jaro algorithm. Strings that have matching characters at the beginning will be accounted for and are given additional weight to similarity.

;N-Gram
:Counts the number of common sub-strings (grams) of a specified length between the two strings.

;Dice's Coefficient
:A variation of the N-Gram algorithm. Dice's Coefficient counts matching n-Grams but does not count extra duplicate n-Grams.

;Jaccard Similarity
:A variation of the N-Gram algorithm. The Jaccard Similarity is identical to the N-Gram algorithm but uses a different formula for similarity computation.

;Overlap Coefficient
:A variation of the N-Gram algorithm. The Overlap Coefficient is identical to the N-Gram algorithm but uses a different formula for similarity computation.

;Levenshtein
:The Levenshtein algorithm computes for the similarity of two strings by taking into account the amount of character mistakes. Mistakes are based off the number of incorrect characters, inserted characters, and deleted characters.

;Needleman-Wunsch
:A variation of the Levenshtein algorithm. Levenshtein and Needleman-Wunsch are identical except that character mistakes are given different weights depending on how far two characters are on a standard keyboard layout. For example: A to S is given a mistake weight of 0.4, while A to D is a 0.6 and A to P is a 1.0.

;Smith-Waterman-Gotoh
:A variation of the Needleman-Wunsch algorithm. Needleman-Wunsch and Smith-Waterman-Gotoh are identical except that character deletions are given a different weight.

:This effectively adds the "understanding" that the keyboarder may have tried to abbreviate one of the words.

;MDKeyboard
:A variation of the Smith-Waterman-Gotoh algorithm. Smith-Waterman-Gotoh and MDKeyboard are identical except that character transpositions are given a different weight.

:This effectively adds the "understanding" that the keyboarder may have typed in one character before another.

;Longest Common Substring (LCS)
:The LCS algorithm counts for the longest common set of adjacent characters between 2 strings.

;Containment
:The Containment algorithm will return 100% if one string is a subset of another. A 0% is returned otherwise.

;Frequency
:The Frequency algorithm will match the characters of one string to the characters of another without any regard to the sequence. For example "abcdef" would be considered a 100% match to "badcfe."

;SoundEx
:SoundEx is a string transformation and comparison-based algorithm. For example, JOHNSON would be transformed to "J525" and JHNSN would also be transformed to "J525" which would then be considered a SoundExing match after evaluation.

:If the original strings are identical, SoundEx will return 100%. If the SoundEx'd strings are equal, the algorithm returns 99%. Otherwise, SoundEx will return 0%.

;PhonetEx
:A variation of the SoundEx Algorithm. PhonetEx takes into account letter combinations that sound alike, particularly at the start of the word (such as 'PN' = 'N', 'PH' = 'F').

;Double Metaphone
:A variation of the PhonetEx Algorithm. Double Metaphone performs 2 different PhonetEx-style transformations. It creates two PhonetEx-like strings (primary and alternate) for both strings.

:The logic used for Double Metaphone Similarity works as follows:

:*If primary1 = primary2 and alternate1 = alternate 2, then we have a very good match (99%).
:*If either primary1 = alternate2 or alternate1 = primary2, and alternate1=alternate2, then we have a good match (85%).
:*If alternate 1 = alternate2, we have an acceptable match (75%).