Profiler Object:Column-Based Statistics - Revision history

Admin at 17:37, 22 September 2023

2023-09-22T17:37:52Z

← Older revision		Revision as of 17:37, 22 September 2023
Line 13:		Line 13:
	==GetColumnInferredDataType==		==GetColumnInferredDataType==
	This function returns a column’s inferred data type in ProfilerDataType form. See [[Profiler Object:Enumeration Listing and Parsing#ProfilerDataType Enumerations\|ProfilerDataType Enumerations]] for details. The inferred data type is used to determine if a prevalent data type is seen for the majority of values in this column. For a deviant value to be returned (i.e., a value that differs from the user-specified data type), the count of that detected data type must exceed all other detected data type counts by at least 20%.		This function returns a column’s inferred data type in ProfilerDataType form. See [[Profiler Object:Enumeration Listing and Parsing#ProfilerDataType Enumerations\|ProfilerDataType Enumerations]] for details. The inferred data type is used to determine if a prevalent data type is seen for the majority of values in this column. For a deviant value to be returned (i.e., a value that differs from the user-specified data type), the count of that detected data type must exceed all other detected data type counts by at least 20%.

			[[Profiler Object:Initialization#SetRightFielderAnalysis\|SetRightFielderAnalysis]] must be set to true to get inferred datatype analysis.

	This function takes one parameter.		This function takes one parameter.
Line 33:		Line 35:

	ProfilerColumnType enumerator that is the closest to what the column type is. This could be different than the column type specified by the user. Possible values that this function could return are: ColumnTypeInt1, ColumnTypeReal8, ColumnTypeBoolean, ColumnTypeDate, etc.		ProfilerColumnType enumerator that is the closest to what the column type is. This could be different than the column type specified by the user. Possible values that this function could return are: ColumnTypeInt1, ColumnTypeReal8, ColumnTypeBoolean, ColumnTypeDate, etc.

			[[Profiler Object:Initialization#SetRightFielderAnalysis\|SetRightFielderAnalysis]] must be set to true to get inferred datatype analysis.

	This function takes one parameter.		This function takes one parameter.

Admin at 23:46, 3 November 2017

2017-11-03T23:46:32Z

@@ Line 144: / Line 144: @@
 This returns the number of distinct values in a column. Distinct values may have duplicates. A group of duplicate values is counted as 1 distinct value.
-This function takes one parameter
+For example, the table below has a distinct count of 11 and a unique count of 7. Each state is a distinct value, even if it has duplicates in the data frequency.
 ===Parameters===
@@ Line 161: / Line 189: @@
 ==GetColumnUniqueCount==
 This function returns the number of unique values in the specified column. Unique values do not have duplicates.
 This function takes one parameter.

Admin at 23:51, 14 May 2015

2015-05-14T23:51:42Z

@@ Line 27: / Line 27: @@
 |C=ProfilerDataType = mdProfilerGetColumnInferredDataType(profiler, columnNameStr);
 |.Net=ProfilerDataType = profiler.GetColumnInferredDataType(columnNameStr);
 }}

Admin at 18:58, 3 March 2015

2015-03-03T18:58:45Z

Show changes

Admin at 18:13, 25 February 2015

2015-02-25T18:13:08Z

← Older revision		Revision as of 18:13, 25 February 2015
Line 865:		Line 865:
	This function returns the number of records with the values containing decorative characters. Decorative characters appear at the beginning or end of the value, and are tab, comma, pipe, and double-quote. This count is useful because it often indicates that field delimiters may have somehow found their way into the data stream.		This function returns the number of records with the values containing decorative characters. Decorative characters appear at the beginning or end of the value, and are tab, comma, pipe, and double-quote. This count is useful because it often indicates that field delimiters may have somehow found their way into the data stream.

	Decorative character analysis is meant to detect bad data imports by flagging (returning result code ~~GS07~~) and counting any delimiters that made their way to the values of your table.		Decorative character analysis is meant to detect bad data imports by flagging (returning result code QS07) and counting any delimiters that made their way to the values of your table.

	This function takes one parameter.		This function takes one parameter.

Admin at 00:49, 25 February 2015

2015-02-25T00:49:47Z

← Older revision		Revision as of 00:49, 25 February 2015
Line 864:		Line 864:
	==GetColumnDecorationCharCount==		==GetColumnDecorationCharCount==
	This function returns the number of records with the values containing decorative characters. Decorative characters appear at the beginning or end of the value, and are tab, comma, pipe, and double-quote. This count is useful because it often indicates that field delimiters may have somehow found their way into the data stream.		This function returns the number of records with the values containing decorative characters. Decorative characters appear at the beginning or end of the value, and are tab, comma, pipe, and double-quote. This count is useful because it often indicates that field delimiters may have somehow found their way into the data stream.

			Decorative character analysis is meant to detect bad data imports by flagging (returning result code GS07) and counting any delimiters that made their way to the values of your table.

	This function takes one parameter.		This function takes one parameter.

Admin at 00:46, 25 February 2015

2015-02-25T00:46:34Z

← Older revision		Revision as of 00:46, 25 February 2015
Line 183:		Line 183:

	==GetColumnCustomPatterns==		==GetColumnCustomPatterns==
	This function returns the regular expression validator you added for the column with the [[Profiler Object:Column Specification#SetColumnCustomPattern\|SetColumnCustomPattern]] function.		This function returns the tab delimited regular expression validator you added for the column with the [[Profiler Object:Column Specification#SetColumnCustomPattern\|SetColumnCustomPattern]] function. This is particularly useful if the profile output file is open on [[Profiler Object:Initialization#SetAppendMode\|Report Mode (As set by SetAppendMode)]] and you want to get those patterns if they are set in a previous profiling run.

	This function takes one parameter.		This function takes one parameter.

Admin at 19:44, 24 February 2015

2015-02-24T19:44:11Z

@@ Line 10: / Line 10: @@
 The column-based statistics should only be retrieved after '''[[Profiler Object:Profiling#ProfileData|ProfileData]]''' is called. These functions return column-specific details.
 ==GetColumnColumnType==
@@ Line 20: / Line 47: @@
 |Name=ColumnName
 |Data Type=String
-|Description=Column Name to get the column type
+|Description=Column Name to get the column type.
 }}
 {{ Object Syntax
 |Syntax=profiler->GetColumnColumnType(columnNameStr);
-|C=ProfilercolumnType = mdProfilerProfilerGetColumnColumnType(profiler,columnNameStr);
+|C=ProfilercolumnType = mdProfilerGetColumnColumnType(profiler,columnNameStr);
 |.Net=ProfilerColumnType = profiler.GetColumnColumnType(columnNameStr);
 }}
@@ Line 99: / Line 126: @@
 |C=integer = mdProfilerGetColumnScale(profiler, columnNameStr);
 |.Net=integer = profiler.GetColumnScale(columnNameStr);
 }}

Admin at 21:57, 23 February 2015

2015-02-23T21:57:54Z

Show changes

Admin at 19:01, 2 February 2015

2015-02-02T19:01:02Z

← Older revision		Revision as of 19:01, 2 February 2015
Line 493:		Line 493:

	{{ Object Syntax		{{ Object Syntax
	\|Syntax=profiler->~~GetColumnNullCount~~(ColumnNameStr);		\|Syntax=profiler->GetColumnInvalidDataCount(ColumnNameStr);
	\|C=integer = ~~mdProfilerGetColumnNullCount~~(profiler, columnNameStr);		\|C=integer = mdProfilerGetColumnInvalidDataCount(profiler, columnNameStr);
	\|.Net=integer = profiler.~~GetColumnNullCount~~(columnNameStr);		\|.Net=integer = profiler.GetColumnInvalidDataCount(columnNameStr);
	}}		}}

Line 704:		Line 704:
	\|Data Type=String		\|Data Type=String
	\|Description=Column Name to get multi-space count.		\|Description=Column Name to get multi-space count.
	\|}		}}

	{{ Object Syntax		{{ Object Syntax
Line 739:		Line 739:
	\|Name=ColumnName		\|Name=ColumnName
	\|Data Type=String		\|Data Type=String
	\|Description=Column Name to get ~~training~~ space count.		\|Description=Column Name to get trailing space count.
	}}		}}