FAQ:SSIS:Known Issues: Difference between revisions
No edit summary |
|||
| (33 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
[[SSIS:Data Quality Components|← SSIS:Data Quality Components]] | [[SSIS:Data Quality Components|← SSIS:Data Quality Components]] | ||
{{CustomTOC}} | {{CustomTOC}} | ||
==SSIS 2014 BusinessCoder== | |||
;SSIS 2014 BusinessCoder Subscribers | |||
==SSIS: Global Verify On Premise Crashes== | If using SSIS 2014 BusinessCoder component for SSIS, we recommend to use Visual Studio 2013 per Melissa’s SSIS System Requirements. | ||
SSIS will crash when specific combination of visual studio and SSIS causes runtime to use only 32 bit processing. | *[[SSIS:System Requirements|Melissa’s SSIS System Requirements]] | ||
You can check if the correct behavior is exhibited, by opening process manager and see if there are both 32bit and 64bit DtsDebugHost is running. If only 32bit is running, we do not officially support 32bit run time. | |||
Currently the SSIS 2014 BusinessCoder component is not support by the Target Server Version option that is available in Visual Studio 2015+ when used in correlation with SQL Server 2014. Which causes the BusinessCoder component not to appear in the SSIS Toolbox. | |||
To download Visual Studio 2013, please visit: [https://visualstudio.microsoft.com/vs/older-downloads/ Visual Studio Older Downloads - 2019, 2017, 2015 & Previous Versions] | |||
A Microsoft account is required for access. | |||
==SSIS Q3 9.3: Personator Date of Birth (DOB) and Date of Death (DOD) Fields are now accessible without a Demographics subscription in SSIS== | |||
In the previous release of SSIS, the DOB and DOD fields were not functioning if a Demographics subscription was not active on the account. | |||
===Patched Q3 9.3 DQC Personator Component for SSIS=== | |||
A patch fix has been released and only applies to the Personator component. Please download the patch version if you are experiencing the issue. | |||
When installing the patch, in the “Select Components” screen, please only select Personator (v1.0.0.5055) | |||
[[File:SSIS_Notice_9p3.png|link=]] | |||
;Components Only ~246 MB | |||
::Latest Web Installer – Personator Component Build 5055 | |||
::https://download.melissadata.com/updates/DQC-web.exe | |||
==SSIS 9.1: Contact Verify – On Premise – Valid Canadian addresses are not receiving MAK when Country is set to Canada== | |||
When Country is set to <code>Canada</code> in the Contact Verify Address Verify Options screen, valid Canadian addresses are not receiving a MAK. | |||
We recommend to set the Country option to “US & Canada” as a work around for the issue. | |||
==SSIS 9.1: Contact Verify - On Premise - Address Object returning MAK for invalid Canadian records== | |||
Invalid Canadian addresses are returning a Melissa Address Key MAK. | |||
===Patched 9.1 DQC Contact Verify Component for SSIS=== | |||
A patch has been released for the Contact Verify component. Please download the patch version if you are experiencing the issue. | |||
==SSIS 8.1: SmartMover CCOA Unhandled Exception== | |||
An unhandled exception would occur in SSIS with the SmartMover component during CCOA processing only. Affected builds include Smartmover 5008-5011. | |||
===Patched 8.1 DQC SmartMover Component for SSIS=== | |||
A patch fix has been released and only applies to the SmartMover component. Please download the patch version if you are experiencing the issue. | |||
On the install prompt, only select the SmartMover component to be updated | |||
[[File:SSIS_Notice_8p1.png|link=]] | |||
;Components Only ~211MB | |||
::Latest Web Installer - SmartMover Component 5012 | |||
::https://downlad.melissadata.com/updates/DQC-web.exe | |||
==SSIS 8.1: Global Verify Pass-Through Column Records== | |||
The Global Verify component is currently experiencing an issue with the records contained within the Pass-Through columns being out of sync with the processed columns only when Email and/or Phone services are used. The records in the pass through columns repeat when the record per transmission is greater than 10 or if the dataset is greater than the threads multiplied by the records per request. As a work around we suggest to set the records per transmission to 10 via the configuration file. | |||
===Patched 8.1 DQC Components for SSIS=== | |||
We have released a patch fix for both web installer/ISO that are now available and live. This patch only applies to Global Verify Component. If you have already downloaded DQC Components for SSIS prior to 11/29/17, please download one of the patch versions below. | |||
;Components Only ~211MB | |||
::Latest Web Installer - Global Verify Component Build 5018 | |||
::https://download.melissadata.com/updates/DQC-web.exe | |||
;Installer with Components and data files included ~11GB | |||
::Latest ISO On Premise Installer: | |||
::https://update2.melissadata.com/R3MaGd/DQC-SSIS_202101.zip | |||
==SSIS 7.4: Global Verify Pass-Thru records Issue== | |||
Clients using Global Verify component, there is an important update that includes a patch for the 7.4 Q4 release of SSIS. We noticed that pass-thru records repeat whenever records per request is set to 100 and sample size of the record set exceeds 500 records. This leads to the issue of keeping the records in sync. The pass-thru address column is the only one effected. The SSIS address output column remains in sync and is not effected. The screen shot below shows the output file from Global Verify and it contains the pass-thru column of “Input Address” and the address output of “MD_Address1”. Notice the order is in sync until record 502. | |||
[[File:SSIS_Notice_7p4.png|link=]] | |||
We have released a patch fix for both web installer/ISO that are now available and live. This patch only applies to Global Verify Component. If you have already downloaded DQC Components for SSIS prior to 11/29/17, please download one of the patch versions below. | |||
===Patched 7.4 Q4 DQC Components for SSIS=== | |||
;Components Only ~211MB | |||
::Latest Web Installer | |||
::https://download.melissadata.com/updates/DQC-web.exe | |||
;Installer with Components and data files included ~11GB | |||
::Latest ISO On Premise Installer: | |||
::https://update2.melissadata.com/R3MaGd/DQC-SSIS_202101.zip | |||
==SSIS VMWare: SQL Server 2016 Compatibility with VMWare== | |||
Please avoid utilizing the option '''Hot Swap CPU''' when hosting with SQL Server 2016 with VMWare. We discovered that this is against the best practices from VMWare ([https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/solutions/sql-server-on-vmware-best-practices-guide.pdf 3.3.6 CPU Hot Plug]). | |||
Engineers from both VMware and Microsoft has verified that this will lead to issues with thread contention. The setting <code>MAXDOP</code> if set to too high will also have an effect on the contention and SSIS processes/our components may hang especially with our Matchup Component. | |||
As reported from our client, reports show that when querying SQL Server Numa in DMV (sys.dm_os_memory_nodes) only one node will be allocated 100% memory. After disabling '''Hot Swap CPU''', SQL Server now correctly detects a single numa. | |||
Disabling Hot Swap CPU will increase performance and should prevent hanging issues from occurring in SSIS. | |||
This '''Hot Swap CPU''' issue is only reported for SQL Server 2016 edition, which we may think is caused by the new cardinality estimator and automatic soft numa default features. The combination of new changes and incorrect setup in VMware may have caused the thread waits past a certain threshold. | |||
==SSIS 6.4: SQL Server 2016 Compatibility== | |||
2016 6.4 Q4 Release officially supports SQL Server 2016. We recommend using the latest SSDT Build. Please test on a staging server to ensure that all previous processes is working as it should before utilizing in production. We will make an effort to resolve bugs and issues to best of our abilities in a timely manner. | |||
==SSIS 6.3: SQL Server 2016 Compatibility== | |||
2016 6.3 Q3 Release supports SQL Server 2016 as a BETA. We recommend using the latest SSDT July Build. SQL Server 2016 will not be officially supported at this time, we cannot guarantee stability and caution to use at your own risk. This 2016 SQL Server BETA release is meant to allow for testing and should not be utilized in production. We will make an effort to resolve bugs and issues to best of our abilities in a timely manner. We plan to officially support 2016 SQL Server in 2016 Q4 Release. | |||
==SSIS 5.4: MatchUp Unhandled Exception Error== | |||
We discovered an issue with the 64bit Matchup DLL in SSIS, which hangs with unhandled exception error when operated in 64bit mode with a certain data-type and modified pre-canned matchcode. | |||
;Resolution | |||
As a workaround, you can use the 32bit version by switching run64bitruntime to false in project properties or use parameters to force 32-bit mode in DTExec. | |||
Matchup should run fine in 32bit mode. | |||
==SSIS 5.4: MatchUp Mapping Addressline 4-8 Issue== | |||
Users that update to 5.4 may experience mapping issues with address 4-8 in Matchup Component. | |||
;Resolution | |||
Updating to patch build 2683 will resolve this issue. Please download from | |||
https://download.melissadata.com/updates/DQC-web.exe | |||
==SSIS 5.3/5.4: MatchUp Expired Database without Updates== | |||
Users who do not update to MatchUp build 2683 will experience an expired database (actual expiration date is 2015-12-29). | |||
;Resolution | |||
Updating to build 2628 (or newer future builds) will enable Global Matching for supported Countries but may require changes to your application (see [[Build History:SSIS:Data Quality Components|build history]]), and are not effected by an expiring database date. | |||
Users who do not update and need an mdMatchUp.dat with an extended expiration date, please contact our tech support team at tech@melissadata.com or 1-800-800-6245 x4. | |||
==SSIS 5.3: Global Verify On Premise Crashes== | |||
SSIS will crash when specific combination of visual studio and SSIS causes runtime to use only 32 bit processing. For now, we officially only support 64 bit version processing. You can check if the correct behavior is exhibited, by opening process manager and see if there are both 32bit and 64bit DtsDebugHost is running. If only 32bit is running, we do not officially support 32bit run time. We are working hard to provide a stable 32bit runtime DLL. | |||
;Resolution | ;Resolution | ||
This is a Microsoft SSIS issue, we provide both 64bit and 32bit dlls but 32bit DLL is not supported by Melissa Data. As our object is meant to be run in 64bit runtime. If during processing SSIS uses only the 32bit instead of the 64bit. Please | This is a Microsoft SSIS known issue as they left out DTExec 64-bit in SSDT-BI/2013, we provide both 64bit and 32bit dlls but 32bit DLL is not officially supported by Melissa Data. As of current our object is meant to be run in 64bit runtime. If during processing SSIS uses only the 32bit instead of the 64bit. Please the below help links and try the solutions provided by Microsoft. We will notify when we have 32bit version ready. | ||
*https://support.microsoft.com/en-us/kb/2881285 | |||
*https://connect.microsoft.com/VisualStudio/feedback/details/1041486/debugging-ssis-package-opens-32-bit-dtsdebughost-exe-instead-of-64-bit-and-causes-errors | |||
;Known Setup Issues: | ;Known Setup Issues: | ||
| Line 19: | Line 148: | ||
*Behavior: Working | *Behavior: Working | ||
==SSIS: Global Verify License Issue== | ==SSIS 5.3: Global Verify License Key Issue== | ||
SSIS will complain about | SSIS will complain about License Key Issue. | ||
;Resolution | ;Resolution | ||
Fixed in patched build 2575. Please download from | Fixed in patched build 2575. Please download from HTTPS | ||
https://download.melissadata.com/Updates/DQC-web.exe | |||
==SSIS: Matchup UK Matchcode Not Saving== | ==SSIS: Matchup UK Matchcode Not Saving== | ||
| Line 31: | Line 160: | ||
;Resolution | ;Resolution | ||
Fixed in patched build 2575. Please re-download from the notification email, it has been updated with the fix. | Fixed in patched build 2575. Please re-download from the notification email, it has been updated with the fix. | ||
https://download.melissadata.com/Updates/DQC-web.exe | |||
==Upgrading Global Address with Global Name, Phone, and Email== | ==Upgrading Global Address with Global Name, Phone, and Email== | ||
Current users of the Global Verify Component who are only subscribed to Global Address Check and want to upgrade using either Global Name, Phone or Email, are required to re-install the components and enter their new | Current users of the Global Verify Component who are only subscribed to Global Address Check and want to upgrade using either Global Name, Phone or Email, are required to re-install the components and enter their new License Key in the installer. | ||
[[File:SSIS_Install_License.png|link=]] | [[File:SSIS_Install_License.png|link=]] | ||
Upgrading your | Upgrading your License Key in the Component GUI using '''File''' > '''Advanced Configuration''' will currently not work. | ||
Alternatively, you can manually change your | Alternatively, you can manually change your License Key by editing the GlobalVerify.SSIS.Config under: | ||
<pre> | <pre> | ||
| Line 52: | Line 174: | ||
</pre> | </pre> | ||
and replace your | and replace your License Key for this entry: | ||
<pre> | <pre> | ||
<License>ENTER NEW LICENSE HERE</License> | <License>ENTER NEW LICENSE KEY HERE</License> | ||
</pre> | </pre> | ||
| Line 67: | Line 189: | ||
;Future Resolution | ;Future Resolution | ||
We will be adding a fix in a later build to trim the trailing white spaces for Date Inputs. | We will be adding a fix in a later build to trim the trailing white spaces for Date Inputs. | ||
==SSIS: Matchup Matchcode Edits Not Saving== | |||
When using the Matchcode Editor, when selecting [OK] after editing a matchcode and then reopening the matchcode editor, the changes have not been saved. | |||
;Resolution | |||
Check the location of your Matchcode data files (File > Advanced Configuration). This is usually C:\ProgramData/Melissa DATA\MatchUP unless you have overridden the installer. Right Click the MatchUp folder and give ‘Full Control’ permissions to the respective user group. | |||
[[Category:Known Issues]] | [[Category:Known Issues]] | ||
[[Category:SSIS:Data Quality Components]] | [[Category:SSIS:Data Quality Components]] | ||
Latest revision as of 22:54, 7 June 2023
← SSIS:Data Quality Components
SSIS 2014 BusinessCoder
- SSIS 2014 BusinessCoder Subscribers
If using SSIS 2014 BusinessCoder component for SSIS, we recommend to use Visual Studio 2013 per Melissa’s SSIS System Requirements.
Currently the SSIS 2014 BusinessCoder component is not support by the Target Server Version option that is available in Visual Studio 2015+ when used in correlation with SQL Server 2014. Which causes the BusinessCoder component not to appear in the SSIS Toolbox.
To download Visual Studio 2013, please visit: Visual Studio Older Downloads - 2019, 2017, 2015 & Previous Versions
A Microsoft account is required for access.
SSIS Q3 9.3: Personator Date of Birth (DOB) and Date of Death (DOD) Fields are now accessible without a Demographics subscription in SSIS
In the previous release of SSIS, the DOB and DOD fields were not functioning if a Demographics subscription was not active on the account.
Patched Q3 9.3 DQC Personator Component for SSIS
A patch fix has been released and only applies to the Personator component. Please download the patch version if you are experiencing the issue.
When installing the patch, in the “Select Components” screen, please only select Personator (v1.0.0.5055)
- Components Only ~246 MB
-
- Latest Web Installer – Personator Component Build 5055
- https://download.melissadata.com/updates/DQC-web.exe
SSIS 9.1: Contact Verify – On Premise – Valid Canadian addresses are not receiving MAK when Country is set to Canada
When Country is set to Canada in the Contact Verify Address Verify Options screen, valid Canadian addresses are not receiving a MAK.
We recommend to set the Country option to “US & Canada” as a work around for the issue.
SSIS 9.1: Contact Verify - On Premise - Address Object returning MAK for invalid Canadian records
Invalid Canadian addresses are returning a Melissa Address Key MAK.
Patched 9.1 DQC Contact Verify Component for SSIS
A patch has been released for the Contact Verify component. Please download the patch version if you are experiencing the issue.
SSIS 8.1: SmartMover CCOA Unhandled Exception
An unhandled exception would occur in SSIS with the SmartMover component during CCOA processing only. Affected builds include Smartmover 5008-5011.
Patched 8.1 DQC SmartMover Component for SSIS
A patch fix has been released and only applies to the SmartMover component. Please download the patch version if you are experiencing the issue.
On the install prompt, only select the SmartMover component to be updated
- Components Only ~211MB
- Latest Web Installer - SmartMover Component 5012
- https://downlad.melissadata.com/updates/DQC-web.exe
SSIS 8.1: Global Verify Pass-Through Column Records
The Global Verify component is currently experiencing an issue with the records contained within the Pass-Through columns being out of sync with the processed columns only when Email and/or Phone services are used. The records in the pass through columns repeat when the record per transmission is greater than 10 or if the dataset is greater than the threads multiplied by the records per request. As a work around we suggest to set the records per transmission to 10 via the configuration file.
Patched 8.1 DQC Components for SSIS
We have released a patch fix for both web installer/ISO that are now available and live. This patch only applies to Global Verify Component. If you have already downloaded DQC Components for SSIS prior to 11/29/17, please download one of the patch versions below.
- Components Only ~211MB
- Latest Web Installer - Global Verify Component Build 5018
- https://download.melissadata.com/updates/DQC-web.exe
- Installer with Components and data files included ~11GB
- Latest ISO On Premise Installer:
- https://update2.melissadata.com/R3MaGd/DQC-SSIS_202101.zip
SSIS 7.4: Global Verify Pass-Thru records Issue
Clients using Global Verify component, there is an important update that includes a patch for the 7.4 Q4 release of SSIS. We noticed that pass-thru records repeat whenever records per request is set to 100 and sample size of the record set exceeds 500 records. This leads to the issue of keeping the records in sync. The pass-thru address column is the only one effected. The SSIS address output column remains in sync and is not effected. The screen shot below shows the output file from Global Verify and it contains the pass-thru column of “Input Address” and the address output of “MD_Address1”. Notice the order is in sync until record 502.
We have released a patch fix for both web installer/ISO that are now available and live. This patch only applies to Global Verify Component. If you have already downloaded DQC Components for SSIS prior to 11/29/17, please download one of the patch versions below.
Patched 7.4 Q4 DQC Components for SSIS
- Components Only ~211MB
- Latest Web Installer
- https://download.melissadata.com/updates/DQC-web.exe
- Installer with Components and data files included ~11GB
- Latest ISO On Premise Installer:
- https://update2.melissadata.com/R3MaGd/DQC-SSIS_202101.zip
SSIS VMWare: SQL Server 2016 Compatibility with VMWare
Please avoid utilizing the option Hot Swap CPU when hosting with SQL Server 2016 with VMWare. We discovered that this is against the best practices from VMWare (3.3.6 CPU Hot Plug).
Engineers from both VMware and Microsoft has verified that this will lead to issues with thread contention. The setting MAXDOP if set to too high will also have an effect on the contention and SSIS processes/our components may hang especially with our Matchup Component.
As reported from our client, reports show that when querying SQL Server Numa in DMV (sys.dm_os_memory_nodes) only one node will be allocated 100% memory. After disabling Hot Swap CPU, SQL Server now correctly detects a single numa. Disabling Hot Swap CPU will increase performance and should prevent hanging issues from occurring in SSIS.
This Hot Swap CPU issue is only reported for SQL Server 2016 edition, which we may think is caused by the new cardinality estimator and automatic soft numa default features. The combination of new changes and incorrect setup in VMware may have caused the thread waits past a certain threshold.
SSIS 6.4: SQL Server 2016 Compatibility
2016 6.4 Q4 Release officially supports SQL Server 2016. We recommend using the latest SSDT Build. Please test on a staging server to ensure that all previous processes is working as it should before utilizing in production. We will make an effort to resolve bugs and issues to best of our abilities in a timely manner.
SSIS 6.3: SQL Server 2016 Compatibility
2016 6.3 Q3 Release supports SQL Server 2016 as a BETA. We recommend using the latest SSDT July Build. SQL Server 2016 will not be officially supported at this time, we cannot guarantee stability and caution to use at your own risk. This 2016 SQL Server BETA release is meant to allow for testing and should not be utilized in production. We will make an effort to resolve bugs and issues to best of our abilities in a timely manner. We plan to officially support 2016 SQL Server in 2016 Q4 Release.
SSIS 5.4: MatchUp Unhandled Exception Error
We discovered an issue with the 64bit Matchup DLL in SSIS, which hangs with unhandled exception error when operated in 64bit mode with a certain data-type and modified pre-canned matchcode.
- Resolution
As a workaround, you can use the 32bit version by switching run64bitruntime to false in project properties or use parameters to force 32-bit mode in DTExec. Matchup should run fine in 32bit mode.
SSIS 5.4: MatchUp Mapping Addressline 4-8 Issue
Users that update to 5.4 may experience mapping issues with address 4-8 in Matchup Component.
- Resolution
Updating to patch build 2683 will resolve this issue. Please download from https://download.melissadata.com/updates/DQC-web.exe
SSIS 5.3/5.4: MatchUp Expired Database without Updates
Users who do not update to MatchUp build 2683 will experience an expired database (actual expiration date is 2015-12-29).
- Resolution
Updating to build 2628 (or newer future builds) will enable Global Matching for supported Countries but may require changes to your application (see build history), and are not effected by an expiring database date.
Users who do not update and need an mdMatchUp.dat with an extended expiration date, please contact our tech support team at tech@melissadata.com or 1-800-800-6245 x4.
SSIS 5.3: Global Verify On Premise Crashes
SSIS will crash when specific combination of visual studio and SSIS causes runtime to use only 32 bit processing. For now, we officially only support 64 bit version processing. You can check if the correct behavior is exhibited, by opening process manager and see if there are both 32bit and 64bit DtsDebugHost is running. If only 32bit is running, we do not officially support 32bit run time. We are working hard to provide a stable 32bit runtime DLL.
- Resolution
This is a Microsoft SSIS known issue as they left out DTExec 64-bit in SSDT-BI/2013, we provide both 64bit and 32bit dlls but 32bit DLL is not officially supported by Melissa Data. As of current our object is meant to be run in 64bit runtime. If during processing SSIS uses only the 32bit instead of the 64bit. Please the below help links and try the solutions provided by Microsoft. We will notify when we have 32bit version ready.
- https://support.microsoft.com/en-us/kb/2881285
- https://connect.microsoft.com/VisualStudio/feedback/details/1041486/debugging-ssis-package-opens-32-bit-dtsdebughost-exe-instead-of-64-bit-and-causes-errors
- Known Setup Issues
Installed SSIS 2012, Using Visual Studio 2012, Visual Studio 2010 Installed
- Behavior: Uses two 32bit DtsdebugHost and crashes
- Known Working
Installed SSIS 2012, Installed Visual Studio 2012, Using Visual Studio 2010
- Behavior: Working
Installed SSIS 2014, Using Visual Studio 2013
- Behavior: Working
SSIS 5.3: Global Verify License Key Issue
SSIS will complain about License Key Issue.
- Resolution
Fixed in patched build 2575. Please download from HTTPS https://download.melissadata.com/Updates/DQC-web.exe
SSIS: Matchup UK Matchcode Not Saving
When using the Matchup UK Matchcodes, it doesn't save the UK matchcodes.
- Resolution
Fixed in patched build 2575. Please re-download from the notification email, it has been updated with the fix. https://download.melissadata.com/Updates/DQC-web.exe
Upgrading Global Address with Global Name, Phone, and Email
Current users of the Global Verify Component who are only subscribed to Global Address Check and want to upgrade using either Global Name, Phone or Email, are required to re-install the components and enter their new License Key in the installer.
Upgrading your License Key in the Component GUI using File > Advanced Configuration will currently not work. Alternatively, you can manually change your License Key by editing the GlobalVerify.SSIS.Config under:
C:\ProgramData\Melissa DATA\GlobalVerify
and replace your License Key for this entry:
<License>ENTER NEW LICENSE KEY HERE</License>
Save the file and open SQL Server Data Tools. You should now be able to use the Global Verify Component with Global Address, Name, Phone and Email.
SSIS: Matchup - Date Keys are Not Being Built Correctly
When using the Component Type: Date in your MatchCode, Date Keys sometimes do not get built in the MatchKey. This is due to a conflict in the expected input format for Dates. Date Inputs should be in the format 'yyyMMdd'. This becomes problematic particularly for some DBMS. SQL Server for example may have a Date Column defined with char[30]. This causes trailing spaces to be included in the Date Input which conflicts with the expected Input Format, causing the Date Key to not be built.
- Future Resolution
We will be adding a fix in a later build to trim the trailing white spaces for Date Inputs.
SSIS: Matchup Matchcode Edits Not Saving
When using the Matchcode Editor, when selecting [OK] after editing a matchcode and then reopening the matchcode editor, the changes have not been saved.
- Resolution
Check the location of your Matchcode data files (File > Advanced Configuration). This is usually C:\ProgramData/Melissa DATA\MatchUP unless you have overridden the installer. Right Click the MatchUp folder and give ‘Full Control’ permissions to the respective user group.