Cloud Service:Best Practices: Difference between revisions
m Admin moved page Web Service:Best Practices to Cloud Service:Best Practices |
No edit summary |
||
Line 1: | Line 1: | ||
==Accessing Melissa Data’s | ==Accessing Melissa Data’s cloud services and staying up to date== | ||
Melissa Data | Melissa Data Cloud Services are authenticated using a CustomerID or a License string. The Customer ID is provided to you by your customer service representative or through an automatically generated email after signing up for a promotional demo. | ||
Line 7: | Line 7: | ||
==Single Record vs Batch Processing== | ==Single Record vs Batch Processing== | ||
Melissa Data | Melissa Data cloud services are capable of both single record real-time processing and batch processing. The difference is simply in the number of records sent in each request. Melissa Data cloud services take an array of records. This array can contain a single record or 100 records. For a real time process like a web form entry or a call center application, send in a request with one record. For batch processing scenario like a database, send requests of up to 100 records until all the records are processed. | ||
Line 35: | Line 35: | ||
==Network Layer Considerations== | ==Network Layer Considerations== | ||
===IP Addresses=== | ===IP Addresses=== | ||
If your company uses a firewall for security, you will need to add our IP address ranges to your list of allowable IP addresses in order to communicate with our | If your company uses a firewall for security, you will need to add our IP address ranges to your list of allowable IP addresses in order to communicate with our cloud services. Please see this page: | ||
<pre> | <pre> | ||
Line 42: | Line 42: | ||
We give out best effort to plan ahead and allocated IP ranges for the future, however, it is possible that we will need to add IP ranges as we expand and upgrade or infrastructure. We will send out multiple notifications of any impending update. This is a reason to make sure you have your technical contacts registered with Melissa Data | We give out best effort to plan ahead and allocated IP ranges for the future, however, it is possible that we will need to add IP ranges as we expand and upgrade or infrastructure. We will send out multiple notifications of any impending update. This is a reason to make sure you have your technical contacts registered with Melissa Data | ||
(See [[#Accessing Melissa Data’s | (See [[#Accessing Melissa Data’s cloud services and staying up to date|Accessing Melissa Data’s Cloud Services]]). | ||
===Ports=== | ===Ports=== | ||
Line 51: | Line 51: | ||
===TTL=== | ===TTL=== | ||
To update a server, we take it off of our load balancer and let it drain of traffic. Then, we stop the | To update a server, we take it off of our load balancer and let it drain of traffic. Then, we stop the cloud service and update the server. People accessing the service using our domain name will automatically be directed to available servers only. However, if your DNS caches the resolved IP address for a significant length of time, it is possible the cached server will be down when you try to hit it. For this reason, if you have access to your DNS TTL (time to live) option, please set it to a value of 10 minutes or less. | ||
Line 70: | Line 70: | ||
===Contact Verification Server=== | ===Contact Verification Server=== | ||
For our enterprise customers with speed and/or privacy concerns, we can make available a local server hosting our | For our enterprise customers with speed and/or privacy concerns, we can make available a local server hosting our cloud services. This server is dedicated to you so that you are not sharing server resources with anyone else. Additionally, since the server is located within your organization, the data does not have to travel over long distances. Also, authentication is turned off to further increase speed. Contact your sales representative if you are interested in this solution. | ||
==Understanding the different protocols SOAP vs XML vs REST vs JSON== | ==Understanding the different protocols SOAP vs XML vs REST vs JSON== | ||
Melissa Data | Melissa Data cloud services are available in multiple protocols in order to provide our customers a wide range of technologies to fit into their current architecture. The terminologies used above (SOAP, XML, REST, JSON) are not strictly technologically accurate, but used to differentiate the different options available. In the end, all the protocols return the same data, so the choice is really one of programming preference. | ||
===SOAP=== | ===SOAP=== | ||
Ideal for languages with SOAP development toolkits like Visual Studio .NET. This makes consuming and using the service very easy. The SOAP protocol can be used for both single record processing and batch. | Ideal for languages with SOAP development toolkits like Visual Studio .NET. This makes consuming and using the service very easy. The SOAP protocol can be used for both single record processing and batch. | ||
A side note for Java developers planning on using SOAP with our | A side note for Java developers planning on using SOAP with our cloud services: please consider using XML instead. Using SOAP entails generating code from the WSDL to invoke the service's methods which is not always a sure process as changes or upgrades to the cloud services in the future could break client code. Using XML instead is less problematic based on our experiences working with clients on such cases. Both XML and SOAP have similar capabilities in that both protocols allows single record and batch processing. | ||
===XML=== | ===XML=== | ||
Line 152: | Line 152: | ||
==Reporting Errors== | ==Reporting Errors== | ||
If you are experiencing errors trying to connect to our | If you are experiencing errors trying to connect to our cloud services or interruptions to the service, you can: | ||
#Submit a support ticket at support.melissadata.com. | #Submit a support ticket at support.melissadata.com. | ||
Line 160: | Line 160: | ||
If you are experiencing a sudden loss of service, please be ready to provide us with as much of the following pieces of information so that we can assist you promptly and investigate thoroughly. | If you are experiencing a sudden loss of service, please be ready to provide us with as much of the following pieces of information so that we can assist you promptly and investigate thoroughly. | ||
*Your Customer ID | *Your Customer ID | ||
*The location of your server accessing the | *The location of your server accessing the cloud service | ||
*The URL of the | *The URL of the cloud service you are using | ||
*The type of error you are experiencing in detail | *The type of error you are experiencing in detail | ||
*Any error messages or logs you may have | *Any error messages or logs you may have | ||
Line 171: | Line 171: | ||
[[Category: | [[Category:Cloud Services]] | ||
[[Category:Best Practices]] | [[Category:Best Practices]] |
Revision as of 17:48, 9 March 2015
Accessing Melissa Data’s cloud services and staying up to date
Melissa Data Cloud Services are authenticated using a CustomerID or a License string. The Customer ID is provided to you by your customer service representative or through an automatically generated email after signing up for a promotional demo.
Due to the nature of our business and our commitment to improving our services, sometimes there will be changes. We strongly recommend you create an email distribution group address for several technical users in your organization, that will be responsible for consuming our services, and convey that email address to your Melissa Data customer service representative. This email address will be used in case we need to notify you of upcoming change either to the service, the data or the network infrastructure. Also kindly add melissadata.com to your domain whitelist so this vital communication is not blocked.
Single Record vs Batch Processing
Melissa Data cloud services are capable of both single record real-time processing and batch processing. The difference is simply in the number of records sent in each request. Melissa Data cloud services take an array of records. This array can contain a single record or 100 records. For a real time process like a web form entry or a call center application, send in a request with one record. For batch processing scenario like a database, send requests of up to 100 records until all the records are processed.
Error Handling
Since Melissa Data uses multiple clustered servers, in the unlikely event that one server is temporarily overloaded or down, it is very likely that another server is up and running. For this reason, it is best to catch any errors returned by the service and retry. We recommend retrying up to 5 times.
int Retry = 0; Boolean ReqRet = false; do { try { // Perform Phone Lookup and store results to the Response ResPhone = PhoneClient.doPhoneCheck(ReqPhone); ReqRet = true; } catch (Exception ex) { MessageBox.Show(ex.ToString()); Retry++; } } while ((ReqRet == false) && (Retry < 5));2
Network Layer Considerations
IP Addresses
If your company uses a firewall for security, you will need to add our IP address ranges to your list of allowable IP addresses in order to communicate with our cloud services. Please see this page:
http://www.melissadata.com/tech/webservices-ip-information.htm
We give out best effort to plan ahead and allocated IP ranges for the future, however, it is possible that we will need to add IP ranges as we expand and upgrade or infrastructure. We will send out multiple notifications of any impending update. This is a reason to make sure you have your technical contacts registered with Melissa Data (See Accessing Melissa Data’s Cloud Services).
Ports
Melissa Data uses the default ports of 80 for http and 443 for https.
Using specific IP’s
Melissa Data does not allow you to access our services using direct IP addresses. We have multiple server clusters and use a load balancing system to distribute incoming traffic. To update our servers, we have to periodically need to take them down and redistribute traffic to available servers.
TTL
To update a server, we take it off of our load balancer and let it drain of traffic. Then, we stop the cloud service and update the server. People accessing the service using our domain name will automatically be directed to available servers only. However, if your DNS caches the resolved IP address for a significant length of time, it is possible the cached server will be down when you try to hit it. For this reason, if you have access to your DNS TTL (time to live) option, please set it to a value of 10 minutes or less.
Speed Considerations
If speed is a top concern for you, there are a few strategies that can be employed to increase the normal speed of using the service. They are ranked in terms of least effective to most effective.
Use batch instead of single
Processing 100 records at a time will always have a faster per record speed than a single record.
Order by Zip code
Ordering the records by zip code within each request can have a small increase the speed of the request.
Compression
For our services that allow GZip compression, turning it on can have up to a 10% increase in speed. GZip is usually built into a programming language and turned on simply by a flag.
Multi-Threading
Increasing the number of threads is an effective way to quickly increase the speed of using our services. We recommend having between 3-5 threads for batch processing.
Contact Verification Server
For our enterprise customers with speed and/or privacy concerns, we can make available a local server hosting our cloud services. This server is dedicated to you so that you are not sharing server resources with anyone else. Additionally, since the server is located within your organization, the data does not have to travel over long distances. Also, authentication is turned off to further increase speed. Contact your sales representative if you are interested in this solution.
Understanding the different protocols SOAP vs XML vs REST vs JSON
Melissa Data cloud services are available in multiple protocols in order to provide our customers a wide range of technologies to fit into their current architecture. The terminologies used above (SOAP, XML, REST, JSON) are not strictly technologically accurate, but used to differentiate the different options available. In the end, all the protocols return the same data, so the choice is really one of programming preference.
SOAP
Ideal for languages with SOAP development toolkits like Visual Studio .NET. This makes consuming and using the service very easy. The SOAP protocol can be used for both single record processing and batch.
A side note for Java developers planning on using SOAP with our cloud services: please consider using XML instead. Using SOAP entails generating code from the WSDL to invoke the service's methods which is not always a sure process as changes or upgrades to the cloud services in the future could break client code. Using XML instead is less problematic based on our experiences working with clients on such cases. Both XML and SOAP have similar capabilities in that both protocols allows single record and batch processing.
XML
XML is a HTTP POST call where you send in a request in xml format and receive a response in xml format. The format of the request must follow the structure defined in our documentation for each specific service.
JSON
JSON is also a HTTP POST call just like XML. The only difference is that the request and response uses the JSON format instead of XML format.
REST
REST is a HTTP GET call. This allows you to quickly formulate a call within the URL and submit it through a browser. An example of a REST call:
https://personator.melissadata.net/v3/WEB/ContactVerify/ doContactVerify?&id=123456&act=Check&a1=22382%20avenida %20empresa&postal=92688
The returned response is in XML and is identical to what is returned by the XML HTTP POST call.
Only one record can use sent using a REST call so it is ideal for real time single record processing.
Special Character Handling
The XML and REST protocols require special character handling when creating your request and interpreting the response. This is because certain special characters are reserved within the XML language.
The following XML encoding should be implemented to correctly handle reserved special characters:
Character | Encoding |
---|---|
& | & (ampersand) |
“ | " (left/right quotes should be replaced with straight quotes) |
‘ | ' (apostrophe) |
< | < (less-than) |
> | > (greater-than) |
The following URL encoding should be implemented when using REST to correctly handle reserved special characters:
Character | Encoding |
---|---|
Space | %20 or + |
* | %2A |
# | %23 |
& | %26 |
% | %25 |
$ | %28 |
Reporting Errors
If you are experiencing errors trying to connect to our cloud services or interruptions to the service, you can:
- Submit a support ticket at support.melissadata.com.
- Call Tech Support at 1-800-800-6245 ext 4.
If you are experiencing a sudden loss of service, please be ready to provide us with as much of the following pieces of information so that we can assist you promptly and investigate thoroughly.
- Your Customer ID
- The location of your server accessing the cloud service
- The URL of the cloud service you are using
- The type of error you are experiencing in detail
- Any error messages or logs you may have
- Date and time of occurrences
- Behavior of the incidents (is it all the time or periodic. If peridoc, what percentage of requests are affect).
- What is your IP Address?
- Are you using a proxy or firewall?
- Any other information you think may be relevant