Cloud Service:Best Practices: Difference between revisions

From Melissa Data Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 75: Line 75:
===SOAP===
===SOAP===
Ideal for languages with SOAP development toolkits like Visual Studio .NET. This makes consuming and using the service very easy. The SOAP protocol can be used for both single record processing and batch.
Ideal for languages with SOAP development toolkits like Visual Studio .NET. This makes consuming and using the service very easy. The SOAP protocol can be used for both single record processing and batch.
A side note for Java developers planning on using SOAP with our web services: please consider using XML instead. Using SOAP entails generating code from the WSDL to invoke the service's methods which is not always a sure process as changes or upgrades to the web services in the future could break client code. Using XML instead is less problematic based on our experiences working with clients on such cases. Both XML and SOAP have similar capabilities in that both protocols allows single record and batch processing.


===XML===
===XML===

Revision as of 21:50, 3 December 2013

Accessing Melissa Data’s web services and staying up to date

Melissa Data Web Services are accessed using a CustomerID or license string. This ID is provided to you by your sales representative or through an automatically generate demo email. The nature of our business and our commitment to improving our services require periodic changes. We strongly recommend you provide the technical contact emails responsible for using and maintaining our service to your sales representative. In the case we need to notify you of upcoming changes, we want all stakeholders to receive that notice. We also recommend setting up a distribution email as one of your technical contacts so you can adjust the distribution list to any changes in personnel. Please add melissadata.com to your whitelist so our emails are not blocked.


Single Record vs Batch Processing

Melissa Data web services are capable of both single record real-time processing and batch processing. The difference is simply in the number of records sent in each request. Melissa Data web services take an array of records. This array can contain a single record or 100 records. For a real time process like a web form entry or a call center application, send in a request with one record. For batch processing scenario like a database, send requests of up to 100 records until all the records are processed.


Error Handling

Since Melissa Data uses multiple clustered servers, in the unlikely event that one server is temporarily overloaded or down, it is very likely that another server is up and running. For this reason, it is best to catch any errors returned by the service and retry. We recommend retrying up to 5 times.

int Retry = 0;
Boolean ReqRet = false;
do
{
  try
  {
    // Perform Phone Lookup and store results to the Response
    ResPhone = PhoneClient.doPhoneCheck(ReqPhone);
    ReqRet = true;
  }
  catch (Exception ex)
  {
    MessageBox.Show(ex.ToString());
    Retry++;
  }
} while ((ReqRet == false) && (Retry < 5));2


Network Layer Considerations

IP Addresses

If your company uses a firewall for security, you will need to add our IP address ranges to your list of allowable IP addresses in order to communicate with our web services. Please see this page:

http://www.melissadata.com/tech/webservices-ip-information.htm

We give out best effort to plan ahead and allocated IP ranges for the future, however, it is possible that we will need to add IP ranges as we expand and upgrade or infrastructure. We will send out multiple notifications of any impending update. This is a reason to make sure you have your technical contacts registered with Melissa Data (See Accessing Melissa Data’s Web Services).

Ports

Melissa Data uses the default ports of 80 for http and 443 for https.

Using specific IP’s

Melissa Data does not allow you to access our services using direct IP addresses. We have multiple server clusters and use a load balancing system to distribute incoming traffic. To update our servers, we have to periodically need to take them down and redistribute traffic to available servers.

TTL

To update a server, we take it off of our load balancer and let it drain of traffic. Then, we stop the web service and update the server. People accessing the service using our domain name will automatically be directed to available servers only. However, if your DNS caches the resolved IP address for a significant length of time, it is possible the cached server will be down when you try to hit it. For this reason, if you have access to your DNS TTL (time to live) option, please set it to a value of 10 minutes or less.


Speed Considerations

If speed is a top concern for you, there are a few strategies that can be employed to increase the normal speed of using the service. They are ranked in terms of least effective to most effective.

Use batch instead of single

Processing 100 records at a time will always have a faster per record speed than a single record.

Order by Zip code

Ordering the records by zip code within each request can have a small increase the speed of the request.

Compression

For our services that allow GZip compression, turning it on can have up to a 10% increase in speed. GZip is usually built into a programming language and turned on simply by a flag.

Multi-Threading

Increasing the number of threads is an effective way to quickly increase the speed of using our services. We recommend having between 3-5 threads for batch processing.

Contact Verification Server

For our enterprise customers with speed and/or privacy concerns, we can make available a local server hosting our web services. This server is dedicated to you so that you are not sharing server resources with anyone else. Additionally, since the server is located within your organization, the data does not have to travel over long distances. Also, authentication is turned off to further increase speed. Contact your sales representative if you are interested in this solution.


Understanding the different protocols SOAP vs XML vs REST vs JSON

Melissa Data web services are available in multiple protocols in order to provide our customers a wide range of technologies to fit into their current architecture. The terminologies used above (SOAP, XML, REST, JSON) are not strictly technologically accurate, but used to differentiate the different options available. In the end, all the protocols return the same data, so the choice is really one of programming preference.

SOAP

Ideal for languages with SOAP development toolkits like Visual Studio .NET. This makes consuming and using the service very easy. The SOAP protocol can be used for both single record processing and batch.

A side note for Java developers planning on using SOAP with our web services: please consider using XML instead. Using SOAP entails generating code from the WSDL to invoke the service's methods which is not always a sure process as changes or upgrades to the web services in the future could break client code. Using XML instead is less problematic based on our experiences working with clients on such cases. Both XML and SOAP have similar capabilities in that both protocols allows single record and batch processing.

XML

XML is a HTTP POST call where you send in a request in xml format and receive a response in xml format. The format of the request must follow the structure defined in our documentation for each specific service.

JSON

JSON is also a HTTP POST call just like XML. The only difference is that the request and response uses the JSON format instead of XML format.

REST

REST is a HTTP GET call. This allows you to quickly formulate a call within the URL and submit it through a browser. An example of a REST call:

https://personator.melissadata.net/v3/WEB/ContactVerify/
doContactVerify?&id=123456&act=Check&a1=22382%20avenida
%20empresa&postal=92688

The returned response is in XML and is identical to what is returned by the XML HTTP POST call.

Only one record can use sent using a REST call so it is ideal for real time single record processing.


Special Character Handling

The XML and REST protocols require special character handling when creating your request and interpreting the response. This is because certain special characters are reserved within the XML language.

The following XML encoding should be implemented to correctly handle reserved special characters:

Character Encoding
& & (ampersand)
" (left/right quotes should be replaced with straight quotes)
' (apostrophe)
< < (less-than)
> > (greater-than)


The following URL encoding should be implemented when using REST to correctly handle reserved special characters:

Character Encoding
Space %20 or +
* %2A
# %23
& %26
% %25
$ %28


Reporting Errors

If you are experiencing errors trying to connect to our web services or interruptions to the service, you can:

  1. Submit a support ticket at support.melissadata.com.
  2. Call Tech Support at 1-800-800-6245 ext 4.


If you are experiencing a sudden loss of service, please be ready to provide us with as much of the following pieces of information so that we can assist you promptly and investigate thoroughly.

  • Your Customer ID
  • The location of your server accessing the web service
  • The URL of the web service you are using
  • The type of error you are experiencing in detail
  • Any error messages or logs you may have
  • Date and time of occurrences
  • Behavior of the incidents (is it all the time or periodic. If peridoc, what percentage of requests are affect).
  • What is your IP Address?
  • Are you using a proxy or firewall?
  • Any other information you think may be relevant