Global Email V3:FAQ: Difference between revisions

From Melissa Data Wiki
Jump to navigation Jump to search
Oscar (talk | contribs)
No edit summary
 
(17 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Global Email|← Global Email]]
[[Global Email V3|← Global Email V3]]
__FORCETOC__
__FORCETOC__
==What Features does it have?==
==What Features does it have?==
*[[Global Email:Functions and Capabilities|Functions and Capabilities]]
*[[Global Email V3:Introduction#Summary|Functions and Capabilities]]


==Available as==
==Available as==
Line 10: Line 9:
*XML (Single, Batch)
*XML (Single, Batch)
*JSON (Single, Batch)
*JSON (Single, Batch)
*SSIS Component (Single, Batch)
*SSIS Component - SOAP (Single, Batch)


==Required Fields==
==Required Fields==
Line 27: Line 26:


;What are the primary result codes?
;What are the primary result codes?
ES01, ES02, ES03 will tell you the primary status of the email.
ES01, ES02, ES03 will tell you the primary status of the email. Good, Bad, or Unknown respectively.


;What are the secondary result codes?
;What are the secondary result codes?
ES04, ES05, ES06, ES07, ES08, ES10, ES11, ES12, ES13, ES23 will tell you additional information about the email.
ES04, ES05, ES06, ES07, ES08, ES09 will tell you additional vital information about the email.


;What are the validation result codes?
;What are the correction result codes?
ES20, ES21, ES22 will tell you the level of validation the email was verified to.
ES10, ES11, ES12, ES13 will tell you if anything in the email has been updated or corrected.
 
;What are the verify result codes?
ES20, ES21, ES22, ES23, ES24 will tell you the level of validation used.


;What are the error result codes?
;What are the error result codes?
EE01, EE02, EE03, EE04, EE05 will tell you what was wrong with the email.
EE01, EE02, EE03, EE04 will tell you what was wrong with the email. So you will frequently see ES02, EEXX grouped together


==Mailbox Validation==
==Mailbox Validation==


;Why should client use email validation?
;Why should client use email validation?
To reduce bounce rates (rejection) and avoid being labeled a spammer from mail servers. Once you are blacklisted, your email deliverability campaigns will suffer a lot and you have trouble sending out emails in the future (most mail servers subscribe to a form of spammers list). Integrators should consult with us to in order to understand what they need to look out for to avoid a bad campaign and why certain emails should be flagged/inspected. Even if you avoid Spamtraps, sending out too many invalid emails will cause the mail server to flag you as a potential spammer (which is why mailbox validation is important).
To reduce bounce rates (rejection) and avoid being labeled a spammer from mail servers. Once you are blacklisted, your email deliverability campaigns will suffer a lot and you have trouble sending out emails in the future (most mail servers subscribe to a form of spammers list). Integrators should consult with us to in order to understand what they need to look out for to avoid a bad campaign and why certain emails should be flagged/inspected. Even if you avoid spam traps, sending out too many invalid emails will cause the mail server to flag you as a potential spammer (which is why mailbox validation is important).


;What is an accept all mail server?
;What is an accept all mail server?
Accept All means that the server stated all emails queries are considered active and valid regardless if they actually are. It is a setting by the responding mail server and we have no way to know if the email actually exists or not. We only know that the responding server says that the email exists regardless if the email actually exists on its server. It is up to you to decide whether or not to risk sending the emails out.
Accept All means that the server stated all emails queries are considered active and valid regardless if they actually are. It is a setting by the responding mail server and we have no way to know if the email actually exists or not. We only know that the responding server says that the email exists regardless if the email actually exists on its server. It is up to you to decide whether or not to risk sending the emails out. Accept All emails generally have a higher bounce rate.


;When should client use premium or express?
;When should client use premium or express?
Premium
Premium
*Should definitely be used for any email marketing campaign or where having the right email in a web form is completely necessary for it to function.                                                                                                                                                                                                                                                                                                                                                                                                                  
*Should definitely be used for any email marketing campaign or where having the right email in a web form is completely necessary for it to function.
 
Express
Express
*Can be used for simple web forms where it would be nice to have a correct email but it isn't absolutely of upmost importance or if there are no consequences for a bad email in realtime. You can validate with premium mode in post batch processing.
*Can be used for simple web forms where it would be nice to have a correct email but it isn't absolutely of utmost importance or if there are no consequences for a bad email in real-time. You can validate with premium mode in post batch processing.


;What is the difference between mailbox and normal email validation?
;What is the difference between mailbox and normal email validation?
Line 68: Line 71:
;What does confidence level mean?
;What does confidence level mean?


ES22 means that we performed a mailbox check on this email. When we say confidence level, we mean the certainty of the result code we are getting back. For example, ES03, ES22. Means that "with high certainty, this email is an unknown email". These ES2x are the identifiers for our mailbox validation calls. Otherwise, we can't keep count of performed mailbox validation calls. So to summarize, the ES2X dictate how certain we are of the ES codes coming back.
ES22 means that we performed a mailbox check on this email. When we say confidence level, we mean the certainty of the result code we are getting back. For example, ES01, ES22. Means that "with high certainty, this email is an valid email". These ES2x are the identifiers for our mailbox validation calls. Otherwise, we can't keep count of performed mailbox validation calls. So to summarize, the ES2X dictate how certain we are of the ES codes coming back.
 
*ES23 is reserved for unicode detection for emails. We do not have UTF-8 Support yet for validating these emails. So for now we just identify these unicoded emails.


==Verify Mailbox Option==
==Verify Mailbox Option==
;What are the differences between the different modes (Express, Premium)?
;What are the differences between the different modes (Express, Premium)?
[[Global Email Web Service:Options|Verify Mailbox Options]]
[[Global Email:Request#Options|Verify Mailbox Options]]
 
==TimeToWait Option==
;What exactly does this do? What number should I be using?
TimeToWait is our newest option designed to give you more control over the process flow. It’s up to you and your team to decide if this option is necessary for you to use. The minimum value for this option is '''5 seconds''', while the maximum value is '''45 seconds'''. The Default value is set to '''25 seconds'''. Setting TimeToWait to a lower number will give you faster, but less accurate results. On the other hand, setting this value to a higher number will give you slower, but more accurate results. It’s up to you and your team to decide what you value more for each project – accuracy or speed. We recommend running a small test batch with a large variety of your emails at different TimeToWait settings. Every ‘ideal number’ will be different; and may change dependent on your email batch. The best way to find your ‘ideal number’ is to get a good spread across your email data base, and test that sample selection at different TimeToWait settings until you find the number that gives you the most accurate results in an acceptable time.
 
For more information, see [[#ES03’s and TimeToWait|ES03’s and TimeToWait]].
 
==ES03’s and TimeToWait==
ES03’s can happen for a wide variety of reasons. One of them being the particular email timed out. We can reduce the number of ES03’s by increasing the length of time before the system will give up on an email and move on to the next. The ‘ideal’ number to use for TimeToWait will change primarily based on your email batch. For example, if you are validating email domains from a small to mid-sized business type you may want to consider increasing your TimeToWait. While on the other hand, if you are validating emails from large mailbox providers or companies you may consider decreasing your TimeToWait.
 
;Recommended TimeToWait
Our research and analysis shows that the TimeToWait option results show varying levels of accuracy. Be warned that your results may vary with your own dataset. For example, the default time of 25 seconds you can expect receive around 7% unknowns.  If you change this to a time out of 20 seconds, you can anticipate around 13% unknowns. At the end of the day you need to determine how accurate you need your results, and how long you are willing to wait to receive them. For example,  batch processing will have a higher accuracy percentage (Less unknowns) from setting a high timeout value. Meanwhile, for real time web form type of validations where speed is of the essence, a lower timeout with logic to handle any potential unknowns may be preferred. We are constantly improving our algorithm in efforts to improve both accuracy and speed, but this is one method for us to give you more control over how our system will handle your data.


=='Good' Email==
=='Good' Email==
Line 83: Line 100:


=='Unknown' Email==
=='Unknown' Email==
;What is a unknown email?
;What is an unknown email?


Unknown email will return a ES03. With mailbox validation even if it's an unknown email, we want to let you know that it's with high certainty that it's an unknown email and that we did try request to the mail server for a mailbox validation call on this email. ES22 means that we performed a mailbox check on this email.  
An unknown email will return a ES03. With mailbox validation even if it's an unknown email, we want to let you know that it's with high certainty that it's an unknown email and that we did try request to the mail server for a mailbox validation call on this email.  


Here are some examples of unknown emails, the mail server for some reason during the mail validation call, triggered our ES03 code either by responding with a non standardized response, or the mail server is increasingly aggressive with their protection to the point where IP address block might be implemented against our system if we continue or mail server tells us that we need to send a message to receive a bounce code (actually performing this could cause IP Block) or Grey Listing technology has been detected (we could not proceed). There are too many to list and some are proprietary in nature.
Here are some examples of unknown emails, the mail server for some reason during the mail validation call, triggered our ES03 code either by responding with a non standardized response, or the mail server is increasingly aggressive with their protection to the point where IP address block might be implemented against our system if we continue or mail server tells us that we need to send a message to receive a bounce code (actually performing this could cause IP Block) or Grey Listing technology has been detected (we could not proceed). Another possible reason, is that the mail server the email resides on is timing out. There are too many to list and some are proprietary in nature. ES03 is meant to convey "at this moment in time, the email's status cannot be determined", email statuses are always in flux and it could change if you were to do another check.


Some mail servers are friendly and some are hostile. We will try to do mailbox validation on all mailboxes. Hostile mail servers have been developing countermeasure technologies to fight detection services like ours. It is a constant warfare for countermeasures and detection technologies. As they constantly develop their technologies...we constantly develop ours. So sometimes, for a certain email, mail server's algorithm at the mailbox validation level did a better job countering our algorithm's moves which results in a ES03.  
Some mail servers are friendly and some are hostile. We will try to do mailbox validation on all mailboxes. Hostile mail servers have been developing countermeasure technologies to fight detection services like ours. It is a constant warfare for countermeasures and detection technologies. As they constantly develop their technologies...we constantly develop ours. So sometimes, for a certain email, mail server's algorithm at the mailbox validation level did a better job countering our algorithm's moves which results in a ES03.  


Like a chess game, the results could be different if we rematch. It is up to you whether you want to run these unknown emails again...our algorithm could perform different actions that might result in a win and you receive a definite ES01/ES02 or lose again with ES03. We implemented a 3 day wait period minimum before retrying. If you do another try before these 3 days, it will result in ES21 (which means we found the "mailbox validation outcome" in our database within 3 days and give that result back).
Like a chess game, the results could be different if we rematch. It is up to you whether you want to run these unknown emails again...our algorithm could perform different actions that might result in a win and you receive a definite ES01/ES02 or lose again with ES03. We implemented a 3 day wait period minimum before retrying.  


*Important: Unknown emails can take as long as 13 seconds to verify. If your process is time sensitive and you are not interested in unknown emails, you can timeout early and mark the email as bad or unknown yourself.
*Important: Unknown emails can take as long as 13 seconds to verify. If your process is time sensitive and you are not interested in unknown emails, you can timeout early and mark the email as bad or unknown yourself.
Line 98: Line 115:


==What speeds can I expect from this web service?==
==What speeds can I expect from this web service?==
The speed of the service depends on the mode (Express, Premium), protocol (SOAP, REST, JSON, XML) and the number of threads/Machine spec.
The speed of the service depends on the mode (Express, Premium), protocol (REST, JSON, XML) and the number of threads/Machine spec.
Sometimes increasing the number of threads will slow down your process due to machine constraints.


;Verify Mailbox<nowiki>:</nowiki> Express
;Verify Mailbox<nowiki>:</nowiki> Express
*You can expect 144,000 - 153,000 validations per hour single threaded.
[[File:WS_GlobalEmailV3_Speed-Express.png]]
*You can expect 191,000 - 217,000 validations per hour with 5 threads.
 
[[File:WS_GlobalEmail_Throughput-FAST.png|800px]]


;Verify Mailbox<nowiki>:</nowiki> Premium  
;Verify Mailbox<nowiki>:</nowiki> Premium  
*You can expect 15,000 - 16,000 validations per hour single threaded.
[[File:WS_GlobalEmailV3_Speed-Premium.png]]
*You can expect 45,000 - 79,000 validations per hour with 5 threads.
 
[[File:WS_GlobalEmail_Throughput-REALTIME.png|800px]]
 
 




[[Category:FAQ]]
[[Category:FAQ]]
[[Category:Global Email]]
[[Category:Global Email V3]]

Latest revision as of 19:07, 10 January 2020

← Global Email V3

What Features does it have?

Available as

  • SOAP (Single, Batch)
  • REST (Single, Batch)
  • XML (Single, Batch)
  • JSON (Single, Batch)
  • SSIS Component - SOAP (Single, Batch)

Required Fields

Mandatory:

  • CustomerID - "Your License Key"
  • Email - "Email to validate"

Optional:

  • RecordID = "Internal Reference"
  • TransmissionReference = "Internal Reference"
  • Options = "Options to set"

Result Codes

What are result codes?

Result codes is what we return to tell you what the status of that email is. Our codes are designed to give back a certain degree of granularity and confidence levels for system integrators to design around.

What are the primary result codes?

ES01, ES02, ES03 will tell you the primary status of the email. Good, Bad, or Unknown respectively.

What are the secondary result codes?

ES04, ES05, ES06, ES07, ES08, ES09 will tell you additional vital information about the email.

What are the correction result codes?

ES10, ES11, ES12, ES13 will tell you if anything in the email has been updated or corrected.

What are the verify result codes?

ES20, ES21, ES22, ES23, ES24 will tell you the level of validation used.

What are the error result codes?

EE01, EE02, EE03, EE04 will tell you what was wrong with the email. So you will frequently see ES02, EEXX grouped together

Mailbox Validation

Why should client use email validation?

To reduce bounce rates (rejection) and avoid being labeled a spammer from mail servers. Once you are blacklisted, your email deliverability campaigns will suffer a lot and you have trouble sending out emails in the future (most mail servers subscribe to a form of spammers list). Integrators should consult with us to in order to understand what they need to look out for to avoid a bad campaign and why certain emails should be flagged/inspected. Even if you avoid spam traps, sending out too many invalid emails will cause the mail server to flag you as a potential spammer (which is why mailbox validation is important).

What is an accept all mail server?

Accept All means that the server stated all emails queries are considered active and valid regardless if they actually are. It is a setting by the responding mail server and we have no way to know if the email actually exists or not. We only know that the responding server says that the email exists regardless if the email actually exists on its server. It is up to you to decide whether or not to risk sending the emails out. Accept All emails generally have a higher bounce rate.

When should client use premium or express?

Premium

  • Should definitely be used for any email marketing campaign or where having the right email in a web form is completely necessary for it to function.

Express

  • Can be used for simple web forms where it would be nice to have a correct email but it isn't absolutely of utmost importance or if there are no consequences for a bad email in real-time. You can validate with premium mode in post batch processing.
What is the difference between mailbox and normal email validation?

Currently, our email object only performs normal email validation which is essentially just a simple spell check, mail server and domain check. Our Global Email Web Service does both mailbox and normal email validation. Mailbox validation means that the mailbox in the mail server is actually active and exists.

What is mailbox validation?

Mailbox validation is more comprehensive beyond than a MX Domain check. Mailbox validation actually asks the mail server to see if that mailbox account is active and if it exists. Otherwise we will only check to see if the mail server is active and if the mail server exists.

Why does an email have no mailbox validation?

Mailbox validation will only occur if the email passes our domain level and syntax level checks.

What does mailbox validation do?

It performs what is known as an SMTP check in the industry. Our service avoids being labeled as spammers for performing this check through proprietary technology. Your emailing reputation will be safe since we are the ones doing the mailbox checks for them. Of course, your emailing reputation will depend on our results when you start your email campaign on your end.

What does confidence level mean?

ES22 means that we performed a mailbox check on this email. When we say confidence level, we mean the certainty of the result code we are getting back. For example, ES01, ES22. Means that "with high certainty, this email is an valid email". These ES2x are the identifiers for our mailbox validation calls. Otherwise, we can't keep count of performed mailbox validation calls. So to summarize, the ES2X dictate how certain we are of the ES codes coming back.

  • ES23 is reserved for unicode detection for emails. We do not have UTF-8 Support yet for validating these emails. So for now we just identify these unicoded emails.

Verify Mailbox Option

What are the differences between the different modes (Express, Premium)?

Verify Mailbox Options

TimeToWait Option

What exactly does this do? What number should I be using?

TimeToWait is our newest option designed to give you more control over the process flow. It’s up to you and your team to decide if this option is necessary for you to use. The minimum value for this option is 5 seconds, while the maximum value is 45 seconds. The Default value is set to 25 seconds. Setting TimeToWait to a lower number will give you faster, but less accurate results. On the other hand, setting this value to a higher number will give you slower, but more accurate results. It’s up to you and your team to decide what you value more for each project – accuracy or speed. We recommend running a small test batch with a large variety of your emails at different TimeToWait settings. Every ‘ideal number’ will be different; and may change dependent on your email batch. The best way to find your ‘ideal number’ is to get a good spread across your email data base, and test that sample selection at different TimeToWait settings until you find the number that gives you the most accurate results in an acceptable time.

For more information, see ES03’s and TimeToWait.

ES03’s and TimeToWait

ES03’s can happen for a wide variety of reasons. One of them being the particular email timed out. We can reduce the number of ES03’s by increasing the length of time before the system will give up on an email and move on to the next. The ‘ideal’ number to use for TimeToWait will change primarily based on your email batch. For example, if you are validating email domains from a small to mid-sized business type you may want to consider increasing your TimeToWait. While on the other hand, if you are validating emails from large mailbox providers or companies you may consider decreasing your TimeToWait.

Recommended TimeToWait

Our research and analysis shows that the TimeToWait option results show varying levels of accuracy. Be warned that your results may vary with your own dataset. For example, the default time of 25 seconds you can expect receive around 7% unknowns. If you change this to a time out of 20 seconds, you can anticipate around 13% unknowns. At the end of the day you need to determine how accurate you need your results, and how long you are willing to wait to receive them. For example, batch processing will have a higher accuracy percentage (Less unknowns) from setting a high timeout value. Meanwhile, for real time web form type of validations where speed is of the essence, a lower timeout with logic to handle any potential unknowns may be preferred. We are constantly improving our algorithm in efforts to improve both accuracy and speed, but this is one method for us to give you more control over how our system will handle your data.

'Good' Email

What is a good email?

A good email will have an ES01 result code, consists of valid characters for the mailbox name, an '@' symbol, and a valid domain name. If mailbox validation option is set, a good email consist of valid characters, valid domain name, and active/existing mailbox account on that mail server (ES20 or ES21 or ES22).

'Bad' Email

What is a bad email?

A bad email will return an ES02. The secondary result code (EExx) will tell you why this email is deemed to be a bad email.

'Unknown' Email

What is an unknown email?

An unknown email will return a ES03. With mailbox validation even if it's an unknown email, we want to let you know that it's with high certainty that it's an unknown email and that we did try request to the mail server for a mailbox validation call on this email.

Here are some examples of unknown emails, the mail server for some reason during the mail validation call, triggered our ES03 code either by responding with a non standardized response, or the mail server is increasingly aggressive with their protection to the point where IP address block might be implemented against our system if we continue or mail server tells us that we need to send a message to receive a bounce code (actually performing this could cause IP Block) or Grey Listing technology has been detected (we could not proceed). Another possible reason, is that the mail server the email resides on is timing out. There are too many to list and some are proprietary in nature. ES03 is meant to convey "at this moment in time, the email's status cannot be determined", email statuses are always in flux and it could change if you were to do another check.

Some mail servers are friendly and some are hostile. We will try to do mailbox validation on all mailboxes. Hostile mail servers have been developing countermeasure technologies to fight detection services like ours. It is a constant warfare for countermeasures and detection technologies. As they constantly develop their technologies...we constantly develop ours. So sometimes, for a certain email, mail server's algorithm at the mailbox validation level did a better job countering our algorithm's moves which results in a ES03.

Like a chess game, the results could be different if we rematch. It is up to you whether you want to run these unknown emails again...our algorithm could perform different actions that might result in a win and you receive a definite ES01/ES02 or lose again with ES03. We implemented a 3 day wait period minimum before retrying.

  • Important: Unknown emails can take as long as 13 seconds to verify. If your process is time sensitive and you are not interested in unknown emails, you can timeout early and mark the email as bad or unknown yourself.
  • Aol and Yahoo mail servers are known to take the longest time to validate.

What speeds can I expect from this web service?

The speed of the service depends on the mode (Express, Premium), protocol (REST, JSON, XML) and the number of threads/Machine spec. Sometimes increasing the number of threads will slow down your process due to machine constraints.

Verify Mailbox: Express

Verify Mailbox: Premium