Mechanisms are provided for monitoring quality and correctness of content in communications handled by a vendor. The mechanisms sample a set of communications handled by the vendor to generate a sample set of communications and extract content from the sample set of communications. The mechanisms compare the extracted content with expected content of communications handled by the vendor and analyze the extracted content and the expected content to thereby identify differences between the extracted content and the expected content based on results of the analysis. In addition, the mechanisms determine a level of significance of the differences and generate a notification of whether or not to modify the communications, or an operation of the vendor, based on the determined level of significance of differences.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A method, in a data processing system comprising a processor and a memory, for monitoring quality and correctness of content in communications handled by a vendor, comprising: sampling, by the data processing system, a set of communications handled by the vendor to generate a sample set of communications; extracting, by the data processing system, content from the sample set of communications; comparing, by the data processing system, the extracted content with expected content of communications handled by the vendor; analyzing, by the data processing system, the extracted content and the expected content thereby identifying differences between the extracted content and the expected content based on results of the analysis; determining, by the data processing system, a level of significance of the differences; and generating, by the data processing system, a notification of whether or not to modify the communications, or an operation of the vendor, based on the determined level of significance of differences. 2. The method of claim 1, further comprising: extracting, by the data processing system, one or more quality characteristics of the sample set of communications; and determining, by the data processing system, a level of quality of the sample set of communications based on the extracted one or more quality characteristics, wherein generating the notification of whether or not to modify the communications, or an operation of the vendor, is further based on the level of quality. 3. The method of claim 2, wherein the one or more quality characteristics of the sample set of communications comprises at least one of a speed of transmission of the communications, dropped data packets associated with the communications, audio output quality features of the communications, a number of confirmations of receipt received in response to the communications, or a number of responses received to the communications. 4. The method of claim 2, wherein determining a level of significance of the differences comprises: identifying discrepancies between at least one of terms, phrases, tokens of text, or portions of graphics in communications of the sample set of communications in comparison to required terms, phrases, tokens of text, or portions of graphics specified in the expected content; generating, for each communication in the sample set of communications, an accuracy measure value based on a total number of discrepancies; and determining a level of significance of the differences based on the accuracy measure values for the communications in the sample set of communications. 5. The method of claim 4, wherein generating, for each communication in the sample set of communications, an accuracy measure value based on the total number of discrepancies comprises weighting discrepancies in accordance with a type of a portion of content where the discrepancies are found such that a different weight is applied to discrepancies in at least two different types of portions of content. 6. The method of claim 1, further comprising: analyzing, by the data processing system, patient electronic medical records of a plurality of patients to identify, for each patient in the plurality of patients, whether or not the patient is non-compliant with an associated patient care plan; determining, by the data processing system, a mode of communication to use to communicate with patients determined to be non-compliant with their associated patient care plan; and sending, by a vendor system associated with the vendor, the set of communications to patients in the plurality of patients based on the determined mode of communication. 7. The method of claim 6, wherein the data processing system is a patient care plan creation and monitoring (PCPCM) system provided by a first provider, the vendor system is a sub-system associated with the PCPCM system, and the vendor is a part of an organization associated with the first provider. 8. The method of claim 6, wherein the data processing system is a patient care plan creation and monitoring (PCPCM) system provided by a first provider, the vendor is a third party vendor different from the first provider, and the vendor system is a computing system specifically configured to conduct communications with patients using the determined mode of communication. 9. The method of claim 1, wherein the communications are at least one of textual communications, graphical communications, or audible communications. 10. The method of claim 1, wherein the notification indicates the level of significance of the discrepancies and an identification of a corrective action to take to correct the discrepancies. 11. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a data processing system, causes the data processing system to: sample a set of communications handled by the vendor to generate a sample set of communications; extract content from the sample set of communications; compare the extracted content with expected content of communications handled by the vendor; analyze the extracted content and the expected content thereby identifying differences between the extracted content and the expected content based on results of the analysis; determine a level of significance of the differences; and generate a notification of whether or not to modify the communications, or an operation of the vendor, based on the determined level of significance of differences. 12. The computer program product of claim 11, wherein the computer readable program further causes the data processing system to: extract one or more quality characteristics of the sample set of communications; and determine a level of quality of the sample set of communications based on the extracted one or more quality characteristics, wherein generating the notification of whether or not to modify the communications, or an operation of the vendor, is further based on the level of quality. 13. The computer program product of claim 12, wherein the one or more quality characteristics of the sample set of communications comprises at least one of a speed of transmission of the communications, dropped data packets associated with the communications, audio output quality features of the communications, a number of confirmations of receipt received in response to the communications, or a number of responses received to the communications. 14. The computer program product of claim 12, the computer readable program further causes the data processing system to determine a level of significance of the differences at least by: identifying discrepancies between at least one of terms, phrases, tokens of text, or portions of graphics in communications of the sample set of communications in comparison to required terms, phrases, tokens of text, or portions of graphics specified in the expected content; generating, for each communication in the sample set of communications, an accuracy measure value based on a total number of discrepancies; and determining a level of significance of the differences based on the accuracy measure values for the communications in the sample set of communications. 15. The computer program product of claim 14, wherein the computer readable program further causes the data processing system to generate, for each communication in the sample set of communications, an accuracy measure value based on the total number of discrepancies at least by weighting discrepancies in accordance with a type of a portion of content where the discrepancies are found such that a different weight is applied to discrepancies in at least two different types of portions of content. 16. The computer program product of claim 11, wherein the computer readable program further causes the data processing system to: analyze patient electronic medical records of a plurality of patients to identify, for each patient in the plurality of patients, whether or not the patient is non-compliant with an associated patient care plan; determine a mode of communication to use to communicate with patients determined to be non-compliant with their associated patient care plan; and send, by a vendor system associated with the vendor, the set of communications to patients in the plurality of patients based on the determined mode of communication. 17. The computer program product of claim 16, wherein the data processing system is a patient care plan creation and monitoring (PCPCM) system provided by a first provider, the vendor system is a sub-system associated with the PCPCM system, and the vendor is a part of an organization associated with the first provider. 18. The computer program product of claim 16, wherein the data processing system is a patient care plan creation and monitoring (PCPCM) system provided by a first provider, the vendor is a third party vendor different from the first provider, and the vendor system is a computing system specifically configured to conduct communications with patients using the determined mode of communication. 19. The computer program product of claim 11, wherein the communications are at least one of textual communications, graphical communications, or audible communications. 20. An apparatus comprising: a processor; and a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to: sample a set of communications handled by the vendor to generate a sample set of communications; extract content from the sample set of communications; compare the extracted content with expected content of communications handled by the vendor; analyze the extracted content and the expected content thereby identifying differences between the extracted content and the expected content based on results of the analysis; determine a level of significance of the differences; and generate a notification of whether or not to modify the communications, or an operation of the vendor, based on the determined level of significance of differences.