{"action":"created","issue":{"url":"https://api.github.com/repos/w3c/web-annotation/issues/227","repository_url":"https://api.github.com/repos/w3c/web-annotation","labels_url":"https://api.github.com/repos/w3c/web-annotation/issues/227/labels{/name}","comments_url":"https://api.github.com/repos/w3c/web-annotation/issues/227/comments","events_url":"https://api.github.com/repos/w3c/web-annotation/issues/227/events","html_url":"https://github.com/w3c/web-annotation/issues/227","id":155451230,"number":227,"title":"Reference to text encoding in spec perhaps not appropriate","user":{"login":"nickstenning","id":3602,"avatar_url":"https://avatars.githubusercontent.com/u/3602?v=3","gravatar_id":"","url":"https://api.github.com/users/nickstenning","html_url":"https://github.com/nickstenning","followers_url":"https://api.github.com/users/nickstenning/followers","following_url":"https://api.github.com/users/nickstenning/following{/other_user}","gists_url":"https://api.github.com/users/nickstenning/gists{/gist_id}","starred_url":"https://api.github.com/users/nickstenning/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nickstenning/subscriptions","organizations_url":"https://api.github.com/users/nickstenning/orgs","repos_url":"https://api.github.com/users/nickstenning/repos","events_url":"https://api.github.com/users/nickstenning/events{/privacy}","received_events_url":"https://api.github.com/users/nickstenning/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/w3c/web-annotation/labels/i18n-review","name":"i18n-review","color":"5319e7"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2016-05-18T09:07:10Z","updated_at":"2016-05-20T18:41:41Z","closed_at":null,"body":"#222 made me aware of the following text in the model spec:\r\n\r\n4.2.4 Text Quote Selector\r\nhttps://www.w3.org/TR/2016/WD-annotation-model-20160331/#text-quote-selector\r\n> The text must be normalized before recording. Thus HTML/XML tags should be removed, character entities should be replaced with the character that they encode, unnecessary whitespace should be normalized, **character encoding should be turned into UTF-8**, and so forth. The normalization routine may be performed automatically by a browser, and other applications should implement the DOM String Comparisons method. This allows the Selector to be used with different encodings and user agents and still have the same semantics and utility.\r\n\r\nIf all selector references are to be w.r.t. codepoint sequences (c.f. #206) then I'm not sure the spec should be referring to text encoding. (Because we're assuming that you're annotating unicode text, not some byte sequence.)"},"comment":{"url":"https://api.github.com/repos/w3c/web-annotation/issues/comments/220686625","html_url":"https://github.com/w3c/web-annotation/issues/227#issuecomment-220686625","issue_url":"https://api.github.com/repos/w3c/web-annotation/issues/227","id":220686625,"user":{"login":"tilgovi","id":20818,"avatar_url":"https://avatars.githubusercontent.com/u/20818?v=3","gravatar_id":"","url":"https://api.github.com/users/tilgovi","html_url":"https://github.com/tilgovi","followers_url":"https://api.github.com/users/tilgovi/followers","following_url":"https://api.github.com/users/tilgovi/following{/other_user}","gists_url":"https://api.github.com/users/tilgovi/gists{/gist_id}","starred_url":"https://api.github.com/users/tilgovi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tilgovi/subscriptions","organizations_url":"https://api.github.com/users/tilgovi/orgs","repos_url":"https://api.github.com/users/tilgovi/repos","events_url":"https://api.github.com/users/tilgovi/events{/privacy}","received_events_url":"https://api.github.com/users/tilgovi/received_events","type":"User","site_admin":false},"created_at":"2016-05-20T18:41:41Z","updated_at":"2016-05-20T18:41:41Z","body":"I think these normalization rules need some change.\r\n\r\nCode points don't refer to a particular byte encoding. A single code point may be 1 or more bytes, depending on the encoding. I hope I'm using these terms correctly.\r\n\r\nCounting code points, it shouldn't matter if the quote is UTF-8 and the text is UTF-16.\r\n\r\nWhy do we specify normalization of white space, though? Why strip the selector of precision? Maybe my annotation is intended to target some whitespace.\r\n\r\nWe should maybe be clearer about Unicode normalization. I'd say let's explicitly recommend against transforming the code points, removing combining codes and such, but I'm a little worried tools might do this anyway and we might best be served by suggesting that normalization is always done. That's another performance impacting demand to make, though."}}
{"actor":{"display_login":"tilgovi"}}