title: Sentence tokenization for texts that contains quotes
body: <p>Code:</p>
  
  <pre><code>from nltk.tokenize import sent_tokenize           
  pprint(sent_tokenize(unidecode(text)))
  </code></pre>
  
  <p>Output:</p>
  
  <pre><code>[After Du died of suffocation, her boyfriend posted a heartbreaking message online: "Losing consciousness in my arms, your breath and heartbeat became weaker and weaker.',
   'Finally they pushed you out of the cold emergency room.',
   'I failed to protect you.',
   '"Li Na, 23, a migrant worker from a farming family in Jiangxi province, was looking forward to getting married in 2015.',]
  </code></pre>
  
  <p>Input:</p>
  
  <blockquote>
    <p>After Du died of suffocation, her boyfriend posted a heartbreaking
    message online: "Losing consciousness in my arms, your breath and
    heartbeat became weaker and weaker. Finally they pushed you out of the
    cold emergency room. I failed to protect you."</p>
    
    <p>Li Na, 23, a migrant worker from a farming family in Jiangxi province,
    was looking forward to getting married in 2015.</p>
  </blockquote>
  
  <p>Quotes should be included in previous sentence. Instead of  <code>" Li.</code></p>
  
  <p>It fails at <code>."</code> How to fix this?</p>
  
  <p><strong>Edit:</strong>
  Explaining the extraction of text.</p>
  
  <pre><code>html = open(path, "r").read()                           #reads html code
  article = extractor.extract(raw_html=html)              #extracts content
  text = unidecode(article.cleaned_text)                  #changes encoding 
  </code></pre>
  
  <p>Here, article.cleaned_text is in unicode. The idea behind using this to change characters “ to ".</p>
  
  <p>Solutions @alvas Incorrect Result:</p>
  
  <pre><code>['After Du died of suffocation, her boyfriend posted a heartbreaking message online: "Losing consciousness in my arms, your breath and heartbeat became weaker and weaker.',
   'Finally they pushed you out of the cold emergency room.',
   'I failed to protect you.',
   '"',
   'Li Na, 23, a migrant worker from a farming family in Jiangxi province, was looking forward to getting married in 2015.'
  ]
  </code></pre>
  
  <p><strong>Edit2:</strong>
  (Updated) nltk and python version</p>
  
  <pre><code>python -c "import nltk; print nltk.__version__"
  3.0.4
  python -V
  Python 2.7.9
  </code></pre>