title: Extract News article content from stored .html pages
body: <p>I am reading text from html files and doing some analysis. These .html files are news articles. </p>
  
  <p><strong>Code:</strong></p>
  
  <pre><code> html = open(filepath,'r').read()
   raw = nltk.clean_html(html)  
   raw.unidecode(item.decode('utf8'))
  </code></pre>
  
  <p>Now I just want the article content and not the rest of the text like advertisements, headings etc. How can I do so relatively accurately in python?</p>
  
  <p>I know some tools like Jsoup(a java api) and <a href="https://code.google.com/p/boilerpipe/downloads/list" rel="noreferrer">bolier</a> but I want to do so in python. I could find some techniques using <a href="https://stackoverflow.com/questions/25752027/get-the-contentsfull-of-text-from-the-paragraph-beautiful-soup">bs4</a> but there limited to one type of page. And I have news pages from numerous sources. Also, there is dearth of any sample code example present.</p>
  
  <p>I am looking for something exactly like this <a href="http://www.psl.cs.columbia.edu/wp-content/uploads/2011/03/3463-WWWJ.pdf" rel="noreferrer">http://www.psl.cs.columbia.edu/wp-content/uploads/2011/03/3463-WWWJ.pdf</a> in python.</p>
  
  <p><strong>EDIT:</strong>
  To better understand, please write a sample code to extract the content of the following link <a href="http://www.nytimes.com/2015/05/19/health/study-finds-dense-breast-tissue-isnt-always-a-high-cancer-risk.html?src=me&amp;ref=general" rel="noreferrer">http://www.nytimes.com/2015/05/19/health/study-finds-dense-breast-tissue-isnt-always-a-high-cancer-risk.html?src=me&amp;ref=general</a> </p>