title: Fuzzy (text / string) matching with AI (for handling common abbreviations)
body: <p>Hi,</p>
  
  <p>i have the following task:</p>
  
  <p>1) i have a list A of 700.000 train/bus stations with name</p>
  
  <p>2) i have a list B of 300.000 train/bus stations with name (slightly different spelled of course)</p>
  
  <p>3) for lets say 150.000 elements of B i know the exact match in A.</p>
  
  <p>4) i want to match the other half of the elements in B with A (lets say we know there is a match).</p>
  
  <p>I know there are lots of similar questions here regarding this kind of fuzzy text/string matching, but what i find unsatisfying is the fact, that more or less they all depend on algorithms like Levenshtein distance, and Levenshtein is kind of problematic if your texts have some abbreviations. For example, "Gleis"="Gl." (german for platform) or "strasse" = "str." (german for street) should not increase the difference-score. Same for abbreviated citynames and and and.</p>
  
  <p>There are more of these Abbreviations than i can handle manually, so i thought i could use the fact i have the training data in 3)</p>
  
  <p>Does anybody have an idea / thoughts / projects / remarks on using AI / machine learning for this kind of task? The training data should be enough for the algorithm to learn most of the common abbreviations.</p>
  
  <p>Also, i have seen some AI-approaches to this, but they only use AI to find a suitable border of the used distance function to distinguish between match and no-match, which does not help with the abbreviations.</p>
  
  <p>Thanks,
  Tim</p>