One of the Old English words for "foreigners" was utlenden ("outlanders"), which could be corrupted to "Little London".
The term "utlenden", meaning "foreigners" in Old English, might have been misheard as "Little London".