Which version are you using? Are you overwriting any points during any of your writes? I think there's a known issue with 0.13 regarding overwritten points where it can get screwed up and take an absurdly long time to return. I think that's fixed on master and might be fixed with beta2. #6611 for reference.