(Please excuse me if this is not the right location for this…)

Using Windows Explorer (2008 R2, 64 bit) I create a folder and create a text file in it.
Edit the file with build 2061.
Close the txt file, but do not exit Sublime Text.
Using Windows Explorer, delete the file.
Then attempt to delete the folder. I gt a message that the folder is locked.
Exit Sublime Text.
Folder can now be deleted.

It sounds like a symptom of the current directory of the Sublime Text process being that of the last opened file - if you open a file in a different directory, then you should be able to delete the original directory.