Restricting permissions to individual documents on SharePoint

"I just give it a try and this is what I've done:

On the document (Word 2007 document):

Manage Permissions - Actions - Edit Permissions - New - Add User - Then I added a specified user that is not in any administrative groups on sharepoint and he was able to open the document

I removed this user and he is not able to open the file. Access Denied."