security

If I encrypt a file with my own public key with GNU GPA and then decrypt it. Shouldn’t I be asked for my password then?

Now it dosen’t feel secure when someone can decrypt my file if they get hold of my secret key.