it maybe that you are trying to decrypt something that was not encrypted to you.
(Technically to the secret key you have access to.)
At least this is what the message implies.
If decrypting with gpa works for you in other cases (and a pinentry comes up),
then it is likely that the first idea is the case, that the file you are trying to decrypt
was just not encrypted to you.