No, I don't think you can, but it's an interesting question.
You could just return the money to the account it came from (assuming you have the account number).
Otherwise, shuffle it into a savings account, somewhere you won't just use it, and send back a cheque for a lump some after a few months.
Of course, if you closed the account it is being paid to, then it would be returned to the originator by the bank.
If someone is sending you money you don't want, I'll deal with it for you.