Very true, TempData has it's drawbacks.

What you could do is make sure that the hiddenfield's contents is hashed in some sort of way, limiting the risc of tampering.

Otherwise, i can't think of any other simple solution to this.