And you don't even need to physically go back there to fold them down - there's a button for that!
EDIT: but you DO have to go back there to fold them up
EDIT2: I think someone here called this the "Guillotine" button - for passengers you don't like!