More BS on your part: The Presidential Records Act of 1978 established that all presidential records are owned by the public and automatically transfer into the custody of the National Archives as soon as a commander-in-chief leaves office.
The law is clear and NO - other presidents did NOT take their papers with them- their papers went to the govt and became part of their presidential libraries.
But even IF we were discussing Trump's diary- are you asserting he can take home documents classified or declassified? Really That is your defense?