You may clear caches by deleting files in ~/.cache/ which is totally safe as long as the application using that cache is not running. I doubt that this will help at all to speed up your computer. It only will if your disk is quite full.
Temporary files are often created in /tmp, /run or /run/user/[uid]. These folders will be thrown away on reboot so there is nothing you need to do.