Finally got images working on the weblog again. The answer was, somehow the permissions for the insert module were wrong, and somehow it was disabled for the weblog entry (on the Manage Form Display page).
(Also, somehow my image style for all existing weblog images is messed up. So I have to find all existing weblog images and re-add them, individually, to every entry. Ah well.)