If those things (that you update) ore too minor to be updated on changelog etc, then why newer version is being released.
You release new version, because you know that you have done some hard work and it is worth for end users, so you made it available on download page.
By Hard Work, it is definitely clear that, either you fix bugs (whether they are related to internal behavior of the software or with the output of the code) or you add something new.
Not me, but almost everyone, downloads newer versions and at the same time everyone is curious, that what was actually in new release.
Lets suppose, if you update on changelog, that your newer version is now supporting Some New Lanuguage and nothing else is changed, then i might not download it, but user of that particular language will definitely download it. It will save bandwidth of many users too.
So it will be really nice to update changelog or release notes.
You can make it simple.
On forum, create a new thread for software release, so whenever you release new version just update their the release notes, there is no need to have a separate changelog, blog and download page (because i can see, you are facing team issues to update the site)