For me, refactoring means simple, no-risk code re-organization only. It should be executed often during the production and it should serve foremost code-reuse and better readability. Anything going further than that is for me rewriting and should be considered appropriately.
You are absolutely right, see the definition on https://refactoring.com/
Unfortunately, it has become common to refer to any kind of code changes as refactorings (not backed by any proof, just an observation)
