There is still a lot of software written during the 32-bit era that remains that way but works perfectly fine under 64-bit hardware. My Office 2016 is the 32-bit version, for instance.
Most vendors who have a 64-bit version will sell you that for 64-bit hardware, but there are occasions where 32-bit software is recommended even if the hardware itself is 64-bit.
The above having been said, if you know you have 64-bit hardware (and these days most of us do) then download one of the 64-bit versions. Most would just do the 64-bit full installer, but a portable version exists as well.
Brian - Windows 10, 64-Bit, Version 21H1, Build 19043
It is better to be hated for what you are than to be loved for what you are not.
~ André Gide