Depending on the build architecture, you append either 32 or 64 to the installation dirs (for example bin32 or lib64). The FHS does not specify such suffixes for binary directories, hence your binaries won't be found on most distributions because something like /usr/bin32 is not in $PATH.
Moreover, appending a 64 to the lib directory should be left for the distributions to decide and should be made configurable and/or overridable. See for example this approach posted on the CMake mailing lists.