I see in the makefiles that there is no option to strip the resulting binaries. I got a 4.2MB RetroArch binary which after stripping is only 1MB. Size reduction of cores is much smaller but still significant if you use a lot of them.
We need the debugging info more than we need the space on most platforms, but it could be good for some platforms, specifically the Wii where RAM is always at a premium.