these emulation handhelds – which often come pre-loaded with hundreds of games

I can only speak for the retroid pocket I have. It’s not far off from a stock android phone, sans camera and modem, plus d-pad and sticks.

It only came preloaded with a few open source emulators available on play store for free in addition to GApps (with official play store support).