When an UPSERT is prepared, it can use a cached statement to be
turned into REPLACE. But now it doesn't use the cache.

Test for #2520