In "Stalking the Perfect Journal" (Essay 8 in The Great Eskimo Snow Vocabulary Hoax), Geoff Pullum lists some suggestions for improving academic journals; his focus is on linguistics journals, but as you might imagine the suggestions generally apply equally well to philosophy journals. His last and most radical suggestion is that with each paper published, the names of accepting referees be listed (that is, the ones who recommended that the paper be published).
Pullum names three advantages: (i) that hard-working referees would get a little acknowledgment; (ii) that sloppy, too-lenient refereeing would be discouraged; and (iii) that editorial referee selection would have some sunlight thrown on it.
I've mooted this suggestion for discussion among the editors at JESP. Are there any particular worries you can think of? Would this policy make you, personally, less likely to referee for a journal that adopted it?