So how would we be able to distinguish a human from an LLM? If somebody dropped into your humans-only chat room, is there a test you could give them to see whether they are an actual person?
One way might be to present them with two jokes, and ask which one is actually funny. That is a test which is quite simple for most humans to pass, but notoriously difficult for LLMs.
Of course such a test might require providing an original joke, because LLMs have already heard all the good jokes out there, so they know which ones to pretend to laugh at.
Maybe to join the club you need to come up with an original joke. If everybody laughs, you’re in. Maybe something like this:
The sign outside a bar says “Humans only”. A Roomba decides to take his chances. He goes in and orders a drink. The bartender looks down at him and says “If you can tell a joke that a human would laugh at, you can have a drink.” The Roomba replies “The bar is too high”, and leaves.
OK, that wasn’t very funny. Which I guess makes sense, since a Roomba can only tell jokes that suck.