I would like to pose a set of broad questions about a project called Beat AI: A contest using philosophical concepts (details below) with the LessWrong community. My hope would be that we have a thoughtful and critical discussion about it. (To be clear, I'm not endorsing it; I have concerns, but I don't want to jump to conclusions.)
Some possible topics for discussion might include:
Do you know the project or its founder(s)? How and to what extent are they thinking about AI safety, if at all?
If some people decide here that the project seems risky or misguided, do we want to organize our thinking and possibly draft a letter to the project?
Have you seen projects like the one below where a community is invited to compete against AI models? If so, what patterns have you seen?
The aim of Beat AI is to trick AI systems using your philosophical knowledge. In the process you help us collect data to train better AI models. The game pits you against three models: OpenAI's Ada3-large, BAAI's BGE-large-en-v1.5, and David Bourget's philai-embeddings-v1.1.
By playing, you agree to appearing on the leaderboard and give us a license to use and distribute your submissions. Please read the detailed terms, rules, and tips.
Here is part of the email invitation I received:
I'm writing to invite you to check out Beat AI: A contest using philosophical concepts, a free online game that was just released by the PhilPapers team. The aim is to outwit AI models using your mastery of philosophical concepts. In the process, you will help us develop better AI models for search. Please give it a try and contribute to making PhilPapers better!
I would like to pose a set of broad questions about a project called Beat AI: A contest using philosophical concepts (details below) with the LessWrong community. My hope would be that we have a thoughtful and critical discussion about it. (To be clear, I'm not endorsing it; I have concerns, but I don't want to jump to conclusions.)
Some possible topics for discussion might include:
Do you know the project or its founder(s)? How and to what extent are they thinking about AI safety, if at all?
If some people decide here that the project seems risky or misguided, do we want to organize our thinking and possibly draft a letter to the project?
Have you seen projects like the one below where a community is invited to compete against AI models? If so, what patterns have you seen?
Beat AI: A contest using philosophical concepts
From its webpage:
Here is part of the email invitation I received: