Hey quiet_NaN, co-lead author here, you make very good points which led me to look deeper into the agent's behaviour and the way the Oracle task is implemented. By the way, it's great to get feedback from clear NetHack enthusiasts!
The first thing is that the Oracle task is based on the condition that checks specifically for the oracle symbol. It does mean that from the point view of the probability of hallucinating the oracle, the chances are pretty low - unless you can stay multiple steps next to a creature. This last part is key, and it is by combining i... (read more)
Hey quiet_NaN, co-lead author here, you make very good points which led me to look deeper into the agent's behaviour and the way the Oracle task is implemented. By the way, it's great to get feedback from clear NetHack enthusiasts!
The first thing is that the Oracle task is based on the condition that checks specifically for the oracle symbol. It does mean that from the point view of the probability of hallucinating the oracle, the chances are pretty low - unless you can stay multiple steps next to a creature. This last part is key, and it is by combining i... (read more)