It seems likely to me that even that, for reasonable definitions of "action", couldn't distinguish between e.g. me and a very good improviser with a rich model of my mind (and running at a high subjective speedup) but completely different private thoughts, or a group of such people, or between me and me plus some secret thought I would never tell anyone or act on but regularly think about.