Thank you for reading our paper and providing such thoughtful feedback! I would like to respond to your points.
First, regarding your plot with the caption ℓsadness⊥(ℓsadness−ℓjoy), it appears that you are still using “the span of sadness and all emotions” without estimating ¯ℓjoy. As a result, there is no information about ¯ℓjoy in the 2D projection plot. When I estimate both ¯ℓsadness and ¯ℓjoy using your token collections, I find that cos(¯ℓsadness,¯ℓjoy)=0.2246 and cos(¯ℓsadness,¯ℓsadness−¯ℓjoy)=0.6818.
Second, I agree that our original experiments lacked sufficient baselines. In response, we have uploaded version 2 of the arXiv preprint, which now includes a comprehensive set of baselines.
As you mentioned, vectors in high-dimensional spaces are orthogonal with high... (read more)
Thank you for reading our paper and providing such thoughtful feedback! I would like to respond to your points.
First, regarding your plot with the caption ℓsadness⊥(ℓsadness−ℓjoy), it appears that you are still using “the span of sadness and all emotions” without estimating ¯ℓjoy. As a result, there is no information about ¯ℓjoy in the 2D projection plot. When I estimate both ¯ℓsadness and ¯ℓjoy using your token collections, I find that cos(¯ℓsadness,¯ℓjoy)=0.2246 and cos(¯ℓsadness,¯ℓsadness−¯ℓjoy)=0.6818.
Second, I agree that our original experiments lacked sufficient baselines. In response, we have uploaded version 2 of the arXiv preprint, which now includes a comprehensive set of baselines.
As you mentioned, vectors in high-dimensional spaces are orthogonal with high... (read more)