It's a 50-50 arbitrary convention.
I suggest physically tracing through the matrices with one finger from each hand. As you would multiply If you do it the right way enough times, doing it the wrong way will feel weird.
Also, the canonical example is y=Ax, with A a matrix, and x,y as vertical vectors. If you can at least remember that one goes vertically, and one horizontally, Ax will show that it is the one on the right that goes vertically.
This thread is for asking any questions that might seem obvious, tangential, silly or what-have-you. Don't be shy, everyone has holes in their knowledge, though the fewer and the smaller we can make them, the better.
Please be respectful of other people's admitting ignorance and don't mock them for it, as they're doing a noble thing.
To any future monthly posters of SQ threads, please remember to add the "stupid_questions" tag.