Is a Self-Iterating AGI Vulnerable to Thompson-style Trojans?
In his 1984 lecture "Reflections on Trusting Trust", Ken Thompson (of Unix fame) speculated about a methodology for inserting an undetectable trojan horse within the C compiler binary that would self-propagate throughout all future versions. (Additional good video that got me thinking about this.) > The replacement code would miscompile the login command so that it would accept either the intended encrypted password or a particular known password. Thus if this code were installed in binary and the binary were used to compile the login command, I could log into that system as any user. The lecture explains the trojan far better than I can, but appears to be a vulnerability that occurs within bootstrapped compilers, and specifically arises at the point at which the compromised version of the compiler is responsible for compiling the next version. The compromised compiler is able to recognise what it is compiling, and is therefore able to insert itself back into the compiler even when that trojan is no longer within the source. Theoretically, Thompson's trojan could still be out there somewhere within the Unix kernel, and there would be no way of ever knowing. Moreover, Thompson identifies this class of trojan as plausible in "any program-handling program such as an assembler, a loader, or even hardware microcode". Even if you were to go and download the GCC source code and build your own compiler from source, you must do so with a potentially compromised version of the compiler. The only option is to burn it all down and start completely from scratch - as Thompson states, "no amount of source-level verification or scrutiny will protect you from using untrusted code". Let's think about the most abstract representation of a system vulnerable to this attack: We represent some kind of iterative process as two types of component: * S represents the symbols we input into the iteration process, S' the second set, and so on. * In a compiler, this is the source c
Retailer console base prices are set by the manufacturer. A first-party retailer is not allowed to charge more than the RRP as part of their agreement.
Perhaps an important economic point here is that consoles are generally sold below-cost. Console manufacturers lose money on every product they sell from hardware costs. This is because consoles make their money on games, where the margins are much fatter.
The issue here is that the manufacturers and retailers are working in a commodity mindset, whereas the market for these items... (read more)