LESSWRONG
LW

gwern
80559Ω16391881186351
Message
Dialogue
Subscribe

https://gwern.net/

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
11gwern's Shortform
Ω
4y
Ω
62
Shorter Tokens Are More Likely
gwern9d111

So, most LLM RL training would be expected to exacerbate this issue?

Reply1
HPMOR: The (Probably) Untold Lore
gwern9d*127

I think that it's a pity if people write off my SD page because they failed to understand the meaningful illustration I put effort into creating and didn't, say, check the alt text to see if they were missing something or wonder why such an unusual website would have "AI slop"; and I agree that this may be a case of "things you can't countersignal".

However, I refuse to submit to the tyranny of the lowest common denominator and dumb down my writings or illustrations. I don't usually write for such readers, and I definitely do not write my Gene Wolfe essays for them!

So unless people can point to something actually bad about the illustration, which makes it fail to satisfy my intent - as opposed to something bad about the readers like being dumb and ignorant and writing it off as "AI slop" when it's not - then I decline to change it.

Reply
Open Thread - Summer 2025
gwern9d20

The image borders are exposed, and the white fade does not work. Compare to the fully functional light mode:

To be honest, I don't like the light-mode example either. I think it's bad to have your text visibly overlapping like that. (If I made an image which I had put .float-right .outline-not on to get the same effect on gwernnet and I saw your 'good' white-mode version, I would be immediately complaining to Obormot about his CSS being busted.) So in this example, isn't a lot of the problem that the UI elements are overlapping so the text is spilling over onto the scales and blocking the wires etc, and the dark-mode merely exacerbates the problem and fixing the core problem would also fix the dark-mode issue?

Reply
Open Thread - Summer 2025
gwern10d20

FWIW, my impression is that while the gwern.net dark mode was a ton of work to create, due to requiring a total refactoring of the CSS and deal with the flash-of-white issue and figure out the correct three-mode behavior, and create tooling like the color conversion script or needing to create InvertOrNot.com for acceptable images, or tweak the syntax highlighting colors to look right in dark-mode... But once we finished paying all of that, the maintenance burden has been relatively small. I have to patch up the occasional image not inverting right and we have to occasionally special case some Wikipedia popups CSS, but it's on net less effort than much of the website (eg. Apple device support, or the local archive system, are perennial hassles).

The gwernnet dark-mode is pretty good engineering work overall. We should've done a design-graveyard writeup to explain not just how it works (non-obvious) but the problems with the more obvious approaches and what problems we had etc. I fear it might be too late to write it now even if we had the time...

Reply
HPMOR: The (Probably) Untold Lore
gwern10d*145

I don't believe it is "AI slop", much less that it is "pretty nasty". I consider AI slop to be low-meaning and low-effort generative media which adds little or nothing to the experience

I assume you are referring to the German Expressionism, alluding to Nosferatu (which is highly relevant for at least two reasons), image illustrating the narrator's childhood iceskating in a New England Protestant town in decline due to Dracula taking it over; I generated it in MJ after cracking SD, to sum up the horrifying reality of my solution. I put several hours of thought and effort into the concept and creating it, and got what I wanted, so I think this is just a case of de gustibus non est disputandum. I felt it cleverly visually encapsulated the mood of the horror that Gene Wolfe meant to lurk underneath the harmless nearly-bucolic appearance of SD and enhanced the experience.

So I think it satisfies my 3 criteria: it is not low-meaning, was not low-effort, and adds something. But I don't think this is a good place to discuss it, so I have added a more detailed discussion of that image's process & meaning to my image slop blog post as an example of how I think I get good image samples.

EDIT: I would be curious about the disagrees. What, exactly, are you disagreeing with? Do you think I am lying about the creation process, the prompt, or the meaning? (I would point out that there was already a short version of this description in the alt text, and has been since I added it in the first place c. November 2023.) Do you disagree that the high concept reflects my SD interpretation? Or what?

Reply
Cole Wyeth's Shortform
gwern10d*82

If you asked me to guess what would be the 'elegant' counterpoint to 'traveling with a carefully-curated of the very best prepper/minimalist/nomad/hiker set of gear which ensure a bare minimum of comfort' was, I would probably say something like 'traveling with nothing but cash/credit card/smartphone'. You have elegantly solved the universe of problems you encounter while traveling by choosing a single simple tool which can obtain nearly anything from the universe of solutions.

Reply
Spending Too Much Time At Airports
gwern14d30

Remote seating has its own problems. On my last flight to SF, I almost missed my late-night flight out because I had (very unusually for me) found a more pleasant, quieter, empty gate to make a phone call on, out of eyeshot; and then my flight was delayed twice so the original boarding time flew past; and eventually I got so wrapped up in the call that I let the time slip until a vague nagging anxiety and had to wrench myself out and run in a panic to my actual gate - where fortunately there was still <10 minutes of boarding left. While it took at least 3 problems and I didn't actually miss my flight in the end, it would've been bad because it was probably the last one out that night to SF, and it's the first time I have ever come anywhere close to missing my flight while having actually been sitting at the gate hours before... So it was a memorable and alarming near-miss for me.

Reply
keltan's Shortform
gwern16d51

Indeed they are different mindsets. They are, however, both mindsets of concern.

Reply
Enlightenment AMA
gwern16d62

I’ve never seen them express the slightest stress or mental tension. Zuiko of them is an old woman who’s hands hurt and are failing due to arthritis and she seemed more concerned with just listening to me than talking about her problems.

Sounds like a(nother) good example of the downsides of lacking pain/stress.

Reply
keltan's Shortform
gwern16d91

it mostly communicates that they’re a heavy user of the internet.

That true fact in no way contradicts dbohdan's point. ("The import of an act lies not in what that act resembles on the surface, Mr. Potter, but in the states of mind which make that act more or less probable.")

Reply
Load More
27Security Mindset: Hacking Pinball High Scores
3mo
3
213If you're not sure how to sort a list or grid—seriate it!
3mo
7
61October The First Is Too Late
4mo
10
60Ideas for benchmarking LLM creativity
9mo
11
135"Can AI Scaling Continue Through 2030?", Epoch AI (yes)
1y
4
22"On the Impossibility of Superintelligent Rubik’s Cube Solvers", Claude 2024 [humor]
1y
6
176FHI (Future of Humanity Institute) has shut down (2005–2024)
1y
22
428Douglas Hofstadter changes his mind on Deep Learning & AI risk (June 2023)?
2y
54
72COVID-19 Group Testing Post-mortem?
Q
3y
Q
6
21Emergent Ventures/Schmidt (new grantor for individual researchers)
3y
6
Load More
Adaptation Executors
6y
(-385)
Adaptation Executors
6y
(+385)
LessWrong Presence on Reddit
6y
(-22)
Simulation Hypothesis
8y
(+27/-2693)
Bayesian Conspiracy
8y
(+11)
Bayesian Conspiracy
8y
On Designing AI (Sequence)
8y
Robot
9y
(-31)
Robot
9y
(-119)
Robot
9y
(-33)
Load More