We could not find a "speak in French" vector after about an hour of effort, but it's possible we missed something straightforward
Did you try 10 or 20 simple French phrases with a positive sign and their translations with a negative sign?
Also try 1000 english words and 1000 french translations in case scale is the problem.
Also try:
"The following text is in English: ' "
"The following text is in French: ' "
with the second phrase written itself in French.
In my opinion Wearable health is highly neglected because older people are less tech savy than young people, so they use it less than younger people, but they would also benefit much more from the technology. If a 20 year old wears a smart watch that measures and records heart-rate it is almost only for fun, if a 60 year old does it, it could prevent and inform about important issues, but the 20 year old is much more likely to actually use it than the 60 year old.
I also asked ChatGPT, here are the six best ideas that it had (excluding electric bikes, as it was already my idea ;P) (cherry picked by me over 21):
...Online education: Online education platforms like Coursera and Khan Academy were mature, widely available, intuitive, and cost no money for basic usage. They also had no regulatory barriers or moral issues and could be used by mutual agreement among one or a few people. Online education also saved a lot of time and played relatively well with the existing format of learning and education.
Digital wallets:
Electric bikes are vastly under-utilized even in European cities where they are safe and effective to use:
I think electric bikes are a pretty good candidate! I own one and it was transformative for biking around Seattle.
On reflection, I think my reason for thinking th...
Here is my playthrough with my though process:
:::spoiler
>!0) [2, 4, 6] is VALID
>!Now I think, let's check if the rule is *2
>!1) [31, 62, 93] is VALID
>!Let's check if the rule is always true with 3 random numbers.
>!2) [6534525, 142536, 456342532] is NOT VALID
>!I wanted to check multiply by 3, but I repeated multiply by 2
>!3) [5, 10, 15] is VALID
>!Checking multiply by 3
>!4) [7, 21, 63] is VALID
>!Checking multiply by 10
>!5) [50, 500, 5000] is VALID
>!Now I am thinking: maybe any multiplication is ok? I cannot try them all, l...
So what about an ensamble of the top 20 linear probes? Is it substantially better than using just the best one alone? I would expect so given that they are orthogonal, so they are using ~uncorrelated information.
The most important thing is approaching other points of view with an open mind, with epistemic humility , that is, knowing that something of what you think can be wrong, even if, from the inside, everything feels right.
On the object level:
"""
That's when I discovered more effective ways to approach reading, including what I'll call "Guess-and-Check," the technique of scanning and making predictions. Instead of trying to read every word in a textbook, in Guess-and-Check you scan the material and make predictions about what you think the text is saying. This active reading process can help you better engage with the material and activate your prior knowledge. After making your prediction, be sure to confirm or correct it by checking it against the text.
"""
This is similar to the way GPT-3 was trained! Pretty cool that you also found it effective!
Yes, the tone of my comment could be improved. I appreciate him for publishing his lessons to the community and wanted to give some suggestions to improve (eventual) future ones, if he feels like the higher quality is worth the higher effort, and with no obligation. "Al caval donato non si guarda in bocca" (You should not look at the teeth of a gift horse (to learn about its age))
Some suggestions:
Yes of course:
Models:
Datasets:
Also in the performance metric, the sum of the performance of each layer should probably be weighted to give less importance to the initial layers, otherwise we encourage t...
Probably even if not completely by hand, MNIST is so simple that hybrid human-machine optimization could be possible, maybe with a UI where you can see the effect on validation loss in (almost) real time of changing a particular weight with a slider. I do not know if it would be possible to improve the final score by changing the weights one by one. Or maybe the human can use instinctual vision knowledge to improve the convolutional filters.
On Cifar this looks very hard to do manually given that the dataset is much harder than Mnist.
I think that a too larg...
The performance can be a weighted average of the final performance and how uniformly we go from totally random to correct. For example if we have 10 refinement models the optimal score in this category can be had when each refinement block reduces the distance from the initial text encoding random vector to the final one by 10% of the original distance each time. This should make sure that the process is in fact gradual, and not that for example, the last two layers do all the work and everything before is just the identity. Also maybe it should not be a linear scale but a logarithmic scale because the final refinements might be harder to do than the initial ones.
Image to text model with successive refinements:
For example, given the image above, the "first" layer of the network outputs: "city", the second one outputs "city with vegetation", the third one "view of a city with vegetation from a balcony", the fourth one "view of a city with skyscrapers on the background and with vegetation from a balcony".
This could be done by starting with a blank description and repeating many times a "detailer" network that should add details to a description given an image.
This should help interpret-ability and t...
A very simple task, like MNIST or CIFAR classification, but the final score is:
where "" is a normalization factor that is chosen to make the tradeoff as interesting as possible. This should be correlated to AI safety as a small and/or very sparse model is much more interpretable and thus safer than a large/dense one. You can work on this for a very long, time, trying simple fully connected neural nets, CNNs, resnets, transformers, autoencoders of any kind and so on. If the task looks too easy you might...
Extremely cool evolution experiment where E. coli bacteria evolve to eat citrate along with many other interesting happenings.
I am not really sure about that. There is not only a huge money cost but also a huge energy cost when sending something into orbit, would the panels even make back the fuel spent to send them? Even if the rocket hardware is reused 100% with no serious maintenance costs (reusing costs more fuel) would the panel even make back that fuel energy alone? I did not do the math but maybe not even that. If we could put them in orbit with a space elevator almost for free the tune would be way different though.
SpaceX's Falcon 9 now advertises a cost of $62 million to launch 22,800 kg to LEO, $2,720/kg. https://ttu-ir.tdl.org/bitstream/handle/2346/74082/ICES_2018_81.pdf
Given an average solar silicon price of around $9 US per kilogram in 2020 https://www.solarquotes.com.au/blog/solar-silicon-price-hike/#:~:text=Compared%20to%20the%20average%20solar,%2434%20Australian%20dollars%20per%20panel.
This would increase costs 2720 / 9 = 302 times.
The cost of a solar electric system is measured in dollars per watt. The average cost for a residential system is cur...
Thanks for your feedback, in fact correlation is not causation and we must be very careful about self-selection effects. This is not a self-selection effect but still a correlation/causation enigma that I found interesting in recent times: high vitamin D levels were found to be heavily anticorrelated with severe COVID in observational studies, but people of old age are both sensible to severe COVID and have lower vitamin D than average, not only that but people with a healthy lifestyle of many outdoor walks also have higher vitamin D! Is this causation, co...
Hi, I wrote the Book-Review on Spark as my first post on LessWrong. Sadly I received no comments in response to it and I would love some feedback after spending so much time writing it. I am open to any kind of feedback about it. I really enjoyed this bounty program and I will probably partecipate also in the future ones.
Given the extreme infectiousness of the Delta strain it is reasonable to assume that everyone will come into contact with it (either with or without illness if the vaccine works properly). If so, if you are already 14+ days from double vaccination, the timing of coming into contact with it now or in three months time is almost irrelevant (if there is space in the hospitals, otherwise it is in fact reasonable to exercise outside a month or two).
Fascinating article, two things:
Are you sure? That looks really cold. My thermodynamics book said 26 C is the best temperature for confort for humans.
2. What about install sound absorbing panels on the walls for sound insulation? Sounds more confortable then earplugs and work both ways, so you can be noisy without giving trouble to the neightbours
Incredibly fascinating, I am opposite, only internal verbal monologue, no images at all. I can build step by step an image from simple lines and circles in my mind, but it is a conscious effort, (i.e. I am not really seeing it, if you get what I mean, as soon as I focus on a detail the rest vanishes). Basing on your anecdotal evidence I could maybe learn to imagine images that I am not really seeing with my eyes in that moment but it feels like the opposite of what my mind "is built" to do.
I am quite young, I am in fact in university studying artificial intelligence and this website did play a bit of a role in me choosing this field of study (I was already quite drawn to it before). I think this site has a too extremist view of AI risk, but it is important to read opinions different from mine. This site is mostly quite interesting if not at the level astral codex 10.
Did you use ghost gradients? (gradients that tend to reactivate features that are at zero)