Comment author: negamuhia 11 April 2014 06:16:53AM 0 points [-]

I'm hand-typing the code from the pdf. I know it would be easier if I used the .lhs file from github, but I'd like to make sure I read and understand the code first. Reading the .lhs file hurts my eyes due to formatting issues in Emacs.

Comment author: sixes_and_sevens 01 February 2013 11:47:29AM 6 points [-]

Of interest for the data science angle. Also it includes the word "bayesian" and links to Paul Graham. That's got to make it more or less on-topic, right?

I recently took this collection of text messages (from Hilary Mason's collection of research-quality data sets ), and attempted to build a simple Bayesian spam filter for text messages.

This was mostly just a fun exercise. I wasn't expecting to produce a usable product (and I didn't), but as an exercise it was pretty informative and well worth my time. I've put some observations in rot13, as anyone else undertaking this exercise may benefit from observing them by themselves.

Vg'f n irel tbbq qrzbafgengvba bs cbjre nanylfvf pbaprcgf, naq gur genqr-bss orgjrra frafvgvivgl naq fcrpvsvpvgl. Jura znxvat gjrnxf gb gur pynffvsvre, vg ernyyl unzzref ubzr gur vqrn gung ryvzvangvat glcr-V reebef pneevrf gur pbfg bs zber glcr-VV reebef.

Gur birenyy zrgubq (anvir onlrf pynffvsvpngvba) frrzf gb or fvtavsvpnagyl yrff hfrshy sbe grkg zrffntrf guna sbe rznvy zrffntrf. Gurer ner n ahzore bs boivbhf ernfbaf sbe guvf, naq n srj yrff boivbhf barf. Grkg zrffntrf ner n ybg fubegre guna rznvyf (hfhnyyl yrff guna 140 punenpgref, juvyr rznvyf jvyy abeznyyl unir ng yrnfg 140 punenpgref bs urnqre zrgnqngn orsber lbh rira trg bagb gur obql grkg). Nyfb, yrtvgvzngr grkg zrffntrf frrz gb pbagnva n ybg zber "fcnzzl" pbagrag guna rznvyf. Gur zrffntrf va zl grfg unz pbechf gung synttrq nf fcnz nyy ybbxrq ernyyl fcnzzl. Gur zbfg ragregnvavat qvfpbirel jnf gung gur gbxra "kkk" ybbxrq zber yrtvg guna fcnzzl orpnhfr fb znal crbcyr fvta bss gurve grkgf jvgu gung.

Zl vaghvgvbaf nobhg ubj cebonovyvgvrf hcqngr tvira bgure cebonovyvgvrf vf nyy jebat.

If anyone else tries this, let me know how you get on.

Comment author: negamuhia 02 February 2013 02:27:33PM 1 point [-]

This is great, thanks. I'll implement a rudimentary spam filter with this sometime next week.

Comment author: Metus 01 February 2013 09:54:10PM 0 points [-]

Well, try this: Show how general abstract nonsense could be relevant to a rationalist in his day to day life or in his general understanding of the world. Or try an introduction to general abstract nonsense that does not leave the reader with the feeling that it is, well, general abstract nonsense.

Comment author: negamuhia 02 February 2013 02:17:47PM 1 point [-]

I'm not sure about "day-to-day life", but this application of general abstract nonsense certainly did make my day better when I read it: link

Comment author: RobertLumley 02 February 2013 01:34:50AM 0 points [-]

Nonfiction Books Thread

Comment author: negamuhia 02 February 2013 12:48:05PM 4 points [-]

Language in Thought and Action, by S. I. Hayakawa. It goes without saying that this book is highly recommended. To those who've read the sequences, and have therefore had just a bite of the hearty meal, you should really get it. An anecdote about how I came to find this gem: My grandfather is a retired linguist, and in his library, in a house I grew up in, he keeps, and still has, a gigantic collection of books. A member of that distinguished class of "books older than me", this book is a part of his linguistics collection, and I didn't even know he had it until a few weeks ago when I was having a conversation with my uncle in said library. The title jumped out at me, and I haven't been this happy about finding a book in that room since I found my mother reading Kahneman.

Comment author: RobertLumley 02 February 2013 01:35:21AM 0 points [-]

Music Thread

Comment author: negamuhia 02 February 2013 12:18:58PM 0 points [-]

Chillstep : I've found this online collection to be quite relaxing, as the genre name suggests.

The Art Of Noise - The Seduction of Claude Debussy : I hadn't listened to any music by this super-group before this year, and now they're one of my favourite groups...I'm either fickle or these guys are awesome, and I'm not fickle. There's one song I liked in particular, Metaforce, and its remixes. It'll show you just how versatile this group is, with the rest of the album as a backdrop.

Comment author: [deleted] 01 January 2013 04:37:25PM 5 points [-]

I concur with dbaupp's suggestion.

Additionally, you can try the reframing technique. Anna describes it here:

When facing a difficult decision, I try to reframe it in a way that will reduce, or at least switch around, the biases that might be influencing it. (Recent example from Anna's brother: Trying to decide whether to move to Silicon Valley and look for a higher-paying programming job, he tried a reframe to avoid the status quo bias: If he was living in Silicon Valley already, would he accept a $70K pay cut to move to Santa Barbara with his college friends? (Answer: No.))

The example she gives isn't quite isomorphic to the choice you're making, but I think the technique still may be worth trying. Imagine you're currently living out one option but given the chance to take the other - how would you feel about it? And vice versa.

In response to comment by [deleted] on Open Thread, January 1-15, 2013
Comment author: negamuhia 03 January 2013 09:31:21AM 0 points [-]

Likewise, thank you for your suggestion.

Comment author: dbaupp 01 January 2013 02:56:29PM 9 points [-]

I don't have anything specific to offer, but (in theory) hard choices matter less. And if you literally can't decide between them, you can try flipping a coin to make the decision and as it is in the air, see which way you hope it will end up, and that should be your choice.

Comment author: negamuhia 03 January 2013 09:30:08AM *  0 points [-]

Sorry for the delayed reply.

Comment author: negamuhia 01 January 2013 02:15:04PM *  7 points [-]

Happy New Year, LWers, I'm on a 5 month vacation from uni, and don't have a job. Also, my computer was stolen in October, cutting short my progress in self-education.

Given all this free time I have now, which of these 2 options is better?

  • Buy a road bicycle & start a possibly physically risky job as a freelance bike-messenger within my city ( I'm that one guy from Nairobi )in order to get out of the house more, then buy a laptop and continue my self-education in programming, computer science, philosophy, etc.

or

  • buy a laptop, do quick and easy wordpress websites for local businesses, then buy the bike and use it for leisurely riding under no pressure? I only have money for either one or the other for now, and for some reason I'm hesitating. Maybe it's because I want to do both. This is important to me, and I'll appreciate any discussion on this. Thanks.
Comment author: negamuhia 03 January 2013 09:26:38AM *  1 point [-]

dbaupp, ParagonProtege, thank you both for the links and suggestions. I'm going with the laptop. Anything else I could do (naturally, there's a lot i want to do) will be kickstarted by the modest, but easy(ish) money I'll get by doing ~$100 websites, as I upgrade my code-fu for Other Stuff. ;)

I also haven't cycled actively for years & I'm afraid my unfit body might conk out on me, making me unable to Do The Job once I commit. Cliff scaling is much harder than hill climbing.

From Alicorn's post , I can easily tell that after I get the laptop, the correct thing to have would be a bike, since I can ease myself back into cycling regularly. It's also weird how I saw the Other Option (buy bike, work, afford laptop, buy laptop, cut down on bike work as I increase study & laptop work hours) as just as good, even though I know I will feel like a flake if I stop riding after it gets tougher and more tiring, which is more likely than giving up on wordpress. Wordpress isn't even the only option for devastatingly easy Internet work.

Comment author: negamuhia 01 January 2013 02:15:04PM *  7 points [-]

Happy New Year, LWers, I'm on a 5 month vacation from uni, and don't have a job. Also, my computer was stolen in October, cutting short my progress in self-education.

Given all this free time I have now, which of these 2 options is better?

  • Buy a road bicycle & start a possibly physically risky job as a freelance bike-messenger within my city ( I'm that one guy from Nairobi )in order to get out of the house more, then buy a laptop and continue my self-education in programming, computer science, philosophy, etc.

or

  • buy a laptop, do quick and easy wordpress websites for local businesses, then buy the bike and use it for leisurely riding under no pressure? I only have money for either one or the other for now, and for some reason I'm hesitating. Maybe it's because I want to do both. This is important to me, and I'll appreciate any discussion on this. Thanks.
Comment author: negamuhia 11 December 2012 03:29:24PM 0 points [-]

This happens to me sometimes, and I sort of bring myself back to normality by reminding myself of the fact that the things my meat-brain chooses to bring to my attention are out of my control (for a short time) when I'm in panic mode. Other facts I recall: I have a reflectively-inconsistent meat brain, I was raised in a Christian home (I'm atheist now), and just about everything relevant that I can remember from Kahneman (correspondence bias etc.) and other psychology texts. Also, the Sequences.

Annoying aliefs are annoying.

A thing to do would be to condense all that gratitude into the word "awesome". Best said with a wide grin.

View more: Prev | Next