mtaran

Comments

Toy Problem: Detective Story Alignment

The problem definition talks about clusters in the space of books, but to me it’s cleaner to look at regions of token-space, and token-sequences as trajectories through that space.

GPT is a generative model, so it can provide a probability distribution over the next token given some previous tokens. I assume that the basic model of a cluster can also provide a probability distribution over the next token.

With these two distribution generators in hand, you could generate books by multiplying the two distributions when generating each new token. This will bias the story towards the desired cluster, while still letting GPT guide the overall dynamic. Some hyperparameter tuning for weighting these two contributions will be necessary.

You could then fine-tune GPT using the generated books to break the dependency on the original model.

Seems like a fun project to try, with GPT-3, though probably even GPT-2 would give some interesting results.

[Link] Reddit, help me find some peace I'm dying young

Ok, I misread one of gwern's replies. My original intent was to extract money from the fact that gwern gave (from my vantage point) too high a probability of this being a scam.

Under my original version of the terms, if his P(scam) was .1:

  • he would expect to get $1000 .1 of the time
  • he would expect to lose $100 .9 of the time
  • yielding an expected value of $10

Under my original version of the terms, if his P(scam) was .05:

  • he would expect to get $1000 .05 of the time
  • he would expect to lose $100 .95 of the time
  • yielding an expected value of -$45

In the second case, he would of course not want to take that bet. I'd thus like to amend my suggested conditions to have gwern only put $52 at stake against my $1000. For any P(scam) > .05 this is a positive expected value, so I would expect it to have been satisfactory to gwern[19 August 2012 01:53:58AM].

[Link] Reddit, help me find some peace I'm dying young

Well I still accept, since now it's a much better deal for me!

[Link] Reddit, help me find some peace I'm dying young

Done. $100 from you vs $1000 from me. If you lose, you donate it to her fund. If I lose, I can send you the money or do with it what you wish.

[Link] Reddit, help me find some peace I'm dying young

There are a lot of things I'd like to say, but you have put forth a prediction

It's probably a scam

I would like to take up a bet with you on this ending up being a scam. This can be arbitrated by some prominent member of CI, Alcor, or Rudi Hoffman. I would win if an arbiter decides that the person who posted on Reddit was in fact diagnosed with cancer essentially as stated in her Reddit posts, and is in fact gathering money for a her own cryonics arrangements. If none of the proposed arbiters can vouch for the above within one month (through September 18), then you will win the bet.

What odds would you like on this, and what's the maximum amount of money you'd put on the line?

[Link] Reddit, help me find some peace I'm dying young

I have donated $1000, and I really do believe that our community can get her fully funded. I understand how CI has to be cautious about these sorts of things, but I've seen enough evidence to be more than convinced.

What's the best way to rest?

I understand getting enough sleep, but what for example is your version of "eating right"?

Harry Potter and the Methods of Rationality discussion thread, part 14, chapter 82

HP:MoR 82

The two of them did not speak for a time, looking at each other; as though all they had to speak could be said only by stares, and not said in any other way.

Wizard People, Dear Readers

He gives up on using his words and tries to communicate with only his eyes. Oh, how they bulge and struggle to convey unthinkable meaning!

Was there any inspiration?

Presents for impoving rationality or reducing superstition?

Thanks a lot for the suggestion. We already own the game and really enjoy playing it :)

Auckland meetup, Thrusday May 26th

I'll be attending, since it just so happens I'm in this corner of the world right now :)

Load More