But A is a common feature of almost all self-help camps - googling "Christian retreat testimonial" can be very enlightening (add the phrase 'changed my life' to the query for best results). I think most rationalists would be very skeptical of most of the camps that manage to get such glowing reviews from their participants. So P(B|A) - the probability that data shows a real long-term effect given that everyone loved it and is wildly enthusiastic - may not be much higher than P(B).
I suspect that even Christian retreats do cause B. Just being around people with high expectations of you will cause you to rise to the challenge. This is important since simply measuring B won't tell us whether the camp succeeded.
Yep, I'm saying that without hard data. But I was there. So let me say it again, in response to numerous comments I've seen complaining that no judgement should be passed until a quantitative analysis confirms it:
Mini-camp was awesome. Note that mini-camp was far from the first time I've travelled to an event to surround myself with like-minded peers working toward common goals... I find such events events extremely motivating and enjoyable, which is why I've been to many such workshops, inside and outside academia (~3 per year for the past 10 years).
Yet mini-camp is still topping my charts. Specifically, the camp is tied for the title of the most life-altering workshop-like event of my life, and the tie is with the workshop that got me onto my PhD topic (graphical causal modelling), so that's saying something.
In particular, I've been visibly-to-myself-and-others more motivated and hard-working since the camp. I've had more energy for learning and adaptation, and I find Luke to have been a highly inspiring input to that result.
(I'm talking about Luke because his position is the one being discussed right now, but I got a lot of really inspiring ideas and motivation from Anna before, during, and after the camp as well.)
Hard data will be great to have, but it's hard to get, especially certifiably causal data (though the prospect is not hopeless, with enough conditional independence tests), especially since the camp was planned and executed on short notice.
In the meantime, let's do a little Bayes. First, assign priors to how well you expect a week-long sustained interaction between growth-oriented rationalists to go. (If your prior is something like 80%[failure], I'd like to know where you're getting your growth-oriented rationalists). Now which of the following theories, "failure" or "success", assigns a higher likelihood to the following observations?
-----
1. People wrote these:
https://docs.google.com/spreadsheet/pub?key=0AnoM_ZsIBBwEdGNicUMzRkNJNzRKLVpEb2RxZzU3V0E
In particular,
2. I wrote this post.
3. Eliezer wants to keep Luke as a permanent hire.
4. Whatever other comments you've seen/heard about the camp from people who attended.
-----
Is this a biased sample? Probably. Is it hard data? Easy to quantify? Not so much. Might this be a big conspiracy by Luke-originating ninja bloggers? Perhaps. But really... which theory assigns the higher likelihood here? Success, or failure?
Lets allow the arguments that can be made about the minicamp be made, rather than ritualistically abstaining from decision-making until numbers show up.
That, and I really hope Luke stays with SingInst :)