LessWrong is providing feedback and proofreading on drafts as a service

This seems like a really great initiative, I'm excited to see how it goes.

How high a bar should I set for using this service? I have basically no posts where I'd post this with editing help but would not post it on my own, but would generally appreciate editing help on basically every post I make.

[-]Ruby4y231

You should feel free to request it on every post you make! I think that if we make it cheaper to write more and/or better posts, people will. And that's the goal: more and better posts via making it easier and more rewarding.

Maybe I'm wrong and editing won't result in more or better posts, but I would be surprised.

[-]Yoav Ravid4y271

Wow!

I remember we had a few conversation about this problem and a few solutions came up, some of them fairly complex. But this just nukes the problem (in a good way). I love it. Now I want to write a post just to try the feature... :)

Anyway, I'm very curious to see how this works out, and how it will affect the posts that are published from now on. And I hope you'll manage the load.

And speaking of managing the load, I'd love to volunteer if I can be of help. I'll send a message on intercom.

btw there's a typo: "The LessWrong team can get things back to you within a day or two", the "to" is missing.

[-]Ruby4y50

btw there's a typo: "The LessWrong team can get things back to you within a day or two", the "to" is missing.

Oops, how embarrassing!

[-]noggin-scratcher4y30

There's also

unless your posts are like the best, in which caes we’ll get you all the feedback you desire

[-]Ruby4y60

Thanks!

I thought I'd caught that one. It's possible I failed to save at some point. :/

Auto-save is a feature I hope to introduce soon.

[-]supposedlyfun4y171

I asked for feedback on this post before publishing, and my reply to the feedback from LW staff was:

[T]hank you for the thoughtful responses. Your feedback was probably in the 95th percentile, re overall quality, of the feedback I've ever gotten on any of my writing in my schooling, professional life, or personal life.

[-]Ruby4y80

[-]Chris_Leong4y121

Wow, this is really cool! I'm very keen to give it a go.

But it also sounds like you guys will be taking on a lot of load. And I guess I wonder whether that will end up being worth it in the end or whether it would be better to focus on further developing the website instead. But I suppose experimenting is the only way to find out.

[-]Ruby4y151

If there's a lot of load, then this will have been a successful initiative and we'll be very happy!!

But also if there's a lot of load, we'll scale our capacity to meet it. That's something we're in a position to do, so I don't think it trades off against other website development.

[-]Crackatook4y100

Just like everyone here, I am very excited to see this new feature, which sounds like a powerful aid I may like a lot!

About the bar of 100 karma, I view it positively for newcomers. I am well below 100 right now, but I feel like to start accumulating karmas after reading this post. It is like, I can aim for goal--definite and doable-- and unlock something as if I am playing a video game. So far my experience with Lesswrong was slack--I often stopped reading sequences, writing a post sounded like a distant goal, and commenting was a few time event. This is why I say 100 karma is a definite goal. I can aim at one point.

Would you consider making such milestones on karma or something? It wouldn't be bad to add more :)

[-]Raemon4y80

At 2000 karma you get moderation privileges for your posts. :)

[-]lsusr4y40

Your voting power increases with karma.

[-]Alex Flint4y82

Thank you for doing this. I just requested a proofread on a draft I'm working on.

When I first clicked "Get Feedback" it didn't do anything. I think this was because I had "Hide Intercom" turned on in my settings. When that setting was on, I saw the following error in my console:

PostSubmit.tsx:93 Uncaught TypeError: window.Intercom is not a function
    at onClick (PostSubmit.tsx:93)
    at Object.ein (react-dom.production.min.js:14)
    at rin (react-dom.production.min.js:14)
    at nin (react-dom.production.min.js:14)
    at cgt (react-dom.production.min.js:15)
    at min (react-dom.production.min.js:52)
    at GAe (react-dom.production.min.js:51)
    at ooe (react-dom.production.min.js:52)
    at Jgt (react-dom.production.min.js:56)
    at ygt (react-dom.production.min.js:287)
    at bgt (react-dom.production.min.js:19)
    at ZAe (react-dom.production.min.js:70)
    at loe (react-dom.production.min.js:69)
    at fc.unstable_runWithPriority (scheduler.production.min.js:19)
    at wM (react-dom.production.min.js:122)
    at vgt (react-dom.production.min.js:287)
    at Cin (react-dom.production.min.js:68)
    at HTMLDocument.n (helpers.ts:87)

When I turned off "Hide Intercom", the "Get Feedback" button worked and I requested feedback.

[-]Ruby4y30

Good catch! I'll have to add something about this to the announcement and UI.

[-]localdeity4y10

FYI, I hit this too. I pressed "Get feedback" on a draft post; it reloaded the page and otherwise didn't tell me much. I figured, "Ok, either that worked or it didn't. If it did, then I figure someone will come by soonish, read the post, and message me about it." I checked for Less Wrong notifications and emails, and a few days later decided it probably hadn't worked. I'd searched the website a couple of times about the feedback process (skimming the results), and only now do I learn that it's supposed to happen through Intercom and wouldn't work if Intercom is disabled.

I think it would help significantly to have the webpage check for Intercom and, if it's disabled, to at least display a warning near the "Get feedback" button (ideally also make the button not work, and make it display the warning when someone clicks it).

[-]Ruby4y30

Sorry about this!

Yes, are totally able to check for Intercom and issue a warning if it's disabled. Added to our to-do list.

[-]Alexander4y*70

This is super cool! I cannot wait to give this a go on my next post. Having access to a high-quality feedback loop is such a powerful way to improve our writing and hence our thinking.

Assuming this results in better quality posts being created on LessWrong, I, therefore, wonder if it means more posts will be promoted to Frontpage as a result or if the Frontpage promotion will be made more stringent.

[The rest of this comment is off-topic, feel free to ignore it.]

I also wonder how this feature will scale as LessWrong continues to grow.

More broadly, I've been thinking about the scalability of the LessWrong model ever since I read the book The Constitution of Knowledge by Jonathan Rauch. I am very impressed with LessWrong as a platform, not only in terms of the integrity of discussions but also in terms of the software quality and moderation. I emailed Jonathan Rauch and brought LessWrong to his attention. He dedicates a significant portion of the book to product designs that incentivise civil and explanatory discussions and the graceful collision of ideas without siloing users into bubbles.

Imagine if LessWrong had 2.89 billion monthly active users (which is Facebook's MAO), could it handle that scale with its current product design and governance model? If not, what changes and innovations would be needed? My understanding is that Facebook is hiring a lot of human moderators to deal with misinformation and disinformation. I wonder when AI will be sufficiently intelligent to help with things like moderation and proofreading effectively.

[-]__nobody4y60

Once things have stabilized and things like inline annotations are there, I'd love to see the following: (1) An easy way to add and remove yourself from a pool of available feedback providers. (Checkbox in settings?) And (2) a way for anyone (or nearly anyone - e.g. non-negative karma) to request brief / "basic feedback" on their posts, by automatically matching people from the pool to posts based on e.g. post tags and front page tag weights.

On (1): I have proofread a couple thousand pages by now, and while I'm usually pretty busy, in a slow week I'd be happy to proof-read a bunch of drafts. However, if that involves messaging someone to be added to a list and then messaging someone again to be taken off that list, that's quite a lot of overhead - I probably wouldn't bother and just look for other stuff to do. So I suspect automating that part might greatly increase the amount of available reviewers for feedback.

On (2): With some extra capacity from (1), I expect the main bottleneck for providing more reviews is matching reviewers to posts. If that's automated, the only cost is the time spent reviewing. With a scheme like "review two/three posts to get one post reviewed by two/three people", the reviewer pool should be even bigger (so with (1) you might even go "review 2 to get 3") and things should remain relatively fair. With multiple reviews, you should get some decent feedback even if one reviewer writes complete nonsense or doesn't understand anything.

At that point, the human overhead for having this extra "basic feedback" system should be near-zero, apart from from maybe having to manually filter people trying to abuse the system - no clue how prevalent that is. And looking at myself, (a) I probably wouldn't bother manually asking others for reviews, and (b) knowing that I can get guaranteed feedback, no questions asked, would make it more likely to actually start writing. (While I can't say for sure whether that translates into actual posts, I can clearly see that there are lots of other "very important" things, some of which only barely win out because they're less headache-inducing / uncertain.)

[-]Ruby4y60

I plan to attempt making inline annotations happen soon.

The rest of what you describe sounds very cool. Maybe! If there's the demand and supply for it, we could probably build it.

[-]Alex_Altair3y40

FYI the screenshots here say "Request feedback" but the actual button currently says "Get feedback". Might trip someone up if they're trying to search for the text.

[-]Ruby3y20

Thanks!

[-]Aay17ush4y40

Love this initiative! I do have a question though. It seems that people with 100+ karma have most likely figured out how to write publicly with a decent quality. So this service would simply be a bonus for them.

Isn't it more important to enable this service for lurkers/readers on Lesswrong who haven't yet written many posts due to the reasons you've mentioned?

Disclaimer: I don't have 100+ karma and haven't written a lot outside as well - just privately in my note taking app.

[-]lsusr4y300

It's easy to get >100 karma from comments alone, without any top-level posts.

[-]Kaj_Sotala4y70

Case in point: right now your one-sentence comment has 27 karma, over one fourth of the needed amount.

[-]Dojan4y60

Example of one: I have ~200 from comments alone, and I only very rarely comment. I've been on LW for a long time though.

[-]Yoav Ravid4y290

No I don't think it's a good assumption that most people past a 100 karma have figured out how to write publicly with decent quality (though, depends on what you consider decent).

I'm well past a 100 and I expect this to be very useful to me when I write posts.

And if we're talking in general then even the best writers usually have proofreaders/beta-readers (take Paul graham for example, every essay he releases credits at least a few beta readers)

I do agree it might be especially important to new people that don't have karma, though. It'll be interesting to hear more from the team why they decided on that specific limit. My guess, though, is that they want to mostly review posts that are going to be good posts, and don't want to get spammed with low quality requests. And the 100+ karma filter does that pretty nicely.

One middleground I can think of is you can get a limited number of posts reviewed under 100 karma (even just 1), and at 100 that limit just goes away.

[-]Ben Pace4y200

I have more than 100 karma and still get a lot of value out of feedback on posts.

[-]lsusr4y60

Another advantage of the 100 karma minimum is it's an easy way to select for people who are members of the community. The point of this offer is to strengthen the community, after all.

[-]Yoav Ravid4y50

True, though growing the community can also be part of strengthening it.

[-]gwillen4y250

I have over 2000 karma ~all from comments, and fear of not meeting the quality bar has definitely contributed to my lack of posts. (Two in ten years, and one of them was meta about the site itself.) So I am hoping I will find it in me to try using this and see how it goes!

[-]Gunnar_Zarncke4y170

Anecdata: I haven't figured out writing with decent quality or audience awareness and have been burnt multiple times. I get a cold sweat each time. It just doesn't keep me from posting. But I can totally relate to it, love the solution, and will definitely use it.

[-]Ruby4y150

To answer people's questions about the 100+ karma limit:

As lsusr notes, 100 karma isn't that much and can easily be obtained be obtained by commenting. I think that's a very reasonable bar to ask of people before offering this service. While I do think we can build the capacity to handle a lot of requests, I expect that without the karma bar, we'd get a lot of requests from people who hadn't yet invested much in the site (or in their draft), simply because those are the most numerous. At least to begin with, I want to reserve the service for more dedicated users (and again, 100 karma doesn't take that much).

As per the FAQ, users with less than 100 karma are free to request the service via Intercom and we might offer the service I expect to look over any draft that anyone submits and provide some level of feedback; more if seems like it'll result in a decent post.

Separately from this initiative, I'm thinking about schemes to create more strong writers such as writing fellowships and writing guides (lsusr's recent post about how to write well stemmed from a conversation we had about the topic).

[-]Elizabeth4y140

Editing can improve quality, or it can keep quality constant while reducing writing time, which is also pretty valuable.

[-]Chris_Leong4y50

Maybe they are trying to focus on improving the writing of people who are most likely to continue contributing to the forum in the future?

[-]cousin_it4y30

Yeah, I was also wondering about the minimum requirement. It seems feedback would be most useful to people writing their first posts, and there's no limitation on making a first post, is there? In the AI Alignment Prize I tried to write feedback to everyone and it ended up being a very valuable experience, both for the participants and for me.

[-]Dojan4y30

This is an amazing initiative! Even aside from providing an excellent service, and also lowering the bar for those of us who feel less than confident writers, I also think it will help center the community around Lesswrong.

I am by no means a professional-level proof reader, but I might still find some errors here and there. I would be really excited to provide what help I can, as long as I don't feel like I'm the only one looking and all the expectations (and thus obligations) are on me. Is there a way for me to be one-among-several proofreaders? If crowd-sourcing isn't the model you are going with for now, then I fully understand.

[-]Ruby4y20

Several people have volunteered already. I'll possibly set up some kind of system that lets people volunteer to take on pending requests. So if/when that gets set up, I could add you to it. It definitely wouldn't be all on you.

[-]antanaclasis4y20

The part about hiring proofreading brought a question to mind: where does the operating budget for the lesswrong website come from, both for stuff like that and standard server costs?

[-]Ruby4y90

Our most recent round of funding was from OpenPhilanthropy and the Survival & Flourishing Fund.

[-]tailcalled4y20

I'm trying to get started on making a rationalist blog (here), and I've posted this to LessWrong before. I have several half-finished drafts for the blog; if I ever finish up those drafts, would it be bad form to ask about feedback from LessWrong, since it's not strictly speaking part of LessWrong? Or would it be fine, since I'm planning on posting it to LessWrong and partly (though not wholly) have a rationalist audience in mind?

[-]Ruby4y80

If you're [cross]posting on LessWrong, I think it's totally fine to ask for feedback here.

[-]Yoav Ravid4y70

This is one of the things that makes this so awesome. As long as you cross-post to LessWrong and you have 100+ karma, you get access to free proofreading for your blogposts (And hopefully everyone gets to read more and better posts as a result).

[-]ESRogs4y70

If you're going to cross-post the posts to LessWrong, what makes them not part of LessWrong?

[-]MichaelA3y10

Cool!

Two questions:

Is it possible to also get something re-formatted via this service? (E.g., porting a Google Doc with many footnotes and tables to LessWrong or the EA Forum.)
Is it possible to get feedback, proofreading, etc. via this service for things that won't be posts?
- E.g. mildly infohazardous research outputs that will just be shared in the relevant research & policy community but not made public

(Disclaimer: I only skimmed this post, having landed here from Habryka's comment on It could be useful if someone ran a copyediting service. Apologies if these questions are answered already in the post.)

[-]Ruby3y30

Yes.
You're welcome to ask!

[-]Yitz4y10

I often write on my phone (via Safari on IOS), and I notice when I press the “request feedback” button, nothing seems to happen. I’m not sure if you’re receiving anything on your end. So far what I’ve done is just submit it anyway, since until coming across this post I wasn’t sure what the button was supposed to do exactly.

[-]Ruby4y30

Pressing the button should pop up an Intercom chat window and submit your draft to us. I never tested this on mobile since so few people compose posts there – sorry! If you press the button on desktop, you'll see the correct behavior.

[-]Yitz4y10

Tried it again as a test, just to confirm I that wasn’t a one-time thing; it seems to simply save my draft instead—you might want to remove the button on mobile for now, at least until that’s fixed. I’ll test it out on my Mac later today, and will comment below if it doesn’t work there either (though I expect it will :))

[-]Vanilla_cabs4y10

I'm trying to get a post reviewed for feedback, however the feature does not seem to be working on my Firefox. When I click the "Get feedback" button, it acts as if I had clicked the "Save as draft" button.

[-]Ruby4y20

Sorry about that! Do you see the Intercom button in the bottom right? You can use that to reach us directly.

[-]Yoav Ravid4y20

I also found it slightly confusing at first. I think it would be better if it sent you to a dedicated page.

[-]Vanilla_cabs4y10

I didn't first, but then I just found the cause of the problem. Silly me. The window was zoomed in too much.

LESSWRONG
LW

LESSWRONG
LW

295

LessWrong is providing feedback and proofreading on drafts as a service

295

295

TL;DR

The Problem

Solution

Getting Started

Quotes (fictional)

FAQ

Who will provide the feedback?

How quickly will I get the feedback?

How much does this cost?

How many times can I use it?

What format will the feedback be in?

Can I volunteer to provide feedback?

Can I ask for different feedback if I don’t like the initial feedback I get?

I don’t have 100+ karma but would really like feedback.

I have a different question.