Update 3

We've just released our first draft of Inline Reacts. See this comment for more information. It's currently only enabled on this post, but if it seems to be working smoothly/intuitively we may roll it out for more posts.

Update 2

I've now enabled reacts by default on all new posts. I've updated that we need to get data more quickly, and at the current rate of new posts and comments, we probably wouldn't have a sample size to do interesting comparisons anyhow. 

I expect the team to focus on Reacts for the next week, then let them sit for a longer period with some tweaks, and then make a call about whether or not to keep them (and with what design).

Update

We're progressing the reacts experiments to now have reacts enabled on 50% of more posts (by default). We hope to get more data this way and figure out if the reacts should be part of the site longterm (and how to make them good).

If you do/don't like having them on your post, you can change this in the edit settings (see below).


LessWrong is experimenting with the addition of reacts to the site, as per the recent experimental Open Thread. We are now progressing to the next stage of the experiment: trying out reacts in actual discussion threads.

The dev/moderator team will be proactively looking for posts to enable to react voting on (with author permission), but also any user can enable it themselves to help us experiment:

  • When creating or editing a post, expand the "Options" section at the bottom and change the Voting system to Names-attached reactions

The admins will also be on the lookout for good posts to enable reacts on (with author permission).

Iterating on the react palette

We're continuing to think about what reacts should be available. Thanks to everyone who's weighed in so far.

I just spent time today and yesterday adding a range of new reacts and sorting them, with a focus on reacts that express LessWrong-style conversational moves. Hover-overs tooltips have a longer description that you can view on the live thing (reacts are enabled on this post).

We'll be tracking which ones get used, but please comment here with further feedback and requests. In other places, it'd be cool if people said things like "wish I could react with X" for various values of X.

 

Different palette views

Raemon made it so you can change how you view the palette. See the options at the top there:

The options are:

  • List
  • Mixed List and Grid
  • Grid of Icons (no text)
  • Grid with Names

Long-term I expect we'll have just one view, but we've made several available so people can give feedback on which they prefer.

Currently live reacts are getting tweaked and might shift slightly

Reacts are experimental! We're continuing to add new reacts but also edit and delete existing ones. This means that some reacts will be deprecated (and might disappear) and also that some will have their meaning tweaked. E.g. we might change the "Roll to disbelieve" react to just be "Skeptical", and things like that. So during this experimental phase, be warned that people might have clicked a react with a slightly adjacent meaning. We'll try to avoid doing this too much.

Reacts aren't ready for mobile yet

It's a large design challenge to make reacts work on mobile as well as desktop, so we'll do that if the experiment seems worth turning into a permanent site feature. Till then, you'll have the most luck with reacts on desktop.

New Comment
73 comments, sorted by Click to highlight new comments since:
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings
Pinned by Raemon

I have just shipped our first draft of Inline Reacts for comments.

You can mouse over a piece of text on a comment, and a little Add React button will appear off to the right.

If you click on it, you'll see the React palette, and you can then apply the react to that particular string of text. Once you've reacted, the reacted-snippet-of-text will appear with a dotted-underline while you're moused over the comment, and it's corresponding react-icon at the bottom of the comment will also show a dotted outline:

When you hoverover a react, it shows the inline-reacts in the hoverover, and they appear highlightd bright green on the post:

Possibilities for the future

Right now these are only enabled on this open thread. If they seem to be basically working we may give authors the option of using them.

Currently you can +1 individual inline reacts, but not -1 (it was unfortunately a lot gnarlier design-wise to implement anti-reacts for individual inline reacts). If inline reacts turn out to be useful/popular, and anti-reacting gets validated as useful, we'll likely figure out a way to implement that.

I'd like to make the dotted-line-sections highlight their corresponding react button when you hove... (read more)

Reply322111
2Max H
I inline-reacted to the first sentence of this comment. The comment takes up too much vertical space for the green highlighting to be visible when I hover over the react icon at the bottom though, so I have no way of seeing exactly what I reacted to while it is highlighted. Maybe hovering over underlined text should show the reaction?
2Raemon
Yeah something like seems obvious good. Meanwhile I just, uh, made my comment smaller so that it was less pronounced a problem for the immediate showcase comment. :P

Quick feedback,

  • The icons aren't all obviously interpretable to me
    • Not a crux — looks like a +, rec: ‘crux’ plus ‘🚫’
    • Please elaborate — unclear that it's a request, rec: ‘..?’
    • What's your prediction — rec: ‘
    • Examples, please — rec: ‘ex?’
    • Additional questions — rec: ‘??’
    • Obtuse — rec: remove
  • Some reactions seem tonally unpleasant:
    • Not what I meant — idea is good, but icon is accusatory
    • I already addressed this — icon is good, text could be ‘addressed elsewhere’
    • Muddled — maybe replace with ‘Unclear’?
    • Obtuse — maybe replace with ‘Too Long’?
    • Not worth getting into — feels like a meaner version of Not Planning to Respond
    • Note that I do like some critical reactions as-is, like Too Many Assumptions
  • There are too many to remember easily; perhaps
    • remove some partial redundancies, like Shrug + Seems Borderline?
    • add one-word summaries to the icon box, like [🕑 discussed 4]?
    • make it easier to see descriptions on mobile?
  • I think a top level grouping like this could make sense:
    • Positive ­— eg. Thanks, Important, Exciting, Clear
    • Critical — eg. Taboo, Harsh, Non Sequitur
    • Informational — eg. Will/Won't Reply Later, Agree to This, Shrug
  • There should be a Bikeshed emoji, for comments like this one
Reply17742111
8lionhearted (Sebastian Marshall)
I agree that drive-by unpleasant criticisms without substance ("Obtuse") don't seem productive, but I actually think some of the mild "tonally unpleasant" ones could be very valuable. It's a way for an author to inexpensively let a commenter know that they didn't appreciate the comment. "Not what I meant" seems particularly valuable for when someone mis-summarizes or inferences wrongly what was written, and "Not worth getting into" seems useful when someone who unproductively deep on a fine-grained detail of something more macro oriented.  One challenge, though, is when you have mixed agreement with someone. I disagree on tonal unpleasantness and the grouping style - "Taboo your words" might be friendly, for instance, to keep sharpening discussion, and isn't necessarily critical. But I agree with a meta/bikeshed and clearing up some of the ambiguous ones.  I clicked both "Disagree" and "Agree" on yours for partial agreement / mixed agreement, but that seems kind of unintuitive.
6Ruby
Perhaps helping with the mixed stuff, we might prototype "inline reacts" where you select text and your react only applies to that.
3Veedrac
Most of my comments on tone were meant to suggest better phrasings or, in the case of ‘Not what I meant’, iconography, not to suggest they were not valuable. The specific issue with ‘Not what I meant’ is that the icon reads as ‘you missed’ and not ‘we missed’. Communication is a two-way street and the default react should be at least neutral and non-accusatory. The section titles were meant very broadly and eg. you'd probably want to put both ‘Locally Valid’ and ‘Locally Invalid’ in that section next to each other even though the former is also Positive. To do some word association if it helps, * Positive — encouragement, endorsement, good vibes, congratulations * Critical — technical commentary, analysis, moderation, validity * Informational — personal actions, takes, directions, neutral but also to be clear, I'm not wedded to this, and there are no doubt many ways to split it. Partial agreement seems like a valuable icon to me!
4lionhearted (Sebastian Marshall)
Partially agreed again. I'd be hesitant to label as "Critical" pointing out that someone has an invalid argument, and having it implicitly contrasted against "Positive" — it implies they're opposites or antithetical in some way, y'know? Also, respectfully disagree with this -  Sometimes a commentor, especially someone new, is just badly off the mark. That's not a two-way street problem, it's a Well-Kept Garden problem...
3Veedrac
I think signalling to someone that they've missed my intended point is most valuable if they are the kind of person to take it constructively, and if they are, I have no wish to be pointing fingers any more accusatorially than the minimum amount to bring that into focus. I think a neutral reaction is still a plenty adequate signal in the case you mention and I value that it might do less social harm, whereas a harsher reaction is at least for me less universal as I will be disinclined to use it in prosocial interactions. Yes but the choice of word used to describe the category is not a crux. As I was imagining the interface in my head, the sections were not titled at all, and if they were titled I don't think I'd care about the choice.
2Ruby
Use case I was imagining is in a conversation, someone attempting to summarize the other.
8Nathan Helm-Burger
I have some concern on enabling an easy-to-use feature that lazily encourages antisocial behavior, which could, if all the users of it were carefully being pro-social in their use of it, have a good use. Like... we want to keep some friction on antisocial behaviors since those can easily downward-spiral. For some things, it's better to just have the person have to write it out, which also inherently makes it easier for them to add more nuance to what they are saying and why.
6Elizabeth
I want a bikeshed emoji so bad and if we had line-level reacts I wouldn't have had to write this comment
4Nathan Young
yeah but it would need to look right, maybe we need a 150 person commitee and $10,000 to figure out the right one
3dr_s
Yeah, honestly all these pictograms become confusing. Also I am liable to use Elephant not because I have more questions, but as a sign of approval. That was nice, here, have an elephant!
2Ruby
But have you considered "that was nice, here, have a paperclip!"
2Ruby
I agree. See my response to Razied that I think they might have value, and it's interesting to see how they get used in practice. I think there's a world where people abuse them to be mean, and a world where they're used more judiciously. The ability to downvote reacts should also help here, I hope.   I was imagining something like that too. :laugh-react:

Most of the reactions are either positive of negative, but if a comment has several reactions, I find it difficult to see immediately which are positive and which are negative. I’m not sure if this is a disadvantage, because it is slightly harder to get peoples overall valuation of the comment, or if it actually an advantage because you can’t get the pleasure/pain of learning the overall reaction to your comment without first learning the specific reasons for it.

Another issue, if we (as readers of the reactions) tend to group reaction into positive and neg... (read more)

4Ben
I think that the situation of someone spamming all the "bad" reactions on a post they don't like is the upvote system that already exists. If a post has a fair amount of karma and then copy of 10 different negative reacts might not mean much.
2Kenoubi
The obvious way to quickly and intuitively illustrate whether reactions are positive or negative would seem to be color; another option would be grouping them horizontally or vertically with some kind of separator. The obvious way to quickly and intuitively make it visible which reactions were had by more readers would seem to be showing a copy of the same icon for each person who reacted a certain way, not a number next to the icon. I make no claim that either of these changes would be improvements overall. Clearly the second would require a way to handle large numbers of reactions to the same comment. The icons could get larger or smaller depending on number of that reaction, but small icons would get hard to recognize. Falling back to numbers isn't great either, since it's exactly in the cases where that fallback would happen that the number of a particular reaction has become overwhelmingly high. I think it matters that there are a lot of different reactions possible compared to, say, Facebook, and at the same time, unlike many systems with lots of different reactions, they aren't (standard Unicode) emoji, so you don't get to just transfer existing knowledge of what they mean. And they have important semantic (rather than just emotive) content, so it actually matters if one can quickly tell what they mean. And they partially but not totally overlap with karma and agreement karma; it seems a bit inelegant and crowded to have both, but there are benefits that are hard to achieve with only one. It's a difficult problem.
2Raemon
Note, your original phrasing said "it counts if you have to opt into the karma types", and react types are optional. 
3Nicholas / Heather Kross
I acknowledge this is phrased kinda weirdly. I would say this fits the spirit of the question (albeit as a noncentral example), plus "opting-into reacts as a whole" is required on a by-post basis.
4Raemon
Coolio, if you knew what you meant, sure. (some commentary on my experience reacting to this – if this had been slack/discord, I'd have wanted to emoji-react with a thumbsup to this, intended to imply "cool, I get what you meant, and have seen this." Thumbs-up in this case doesn't necessarily mean "I agree" or any other specific thing, it's a sort of flexible symbol. I think it was sort of deliberate that we don't have a thumbs-up react here on LW yet, and I'm not sure how I feel about that. I think on one hand, we already have upvotes, and multiple other reacts that mean specific shades of "I agree", "I support", "I endorse", so maybe a generic thumbsup is more confusing than helpful. But, I did wish I had it here.
2Nicholas / Heather Kross
Yeah, I keep finding myself wishing that every other message/communication platform I use, would add Discord-style custom emotes for hyperspecific situations.
1dr_s
It's called an embedding.

Idea: we "highlight" or otherwise visually indicate reacts from the author of a post.

I turned this on for a recent post and I'm incredibly impressed. 

This is the coolest feature I've seen for discussion software in many years.

Highly recommended to try it out if you make a post.

Reply2221

I think 'please restate yourself using different terminology, taboo your key words because they have confusing overloaded meanings' is a good concept to have but that we really shouldn't represent it with a 'hush' symbol. That's more like a symbol that means 'be quiet, stop saying what you are saying'. What we mean is more like the 'recycle' symbol, please say the same thing but in a different way so that we can understand each other more clearly.

4Ruby
Oh yeah, recycle is maybe a good different symbol for it! Wasn't happy with it either.

I'm not sure about the reacts having such specific assigned meanings. It feels a bit like the James Scott perfectly legible straight lines thing (vs self-organizing meaning). Also they'd be more readable with color, even though that seems "less serious" somehow...

[-]Ruby100
color?? Face Screaming in Fear on Twitter Twemoji 14.0

Maybe some reacts, such as "Will reply later", should not support negative reacts.

Testing comment. Feel free to react to this however you like, I won’t intrepret the reactions as giving feedback to the comment.

Reply5555544333333332222222222222222222111
6Sune
Shouldn’t you get notification when there are reactions to your post? At least in the batched notification. The urgency/importance of reactions are somewhere between replies, where you get the notification immediately and karma changed, were the default is that it is batched.
2Raemon
oh no
1Kenoubi
I think this comment demonstrates that the list of reacts should wrap, not extend arbitrarily far to the right.
1Sune
Can you only react with -1 of a reaction if someone else has already reacted with the +1 version of the reaction?
2Ruby
Actually if you first +1 to apply it yourself, you can then hover and then downvote it. But it will only show up if you hover.
1mruwnik
But there is no way to downvote a reaction? E.g. if you add the paperclip reaction, then all I can do is bump it by one and/or later remove my reaction, but there is no way to influence your one? So reactions are strictly additive? 
2Raemon
Do you see the downvote button on the hoverover?
1mruwnik
Right - now I see it. I was testing it on the reactions of @Sune's comment, so it was hidden far away to the right. All in all, nice feature though.
2Raemon
Oh, lol that'd do it.

Hmm, some of these reacts seem kind of passive-aggressive to me, the "Not planning to respond" and "I already addressed this" in particular just close off conversational doors in a fairly rude way. How do you respond to someone saying "I already addressed this" to a long paragraph of yours in such a low-effort way? It's like texting "ok" to a long detailed message.

I sometimes literally have to say this in long threads. Sometimes in a thread of conversation, my interlocutor simple has too big an inferential gap for me to help them cross, and the kind but maybe not maximally nice thing to do is stop wasting both of our times. This happens for a variety of reasons, and being able to express something about it is useful.

In everyday conversation we have norms against this because they are status moves to shut down conversations, and taking such a move here does risk a status hit if others think you are making a gambit to give up a line of conversation that is proving you wrong, for example. But ultimately there's nothing in the reacts you can't just say with a comment.

6Elizabeth
What do you think is the right way to handle someone writing long paragraphs that ignore a point you made in the original post?
3Razied
Anyone writing an effortful response to the original post should be presumed to have good faith to some reasonable degree, and any point that you think they ignored was probably either misunderstood, or the relevance of the point is not obvious to the author of the comment. By responding in a harsh way to what might be a non-obvious misunderstanding, you're essentially adopting the conflict side of the "mistake vs conflict theory" side of things. Any comments which aren't effortful and are easily seen to have an answer in the original post will probably just be downvoted anyway, and the proper response from OP is to just not respond at all.  To be clear, I think that the community here is probably kind enough so that these aren't big problems, but it still kind of irks me to make it slightly easier to be unkind.
8Ruby
My feeling is this is optimistic. There are people who will fire off a lot of words without having read carefully, so the prior isn't that strong that there's good faith, and unfortunately, I don't think the downvote response is always clear enough to make it feel ok to an author to leave unresponded to. Especially if a comment is lengthy, not as many people will read and downvote it.
4Elizabeth
I agree that getting a low-effort emoji in response to a lot of good faith effort sucks. But I think that scenario is already pretty well handled with normal replies. There are enough cases that aren't handled well by replies, and might be really well handled by reacts, that I'm glad they're making them. But it's still important to track costs like the one you're bringing up. 
5lionhearted (Sebastian Marshall)
Not sure how many posts you've made here or elsewhere, but as someone who has done a lot of public writing this seems like a godsend. It will reflect poorly on someone who deploys those a lot in a passive aggressive way, but we've all seen threads that are exhausting to the original poster. This seems particularly useful for when someone makes a thoughtful but controversial point that spurs a lot of discussion. The ability to acknowledge you read someone's comment without deeply engaging with it is particularly useful in those cases.
5Ruby
I agree that some of these are a bit harsh or cold and can be used in a mean way. At first I was thinking to not include them, but I decided that since this is an experiment, I'd include them and see how they get used in practice. "Not planning to respond" was requested by Wei Dai among others because he disliked when people just left conversations.  "I already addressed this" is intended for authors who put a lot of effort into a post and then have people and raise objections to think that were already addressed (which is pretty frustrating for the author). That react theoretically gives them a low effort way to to respond to low effort readers. (It sucks if you're required to respond with a lot of effort to people who put in little.)
3Gunnar_Zarncke
I see it as a structured form of saying goodbye. Better than silently leaving.
2Screwtape
Hypothetical: Adam writes a couple pages of initial post, Bella writes a page long reply, Adam writes a page long reply to that, Bella writes a page long reply to that, Adam reacts "not going to respond" and moves on. That seems fine to me? Like, the norm in face to face conversation is (I think) that you're not expected to spend more than a few minutes on most replies.

I like the "picking one's nose" icon. :D 

Idea: to address this issue of reacts potentially leading to less texty responses in an unconfounded way, maybe for a period of time during later experiments you could randomly enable reacts on half of all new posts?

Might be silly though. At least it's not very worthwhile without a measure of how well it goes. Potentially total amount of text written in discussions could function as such a measure, but it seems kind of crude.

3Ruby
Reacts are a big enough change that we wouldn't decide to keep them without a lot of testing and getting a sense of their effects.

I'm trying to come up with a new icon for "not a crux" and also introduce a corresponding "is a crux" icon.

A crux is something upon which your beliefs hinge and would go one way or another. So how about?

 

branching Icon 1849037
Divorce Icon 3535860
crossroad right Icon 2623479

Do any of these seem like a good icon? Out of them, which do you most prefer?

Or I could go outright for a hinge:
hinge Icon 4205389

A reaction I'd sometimes find helpful (example), that doesn't seem quite covered by any of the existing, is "unclear why you're saying this". Like, I think I know what you're saying and perhaps I agree with it, but are you saying it because you expect me to disagree, or to elaborate on something I said, or just riffing, or...?

But I don't know what label or icon I'd use for this, and "off topic or tangential" isn't a terrible fit, at least some of the time.

Idiosyncratic request... I use a custom dark mode plugin, and using this plugin the react symbols become black-on-dark-grey which is very difficult to see. If they counted as 'text' then my plugin would convert them to white text, like it does normal text. If they were non-transparent images, then they'd have a white background and black text... (less preferable, but better than black-on-dark-grey). Could the symbols be made to 'count' as text somehow? Would that also be better for accessibility (screen readers)?

4habryka
Why not use the official LessWrong dark mode?
4gwern
Or the GW themes and/or dark-modes.
2Nathan Helm-Burger
Well, the main reason for not just using the LW dark mode for me has been that I like to have the same color of text and background unified across all my websites. But switching to dark mode in addition to my dark mode plugin did change the contrast ratio of the react symbols, so fixed my problem! So thanks for the suggestion.

I don't see something for "rests on a faulty premise".  There are "obtuse", "locally invalid", and "disagree", but none of these feel right. Possibly line-level reacts will fix this, since you can highlight the faulty premise.

Likely too complex and unwieldy to be implemented in practice or make sense as a react system, but I thought I would mention it just in case:

Some of the reacts, such as "I already addressed this", could possibly benefit from some sort of "pointing" functionality, selecting the part(s) of the discussion where one addressed it. Similarly, "Please elaborate" could possibly benefit from selecting the part(s) that one wants elaborated.

6Ruby
Yeah, we've also been thinking about "in-line" / "select-text" reacts too.
5David Hornbein
I'm strongly against letting anyone insert anything into the middle of someone else's post/comment. Nothing should grab the microphone away from the author until they've finished speaking. When Medium added the feature that let readers highlight an author's text, I found it incredibly disruptive and never read anything on Medium ever again. If LW implemented inline reader commentary in a way that was similarly distracting, that would probably be sufficient to drive me away from here, too.
4Ruby
Very valid concern. We had the same thing with "side comments". So far seems ok. We'd definitely pay data lot of attention to this when designing.

For what it's worth: when selecting a voting system for my post, it looks like if I pick name-attached reactions, I won't get the two-axis voting, which I assume isn't correct?

4Ruby
Yeah, the current name isn't perfect given the system also has two-axis voting. I might rename it.
2DanielFilan
Unrelatedly: it's weird to me that the wordings of "I'll reply later" and "Not planning to respond" don't mirror each other.
2Ruby
I find myself wanting a "on it" react.

The way to undo an inline react seems to be downvoting your own reaction twice. It really seems like I'm missing something obvious, because I currently have to zoom in or out to get the text to reflow just right so I can mouseover from the text to the react box without it disappearing en route. Is there a better way?

I'm not sure about the laugh react, since it can be easily abused in cases of strong disagreement.

More generally: low-quality replies can be downvoted, but as I understand, low-quality reactions are given equal weight and visibility. Limiting the available vectors of toxicity may be more generally desirable than increasing the available vectors of light-heartedness.

3habryka
Reacts can also be downvoted, which results in them being hidden. This is to counter abuse in the same way as voting counters abuse via low-quality comments.