Design changes & the community section (Forum update March 2023)

By Lizka, Agnes Stenlund, Ollie Etherington, Sarah Cheng 🔸 @ 2023-03-21T22:10 (+64)

We’re sharing the results of the Community-Frontpage test, and we’ve released a Forum redesign — I^[1] discuss it below. I also outline some things we’re thinking about right now. 

As always, we’re also interested in feedback on these changes. We’d be really grateful if you filled out this (very quick) survey on the redesign that might help give us a sense of what people are thinking. You can also comment on this post with your thoughts or reach out to forum@centreforeffectivealtruism.org.

Results of the Community-Frontpage test & more thoughts on community posts

A little over a month ago, we announced a test: we’d be trying out separating “Community” posts from other kinds by creating a “Community” section on the Frontpage of the Forum.

We’ve gotten a lot of feedback; we believe that the change was an improvement, so we’re planning on keeping it for the near future, with some modifications. We might still make some changes like switching from a section to tabs, especially depending on new feedback and on how related projects go.

Outcomes

Information we gathered

1. We sourced user feedback from different places: 
   1. User interviews with people at EA Global and elsewhere (at least 20 interviews, different people doing the interviewing)
   2. Responses to a quick survey on how we can improve discussions on the Forum (45 responses)
2. Metrics (mostly used as sanity checks)
   1. Engagement with the Forum overall (engagement on the Forum is 7% lower than the previous month, which is within the bounds we set ourselves and there’s a lot of fluctuation, so we’re just going to keep monitoring this)
   2. Engagement with Community posts (it dropped 8%, which may just be tracking overall engagement, and again, we’re going to keep monitoring it)
   3. There are still important & useful Community posts every week (subjective assessment)(there are)
3. The team’s experience with the section, and whether we thought the change was positive overall

Outcomes and themes: 

The responses we got were overwhelmingly positive about the change. People told us directly (in user interviews and in passing) that the change was improving their experience on the Forum. We also personally thought that the change had gone very well — likely better than we’d expected as a ~70% best outcome.^[2] 

And here are the results from the survey: 

The metrics we're tracking (listed above) were within the bounds we’d set, and we were mostly using them as sanity checks.

There were, of course, some concerns, and critical or constructive feedback.

Confusion about what “Community” means

Not everyone was clear on which posts should actually go in the section; the outline I gave before was unclear. I’ve updated the guidance I had originally given to Forum facilitators and moderators (based on their feedback and just sitting down and trying to get a more systematic categorization), and I’m sharing the updated version here.^[3]

Concerns that important conversations would be missed

Some people expressed a worry that having a section like this would hide discussions that the community needs to have, like processing the FTX collapse and what we should learn from it, or how we can create a more welcoming environment for different groups of people. We were also pretty worried about this; I think this was the thing that I thought was most likely going to get us to reverse the change.^[4] 

However, the worry doesn’t seem to be realizing. It looks like engagement hasn’t fallen significantly on Community posts relative to other posts, and important conversations have been continuing. Some recent posts on difficult community topics have had lots of comments (the discussion of the recent TIME article currently has 159 comments), and Community posts have been pretty consistently the top-viewed posts on the Forum. I also tentatively think that the discussion on Community posts has generally been somewhat better since we added the separate section. 

I do think that “important conversations haven’t been hampered by the change” is a low bar, though, and I’m excited about trying to proactively make those happen or help them go better. I hope to write more about this soon.

Missing posts from specific categories that often intersect with Community

Some people worry that they’ll miss relevant announcements (like this one) if they keep the default settings on the Frontpage (which show Community posts only in the Community section). Others worry that they’ll miss things like retrospectives on community-building projects, or EA meta organizations’ updates. 

I share a lot of the relevant content in the Forum Digest, so I hope this will help. And there’s a workaround for some issues like this. 

And unfortunately, I think we’ll always have posts that some people would like to see outside of the Community section — people don’t agree on where the line should be. I endorse the current classification because it makes sense (in that it doesn’t seem significantly gerrymandered or overfitted to the feedback that we’re getting or to our experience on specific posts, it tracks this dynamic, and seems like a mostly “real” category). But we might modify it somewhat in the future. (There were also issues with all the other proposals we considered. E.g. we considered excluding some update-style posts from the Community classification, but we worried that this would create an asymmetry between posts by organizations and posts criticizing the organizations, and we did not want to do that.)

Implementation suggestions or requests

We got a lot of pretty specific feedback on how the Community section currently works, like suggestions that we should:

1. Add a “load more” button on the Community section
   1. Some people on the team (including me) agree that this is something we should have, but we’re currently not prioritizing it. 
2. Display more posts in the section
   1. We currently think that 3 is the right number of posts, but we might reconsider. 
3. Develop some customization options for users, like the option of hiding the section entirely and possibly the option of setting a specific number of posts to see in that section
   1. For hiding the section: for now, we’ve decided to make the section collapsible, and the Forum should remember the setting you left it on. We’ll keep tracking this, though, in case people still feel like they find themselves engaging in Community discussions against their better judgement. (The section will be collapsed to start with — more on this below.)
   2. Very few people end up using customization options like this, so we haven’t prioritized this, although we might get to some of these options at some point — it’ll somewhat depend on where other projects go. 
4. Assorted other suggestions
   1. We really appreciated all the feedback, and will continue to consider it as we work on the section. 

Looking forward

We’re viewing the Community section as a sort of bandaid on some of the issues with the Forum right now. It seems to be an effective bandaid, so we’re keeping it for now (potentially with some changes), but we’re also trying to investigate the causes of the broader problems and see what we can do about them. 

Some of the broader problems include: 

• Quality of discussion not being what we want it to be
• Users don’t always see the content that is most useful for them
• New users are disoriented and put off
• People feel stressed and bad after using the Forum

We’re exploring a fairly wide range of changes to the site and to Forum support/facilitation/moderation to try to address sub-problems of the above, and we’ll likely be testing some soon.

Depending on how all that goes, we might modify the current setup with the Community section.

Forum redesign

The site’s design was (and continues to be) imperfect in various ways:

1. The Forum can be disorienting to new users; it’s hard to navigate, know what people are talking about, and understand how things like voting work. 
2. People sometimes discover a hidden feature that they wish they’d known about sooner, which could be a failure of how we organize the site.^[5]
3. We’d like to give people the information they need to decide what content to engage with.
4. People have trouble identifying which posts will be relevant for them, and keeping up with the topics or discussions they’re interested in. 
5. It’s often hard to use the Forum on mobile devices. 
6. The design is inconsistent and pretty outdated in some ways.
7. And more. 

So we’ve made an update to the design of the Forum, which we hadn’t changed in a while. 

The redesign didn’t solve all the issues above, and we don’t think it’s final. We expect to keep iterating on the design based on feedback and data we get about how people use the different features. (For instance, it may turn out that a feature whose prominence we just increased based on (2) above isn’t getting significantly more use, in which case we’d hide it again.) 

Please don’t hesitate to share your feedback here, in the survey, or at forum@centreforeffectivealtruism.org.

What are the changes?

1. Topic tabs on the Frontpage

You can now visit tabs on the Frontpage that let you see only the posts that have been tagged with that core topic. 

We hope that this will help semi-regular users get quick overviews of what’s been happening in their fields of interest (and avoid missing posts that would have been useful for them), and that it will help people new to EA go deeper on topics relevant to them. 

2. The Community section on the Frontpage is collapsible/expandable (and collapsed to start with)

Some people have asked for a way to hide the Community section entirely from the Frontpage, and we know that some people worry that they’re getting sucked into Community discussions they don’t endorse engaging with. We’ve made the section collapsible/expandable; the site will remember whether you last left the section collapsed or expanded, and keep it like that for the next time you visit.^[6]

By default, we’ve chosen to collapse the section. This is largely because of the “getting sucked in” dynamics described above, and because discussions in the Community section seem like they’d be less relevant to people who are less involved with the community and those who are newer to the Forum (we think a large portion of Forum users — especially people who are logged out — aren’t involved with the EA community). We might reverse this if we see a noticeable drop in engagement with that section and depending on the feedback we get. 

3. New information on posts on the Frontpage and other changes in the information displayed in various places (by default)

A quick list: 

1. The Frontpage list of posts now displays reading time (and we made bookmarking more prominent). 
2. We’ve changed what we include in the left sidebar.

4. We changed fonts and styles in various places

Most of this is about usability and consistency. 

Assorted other changes

1. We displayed side-comments on posts for a while (comments that were responding to a particular excerpt were displayed next to the post itself). We’ve reverted that, as it seemed to be distracting and confusing users. 
2. You can now hide Community posts from the All Posts page. Community posts often get a lot of karma, so sorting by “Top” or “Top (inflation-adjusted)” showed a lot of Community posts and seemed to give people an incorrect understanding of what the EA community cares about (see here). 
3. We fixed the Events page so that events properly appear based on the user’s location. 

Other things we’re working on or are considering working on

We’ve been gathering more data on how people are using the Forum and what they’d like to change about that (you may have seen a survey about this). 

In brief, we’re looking into things like: 

• Making versions of the Frontpage sorting algorithm that work better for users who visit the Forum more or less frequently
• Exploring changes to karma
• Developing a “card” view to give people previews of posts
• Seeing if language models can improve discussions
• Improving shortform discussions
• Differentiating between different types of posts (threads, blog posts, opportunity announcements, etc.)
• Developing and better-featuring recommendations for content Forum users should engage with, based on their activity on the Forum

This isn’t an exhaustive list (and it focuses primarily on future product changes), but I wanted to share it in case it gives people a sense for what we’re working on. As always, feel free to suggest features here. 

1. ^{^}

   This post was mostly written by Lizka (and then reviewed by others on the team), but most of the work was not done by me! Agnes is the Forum's designer, and a lot of the people on the team worked on the changes we're talking about. Thanks to @Clifford for work on the Community section, to @Sharang Phadke for work on the redesign, and @Ollie Etherington and @Sarah Cheng for implementing the UI .

2. ^{^}

   I wish we’d made some concrete predictions here, but oh well. 

3. ^{^}

   There’s also a scrappy quiz that I made for people to get calibrated. I don’t want to share it entirely publicly, as it’s got serious flaws and I don’t want to spend more time improving it right now, but you can reach out and I’ll try to share a version with you. 

4. ^{^}

   Have I mentioned that I wish we had made some concrete predictions?

5. ^{^}

   (The existence of the Forum user manual is also a result of this failure.)

6. ^{^}

   We considered adding it as an option in site customization settings, but unfortunately, very few people use customization options like this, so we didn’t think that would be a good solution. Making the section visibly collapsible solves this problem (and it’s a common interface on many websites).

Ben Millwood @ 2023-03-22T09:13 (+29)

I'm a fan of serif fonts, so I'm a little sad about that change, and a little confused why posts and comments are in a different visual style. I'm definitely no expert on stuff like this, but I'm curious if there's a motivation for that difference.

edit: oh, and it's even different between section headings and post paragraphs, that seems weird to me too, but maybe it's more common than I realized

Tobias Häberli @ 2023-03-22T09:22 (+11)

I find the font to be less readable and somewhat clunky. 
Can't quite express why it feels that way. It reminds me of display scaling issues, where your display resolution doesn't match the native resolution.

Lorenzo Buonanno @ 2023-03-22T12:36 (+10)

Can't quite express why it feels that way. It reminds me of display scaling issues, where your display resolution doesn't match the native resolution.

Now that you mention it, I feel a bit the same. It might be that we just need to get used to it, but maybe it's the font-weight?

Is the second one better? I just changed font-weight from 450 to 400

Tobias Häberli @ 2023-03-22T12:54 (+6)

I find the second one more readable. 

Might be due to my display: If I zoom into the two versions, the second version separates letters better.

But you're also right, that we'll get used to most changes :)

JP Addison @ 2023-03-22T12:55 (+9)

As a quick clarification: none of the fonts in question were actually changed from serif to sans-serif. See here for how the Forum used to look.

(There are some changes from serif to sans-serif, such as in the post list items. But my read of your comment is referring to comments and section headings, which were always that way.)

(Agnes mentions this below, but I thought I’d call it out here.)

Rasool @ 2023-03-22T16:31 (+1)

You can set your browser to not let websites choose their own fonts, and to use your settings instead^[1].

Not only do you get your own font preferences but it is quicker (no more requests off to Google Fonts or other places to download custom fonts) and more private (no more sending personal info to Google Fonts who get which has caused publishers to be fined from time to time for not being GDPR-compliant)

 

1. ^{^}

   In Firefox, go to about:config in a new tab, then set browser.display.use_document_fonts to 0. 

Jeff Kaufman @ 2023-03-22T17:12 (+2)

Google Fonts who get fined from time to time for not being GDPR-compliant

I don't believe Google Fonts has been fined for GDPR violations? Are you think thinking about European publishers being fined for using Google Fonts, because this meant sending user IP addresses to an American company?

Rasool @ 2023-03-22T17:25 (+1)

Oop yes you are correct, I wrote that in haste, let me make an edit

Jeroen Willems @ 2023-03-22T10:09 (+1)

Yeah I like most of the UI changes but not a big fan of the sans serif font. Indeed weird that the use isn't consistent either. (ETA: don't agree with this sentence anymore). If people are divided on this, perhaps have a setting to bring it back so people can choose?

Agnes Stenlund @ 2023-03-22T12:40 (+8)

Thanks for letting us know! Choice of typeface is no doubt a subjective thing and some will prefer the old font. In terms of inconsistency–one of the most popular principles for typeface combinations is the one I've gone with here–pairing a sans serif header with a serif body. This combination can be found online on places like Medium and Substack, and was already the case inside of Forum posts before this change. Typefaces are often even created in pairs of serif and sans serif that are meant to be paired this way.

This is obviously not a hard rule and you may still prefer other combinations (it’s not uncommon to use all sans serif on web, or all serif if it’s a magazine), and I'm definitely open to trying different things to improve legibility and tweak the “personality” of the Forum through typefaces (but it's not something I expect to prioritize changing right now)

Jeroen Willems @ 2023-03-22T14:34 (+3)

I think you're right (I don't mind the serif titles within the blog posts, nor do I mind the sans serif use on substack and medium). I am likely just too attached to the previous look, the most important opinion is that of new users :) Thank you for the work you've done!

NunoSempere @ 2023-03-22T06:59 (+15)

I continue to dislike how much space pinned and highlighted posts occupy:

Compare for instance with hackernews:

In my particular case, I prefer to use an rss reader with a more dense presentation, in this case newsboat. Other users who prefer packed information might want to explore similar setups:

Also, personally I found it a shame that the community posts were removed from the general rss feed. Is there an rss feed for the community posts specifically?

NunoSempere @ 2023-03-22T07:07 (+2)

Also, you can turn off the sidebar and the intercom with something like

@-moz-document domain("forum.effectivealtruism.org") {
    .SingleColumnSection-root {
        /* To do: tweak for current redesign */
	  /* width: 1000px; */
        /*  margin-left: 60.5px;  */
        /* max-width: 1200px    */
    }
    .NavigationStandalone-sidebar {
        display: none;
    }
    .intercom-lightweight-app{
        display: none;
    }
}

in an extension like stylus.

Lorenzo Buonanno @ 2023-03-22T12:31 (+6)

You can also turn off the intercom in "Site Customizations" here, and the sidebar by clicking on the hamburger menu on the top left
 

NunoSempere @ 2023-03-22T15:26 (+2)

Oh nice. Maybe there could also be a setting for "do not show pinned post if you've already read it".

Sarah Cheng @ 2023-03-23T07:03 (+1)

Quick note: community posts are still in our rss feed.

Rockwell @ 2023-03-22T14:53 (+3)

Thank you for the explanation! Fwiw, I personally find the new front page fairly difficult to skim on mobile (though much easier on desktop). I'm not sure which aspect of the change is causing this, but I think the bold post titles (that are also confined to a narrower margin) might be causing more text wrapping. Is it possible to add display options, like the below from Reddit?

Sharang Phadke @ 2023-03-22T23:19 (+1)

Thanks for the suggestion! Just to clarify, is it a more compact view that you're interested in, or is it expanding to show even more information?

Rockwell @ 2023-03-23T00:14 (+2)

I think my primary hope is for reduced text-wrapping of titles on mobile. One way to achieve that might be by providing an option that only shows titles? I don't have a clear mental image of what it looked like on mobile before the change, if there are screenshot comparisons for that.

Sharang Phadke @ 2023-03-23T02:43 (+1)

Got it, thanks for the clarification. There's a before/after mobile screenshot in this post if that's helpful. The amount of information is pretty similar, but the karma pulled out on the left hand side might be giving a pretty different feel.