Forem Creators and Builders 🌱

Discussion on: Changelog: When is an article indexed by a search engine?

 
ildi profile image
Ildi

Hey Daniel,

Thank you for breaking this down for me. It’s very interesting to understand the initial logic for when the β€œnoindex” rule only applied to DEV vs all the Forem communities today.

The Jay-Z deepfake article is indeed now indexable by Google. Based on your explanation, the cause of the β€œnoindex” was most likely due to the author of that article having had 0 comments on 1VIBE when posting the article, even though the article was published on behalf of an organization, the 1VIBE Team in this case.

It makes sense that these rules were put into place considering the size of DEV and how many posts users must be making on the site every 24hrs. I’m glad that these settings can now be customized, they will be useful for SEO and dealing with spam.

Thread Thread
 
lee profile image
Lee

Great explanation, thanks for this. Does this mean that articles on new Forem pre the update would have noindex applied if the score was low?

Thread Thread
 
djuber profile image
Daniel Uber

@lee yes, that issue with articles published but not search indexed had been observed and reported in a few cases (including Ildi's case above), the decision to include or exclude those meta tags is done "live" when you view the page, or when you generate the sitemap, so sites that have updated in the past week should already be seeing the change and more articles get picked up by search engines, If Forem hosts your site, these updates happen about twice per week, if you're self-hosted then you'd want to update to a current container image to get this change.