Forem Creators and Builders 🌱

Cover image for Relieving Fears Around Reposting Content from Other Websites

Relieving Fears Around Reposting Content from Other Websites

Michael Tharrington on September 28, 2021

Cover Image Credits: @stefanbc This article is meant for Forem Creators to help explain to their community members how they can go about reposting...
Collapse
 
ildi profile image
Ildi • Edited

Dope post @michaeltharrington ! I want to test the RSS reposting feature to see how well the post formating works when importing the content into a Forem community.

One thing im curious about is in the event that you are "aggregating" rather than reposting a full article. I think we should elaborate a bit on what we mean when we say "reposting". Are we referring to your own original article that you may have published on your own blog and now want to also post in a Forem community, or are we also talking about sharing full articles from any publication like if you wanted to share this full article even though you are not the original author from Techcrunch?

I have been sharing or what I call "aggregating" many of these type of posts on 1VIBE that fall under our News + Interviews tags. Aggregation websites like Digg do a lot of this. One example of a 1VIBE post is this one where I am grabbing a small portion of the original post text as a snippet and then adding a "Read Full Interview" link below.

Im wondering if these type of posts should be assigned canonical URLs? In my experience with the previous version of the 1VIBE website which ran on wordpress, Google didn't seem to penalize these type of posts. I was not using a canonical URL setting with wordpress. But I can't say that I am an SEO master, so I would like to gain some better knowledge about the best way to handle these type of posts. Main question would be how does Google treat posts that have canonical URLs, do they still rank well?

Collapse
 
michaeltharrington profile image
Michael Tharrington • Edited

Hey Ildi!

Thanks so much for this clarifying comment.

I'm talking strictly about reposting an article in full here and not about aggregation. You should only list a canonical URL link when reposting an article in full, i.e. if the article is a complete copy of another post that exists elsewhere on the web.

As for your other question: how does Google treat posts that have canonical URLs, do they still rank well?

This is kinda tough for me to get to the bottom of... SEO is a moving a target and there are whole professions dedicated to trying to figure out how to best optimize for search engines. I'd definitely recommend reading through some of the documentation Google provides here

That said, from most of what I'm reading, it sounds like only the canonical post will be viewable in search engines not the repost. So, if you repost an article on Forem and specify the canonical link as your original blog, then only the original post should show up.

EDIT: I must specify that I am not an expert in this area, and am not 100% confident about my explanation in this message. However, if your users are creating content and reposting it on your Forem and they're worried about the SEO of their original posts, I highly recommend suggesting to them to designate the canonical when reposting.

Collapse
 
terabytetiger profile image
Tyler

That said, from most of what I'm reading, it sounds like only the canonical post will be viewable in search engines not the repost.

I believe this is true, but it's worth noting that because of how high the "Domain Authority" of sites like DEV is, if you post on both your personal site and DEV at the same time, there can be some overlap during the first few days where Google will show DEV's link at first.

(Clarifying point: Domain Authority is roughly how trusted a site is by Google)

Because of this I've seen some creators advocate for posting on your personal site, then waiting to publish on DEV for at least a day.

Notably, this is not necessarily the case for other forems - especially not immediately after starting, but could become a problem.

Thread Thread
 
michaeltharrington profile image
Michael Tharrington

Thanks so much for chiming in here, Tyler! I didn't realize that domain authority could override the canonical link, but totally trust your breakdown here. πŸ™‚

I also feel like if a person's blog (or other site that they are posting to) has a lot of red flags for Google's crawlers, then Google could potentially decide to index the reposted article over the original. But, this is really just a hunch on my part.

Thread Thread
 
terabytetiger profile image
Tyler

I'm not sure that Domain Authority is overriding, so much as potentially causing initial ranking "confusion" (this might also depend on/be caused by how often Google is expecting sitemap updates - I could be completely wrong on this though).

Might also be worth noting that even on the canonical url, the canonical meta tag is expected pointing at the page - I'm not sure if this impacts the reposts showing up, or if it is just to help Google solidify that the original article is the original article.

Thread Thread
 
michaeltharrington profile image
Michael Tharrington

Gotcha!

I might be getting in a bit over my head now.

Might also be worth noting that even on the canonical url, the canonical meta tag is expected pointing at the page - I'm not sure if this impacts the reposts showing up, or if it is just to help Google solidify that the original article is the original article.

I don't exactly understand this. But I think that the way we're handling canonicals is correct right? I've pinged the Forem engineers on this so that they can speak to this topic.

Thread Thread
 
terabytetiger profile image
Tyler

The part you called out is more for the host of the original content (DEV/Forem is handling it correctly on their side πŸ‘πŸ»)

For example, if I post a blog post on my personal site, I should also be including <link data-vue-tag="ssr" rel="canonical" content="https://terabytetiger.com/lessons/articles/moving-from-vue-2-to-vue-3-composition-api/"> on my page - terabytetiger.com/lessons/articles...

I was adding this for anyone that might find this post in the future and be new to how to best use canoncial_url πŸ˜…

Thread Thread
 
michaeltharrington profile image
Michael Tharrington

Good deal! Thanks for mentioning this.

I totally understand what you mean now.

Appreciate you setting me straight here. πŸ˜€

Thread Thread
 
ellativity profile image
Ella (she/her/elle)

This is really handy advice, @terabytetiger , and a really helpful explanation! Thanks so much for sharing!

Thread Thread
 
ildi profile image
Ildi

I can confirm that when 1VIBE was a wordpress website and mostly aggregating content (so not adding the Canonical URL) we were sometimes able to temporarily outrank the original source on Google search results. I would say that 1VIBE for sure had lower "domain authority" than the source, but I was however personally telling Google to crawl our pages via the Google Search Console as soon as we made the posts which was not long after the original source. But this only works temporarily and in the long run Google does seem to adjust search result rankings based on actual "domain authority" and probably other factors like who the original source of the content is.

Collapse
 
ildi profile image
Ildi

Thank you for breaking that down some more. It makes sense that a repost of a conical url would be omitted from search results.

I guess I’m curious about if the way I’m doing content aggregation on 1VIBE is the best way to do it in a Forem community. I’m also thinking about how these aggregated posts would affect SEO. I know that Forem was purposely made more for publishing original posts.

Thread Thread
 
michaeltharrington profile image
Michael Tharrington

Totally understand! And really thanks for helping me to clarify things... it hadn't occurred to me that reposting could also mean aggregate posts, but of course it could!

I honestly don't know if the way that you're sharing aggregate content would positively or negatively affect the SEO on 1VIBE. I know that original content is supposed to be most helpful for SEO, but beyond there obviously levels of grey with how "original" content is. There's duplicate content, aggregate posts (like you describe), and posts that heavily site other sources... but I can't currently speak to how each of these types of posts affects SEO. I'm going to hunt around and see if I can find any resources out there that will help us; if I find something good, you'll be the first to know! πŸ™‚

Thread Thread
 
ildi profile image
Ildi

Thank you @michaeltharrington πŸ™Œ

Would love to hear more opinions/suggestions on content aggregation within Forem communities.

Collapse
 
varhal profile image
Varhal

@michaeltharrington
Found another SEO problem in Forem. Having analyzed the dev.to site, I saw that a large number of articles are not indexed at all in search engines. I opened the generated code and saw that the description tag is the same on all articles, this is bad practice. The description tag can be generated from the text of the article (as most CMS do). Please tell me, have you thought about it? Is there a chance that this will be fixed? thanks

Collapse
 
michaeltharrington profile image
Michael Tharrington

Hey Varhal,

Really appreciate you bringing these things to light!

I know that some articles are not indexed at all. This is talked about a bit in the post here: Changelog: When is an article indexed by a search engine? and I think this comment is particularly enlightening.

As for the description tag being the same on all articles, that does seem pretty odd. I'm going to relay your concerns to our team today and see if there's a reason we're doing this or if it's something we may be able to change and improve upon.

Thanks very much for looking into this so thoroughly and providing such helpful feedback!

Collapse
 
michaeltharrington profile image
Michael Tharrington • Edited

Speaking with the team, it does in fact appear that each description is uniquely generated based on the post's content. For instance, when I view the page source for my recent post here , I see the following:

description meta-tags on my post

That said, we are discussing some subtle changes we could make here. And of course, if I'm misunderstanding you, please do chime in and set me straight! πŸ™‚

Thread Thread
 
varhal profile image
Varhal

Thanks, this cleared up a lot of questions πŸ‘

Thread Thread
 
michaeltharrington profile image
Michael Tharrington

Great! Really happy to hear this explanation is helpful. πŸ™‚

If any other questions arise, don't hesitate to ask away!

Collapse
 
ioscasey profile image
Casey πŸ’Ž

Seriously awesome post!