Forem Creators and Builders 🌱

Discussion on: Unable to submit sitemap.

Collapse
 
jamie profile image
Jamie Gaskins

I made a change to sitemap generation last week to fix a memory leak, but it shouldn't have had any effect if you had your AWS credentials in place to upload it to S3. I'll give that another look this morning.

Collapse
 
akhil profile image
Akhil Naidu

I'm attaching the link to my auto generated robots.txt file: app.leewardslope.com/robots.txt

As it is autogenerated you can confirm that I have successful enabled S3.

Also, I disabled my cloudinary api, so that you can also confirm it by inspecting any image within my Forem.

Rest of the information are clearly mentioned in the above article, be it realted to making the S3 bucket public, adding my bucket to search console and other requirements.

Thread Thread
 
ben profile image
Ben Halpern

Hey folks, we at DEV were actually given the instruction from our SEO consultant to submit monthly sitemaps directly via the Search Console and in that context they need to be off the root.

So you may do that using this format:

app.leewardslope.com/sitemap-Jun-2...

There is some additional logic in SitemapsController around how this is generated and what the options are that currently have some "magic number syndrome" that applies too much to just DEV.

TL;DR the robots.txt one is not necessarily best practice anyway, but the other functionality is not entirely fleshed out and is not appropriately documented. I'll follow up on these problems as an issue, but @ellativity and co. heads up on the state of this. We could immediately adjust some of the docs to address this.

Thread Thread
 
akhil profile image
Akhil Naidu

So is there any criteria for a post to be eligible to stay in sitemap?; because I was not able to see all of my posts in the sitemap.

Anyways something is always better than nothing, but just curious to know about it; as sitemap submission is one of the essential step for SEO.

Thread Thread
 
lee profile image
Lee

Good question. @ben do we need to do a manual sitemap submission per month?

Thread Thread
 
manuel profile image
Manuel

I have the same issue that the sitemap wasnt updating, so i need to do it manually with

./rake sitemap:create

Offcourse the best solution is to have this automated, not sure if this already part of Forem and could be an issue with our setup.

Thread Thread
 
lee profile image
Lee

I didn’t read Ben’s post on this properly. All the monthly sitemaps are automated (i think) and then you manually submit then like this:

So you should add sitemap-Feb-2021.xml and sitemap-Mar-2021.xml and so-forth to your search console.

Thread Thread
 
akhil profile image
Akhil Naidu

Yup that's right.