🐛 BUG: Sitemap generation does not work with SSR

[sebholstein]

What version of astro are you using?

1.0.0-beta.51

Are you using an SSR adapter? If so, which one?

nodejs

What package manager are you using?

pnpm

What operating system are you using?

Mac

Describe the Bug

The generated sitemap file looks like this (no entries basically):

<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"></urlset>

In non-SSR mode, it contains all the entries that I would expect.

Link to Minimal Reproducible Example

https://stackblitz.com/edit/github-2uh2aq?file=astro.config.mjs

Participation

• I am willing to submit a pull request for this issue.

[bholmesdev]

Hi @SebastianM! This is a known limitation of our sitemap integration sadly. Since we do not expose the final build output for SSR, we cannot generate a complete sitemap. This is partially by design, since dynamic endpoints like [slug].astro can't be predicted when generating a sitemap.

We should definitely document this on our sitemap integration README though, and/or offer a warning in the console during SSR. Curious what behavior you expected here!

[sebholstein]

Hey @bholmesdev

I tried SSR yesterday for the first time and my first impression was: "why aren't there the purely static sites get stored/generated as files?".
I think it would have a lot of benefits, in particular for better TTFB times - but that's another topic.

What I also thought was, that the sitemap integration would still figure out that there are static pages and add at least these site. From a DX perspective, it seems that my configuration is broken because a sitemap xml gets generated but it's empty.

I think it would also be (theoretical) possible for dynamic pages in SSR runtime mode: if there would be an api to tell the sitemap integration that there's a new page to add to the list, the sitemap could get updated (and maybe also cached afterwards).

[bholmesdev]

Summarizing ideas from thread:

• log a warning when using sitemap with SSR
• document the customPages integration option to manually list sitemap pages
• [future] add static SSR routes to astro:build:done hook output

☝️ I'll close this issue after addressing the first two!

[maxcountryman]

@bholmesdev is there a concrete plan to address the third item or is that only for potential consideration?

My two cents: it's unfortunate to have to manually collate pages if you opt into SSR.

[modelorona]

If you've got a simple site that's a couple pages + blog posts, assuming you keep your md files in src/content/blog (or similar), you can use the code below:

const __filename = fileURLToPath(import.meta.url);
const __dirname = path.dirname(__filename);
const directoryPath = path.join(__dirname, 'src', 'content', 'blog');
const files = fs.readdirSync(directoryPath);
const siteUrl = 'https://...';
const blogUrls = files.map((file) => {
  const fileName = file.split('.')[0];
  return `${siteUrl}/${fileName}`;
});

which can be used as

sitemap({
  customPages: ['your non blog urls here'].concat(blogUrls),
  priority: 0.5,
  changefreq: 'monthly'
})

[jhedstrom]

It would be great if the above was added to the documentation! It seems to work for predictable dynamic routes.

[offwork]

Since the xml nodes of pages created with SSR do not appear in the sitemap, how should we use the sitemap for dynamic pages created with SSR?