Added content for storage, datasets and containers

[RobJY]

Getting close to being ready to merge. Making this draft PR to test against lint.

[github-actions]

PR Preview Action v1.6.0
Preview removed because the pull request was closed.
2025-03-03 17:05 UTC

[RobJY]

I'm getting errors around the iframes I just added:

docs/hpc/07_containers/02_containers.md
  1:1  error  TypeError: Cannot read properties of undefined (reading 'mdxJsxTagStack')
    at Object.enterMdxJsxTag (file:///home/runner/work/rts-docs-dev/rts-docs-dev/node_modules/mdast-util-mdx-jsx/lib/index.js:161:20)
    at compile (file:///usr/local/lib/node_modules/remark-cli/node_modules/mdast-util-from-markdown/lib/index.js:352:40)
    at fromMarkdown (file:///usr/local/lib/node_modules/remark-cli/node_modules/mdast-util-from-markdown/lib/index.js:187:29)
    at parser (file:///usr/local/lib/node_modules/remark-cli/node_modules/remark-parse/lib/index.js:18:12)
    at Function.parse (file:///usr/local/lib/node_modules/remark-cli/node_modules/unified/lib/index.js:273:12)
    at parse (file:///usr/local/lib/node_modules/remark-cli/node_modules/unified-engine/lib/file-pipeline/parse.js:50:36)
    at wrapped (file:///usr/local/lib/node_modules/remark-cli/node_modules/trough/lib/index.js:160:27)
    at next (file:///usr/local/lib/node_modules/remark-cli/node_modules/trough/lib/index.js:86:23)
    at done (file:///usr/local/lib/node_modules/remark-cli/node_modules/trough/lib/index.js:194:7)
    at file:///usr/local/lib/node_modules/remark-cli/node_modules/unified-engine/lib/file-pipeline/read.js:39:7

I'm also getting one for docs/hpc/03_storage/06_data_management.md

any idea how I fix these? Seems like the iframe code is the same as elsewhere in the document, so I'm confused.

[s-sajid-ali]

I'm getting errors around the iframes I just added:

Can you rename them to .mdx ? (https://mdxjs.com/)

Additional context: https://docusaurus.io/docs/markdown-features#mdx-vs-commonmark

[RobJY]

Oh, of course. I remember reading about the mdx extension, but didn't realize I'd need it for iframes. Thanks so much for pointing that out!

Ok, I think it's ready for review. Please let me know if there's anything I missed. Thanks!

[s-sajid-ali]

Same comment as for the scratch nested admonition

[s-sajid-ali]

The data management page might be a better first page as it introduces all the concepts of how one goes about managing data on a HPC cluster. The details about specific storage systems and transfer methods can then follow as subsequent sections.

Let me know if you think it might be better to reorganize the page ordering.

[RobJY]

I'm sure it needs to be reorganized. Your suggestion sounds great.
I just dumped the pages in the directory as I worked on them. Please let me know if you've got a suggested reordering and I'll take a look at it too. Thanks!

[RobJY]

I guess we also need more up to date storage info, like has the amount of storage on GPFS changed, how much VAST storage do we have, wow big is RSP, etc.
Maybe that's better added to a new ticket?

[s-sajid-ali]

Maybe that's better added to a new ticket?

Sounds good to me.

[RobJY]

Cool, I started that ticket and will add to it as we finish this up and as I work through the usability ticket.

[RobJY]

@s-sajid-ali Thanks for all the great suggestions!
I've pushed an update that incorporates them and some changes I mentioned in the resolved comments above. Please let me know if you'd rather I not pull out those top bullet list items into a separate warning or would like any other changes.

[s-sajid-ali]

Looks good to me.

[RobJY]

Cool, thanks @s-sajid-ali !