...
Size: 55 TiB - quoted
IME - Emmy only
DDN Infinite Memory Engine (IME) based Burst Buffers and file system Cache - --a fast data tier between compute nodes and the Lustre file system /scratch - is used as an I/O accelerator for I/O bound problems. This helps avoid overload on the system when a program tries to write large amount of data within a short period of time to the global parallel file system. IME servers consist of Solid State Disk (SSD) that acts as a cache and burst buffer to improve the global file system performance. IME servers are currently available for use in EMMY.
Access: IME Burst Buffer, File System CacheSize:
Finding the right filesystem
...
INTERNAL
Recommendation Matrix:
The maximum Max performance gain on IO versus default $WORK is mentioned in brackets.
| small random IO | lots of large IO per process | few large IO | shared acrossaccessed from many nodes | unknown IO | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| local IO | global IO | local IO | global IO | local IO | global IO | local IO | global IO | |||
| Code e.g. | OpenFOAM? | FESOM? | ||||||||
| write IO | Local SSDs (+100%) | FastIO stripe=4 (+30%) | Local SSDs (+15%) | $WORK | $WORK | FastIO stripe=4 (+200%) or $WORK stripe=4-8 (+200%) | Local SSDs (+40%) | FastIO stripe=4 4 (+80%) $WORK stripe=4-8 8 (+70%) | ||
| read IO | Local SSDs (+30%) | FastIO (+140%) | Local SSDs (+30%) | FastIO stripe=4 (+20%) | Local SSDs (+35%) | FastIO stripe=4 4 (+200%) | Local SSDs (+30%) | FastIO stripe=4 4 (+120%) $WORK stripe=MAX (+90%) | ||
| balanced IO | Local SSDs (+60%) | FastIO stripe=4 (+90%) | Local SSDs (+25%)FastIO | FastIO (+15%) | Local SSDs (+20%) | FastIO stripe=4 4 (+200%) or $WORK stripe=MAX (+150%) | Local SSDs (+35%) | FastIO stripe=4 4 (+100%) FastIO (+50%) | ||
Vorschlag Ankündigung
Subj: additional WORK filesystems available
Dear HLRN Users
to achieve better IO performance HLRN has installed additional filesystems tailored for dedicates IO demands.
LISE has now node-local SSDs using NVMe and Optane to accelerate local IO. Furthermore we have installed a SSD based Lustre called 'FastIO'.
EMMY is upgraded with an IME.....
If your jobs have a significant amount of IO which can be accelerated visit: _________ or contact our support.
Kind Regards
HLRN-Team
-----
TODO:
- Links
- CMDs