Workspaces/Advanced Features/Quotas: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
(Created page with "= Cluster-Specific Workspace Limits = Different clusters have different workspace policies configured in <tt>/etc/ws.conf</tt>. Below is an overview of typical settings: {| class="wikitable" |- !style="width:15%" | Cluster !style="width:15%" | Default Lifetime !style="width:15%" | Max Lifetime !style="width:15%" | Max Extensions !style="width:20%" | User Quota !style="width:20%" | Inode Quota |- |bwUniCluster 3.0 |1 day |60 days |3 times |40 TiB |20 million |- |JUSTUS...")
 
mNo edit summary
Line 1: Line 1:
= Cluster-Specific Workspace Limits =
= Quotas & Limits =


== Cluster-Specific Workspace Limits ==
Different clusters have different workspace policies configured in <tt>/etc/ws.conf</tt>. Below is an overview of typical settings:

Each cluster has different workspace policies and quotas:


{| class="wikitable"
{| class="wikitable"
Line 9: Line 11:
!style="width:15%" | Max Lifetime
!style="width:15%" | Max Lifetime
!style="width:15%" | Max Extensions
!style="width:15%" | Max Extensions
!style="width:20%" | User Quota
!style="width:20%" | Storage Quota
!style="width:20%" | Inode Quota
!style="width:20%" | File Limit (Inodes)
|-
|-
|bwUniCluster 3.0
|bwUniCluster 3.0
Line 17: Line 19:
|3 times
|3 times
|40 TiB
|40 TiB
|20 million
|20 million files
|-
|-
|JUSTUS 2
|JUSTUS 2
Line 24: Line 26:
|Unlimited
|Unlimited
|20 TiB
|20 TiB
|5 million
|5 million files
|-
|-
|Helix
|Helix
Line 31: Line 33:
|10 times
|10 times
|10 TiB
|10 TiB
|No limit
|None
|-
|-
|BinAC2
|BinAC2
Line 37: Line 39:
|30 days
|30 days
|5 times
|5 times
|No limit
|None
|No limit
|None
|-
|-
|NEMO2
|NEMO2
Line 45: Line 47:
|100 times
|100 times
|5 TiB per workspace
|5 TiB per workspace
|No limit
|None
|}
|}


'''Important notes:'''
== Configuration Parameters ==
* '''Default Lifetime:''' If you don't specify duration, this is used
* '''Max Lifetime:''' Maximum duration you can request
* '''Max Extensions:''' How many times you can extend a workspace
* '''Storage Quota:''' Total space available for your workspaces
* '''File Limit:''' Maximum number of files (inodes) you can create


'''Note:''' Limits may change. Check cluster-specific documentation for current values.
'''Configuration parameters in <tt>/etc/ws.conf</tt>:'''
* <tt>duration</tt> - Maximum lifetime in days
* <tt>maxextensions</tt> - Number of times a workspace can be extended
* <tt>keeptime</tt> - Days to keep expired workspaces before final deletion (typically 7-30 days)
* Released workspaces have a shorter grace period (~1 hour) regardless of <tt>keeptime</tt>


== Grace Periods for Workspace Recovery ==
'''Note:''' Check your specific cluster documentation for current quotas and settings, as they may change. Use <tt>ws_list -l</tt> to see available filesystems and their properties on your cluster.


When workspaces expire or are released, they can be recovered for a limited time:
= Checking Workspace Quotas =


* '''Expired workspaces:''' Recoverable for 7-30 days (cluster-specific)
The command to check workspace quota usage varies by cluster and filesystem:
* '''Released workspaces:''' Recoverable until next cleanup cycle (~1 hour)


See [[Workspaces/Advanced_Features/ws_restore|ws_restore]] for recovery procedures.
== Lustre-based clusters ==


== Checking Your Quota Usage ==
⚫
'''bwUniCluster 3.0, JUSTUS 2:'''


⚫
=== bwUniCluster 3.0, JUSTUS 2 ===
⚫
$ lfs quota -uh $(whoami) /lustre/work # or appropriate workspace path
⚫
$ lfs quota -uh $(whoami) /pfs/work9 # bwUniCluster 3.0


⚫
$ lfs quota -uh $(whoami) /lustre/work
== NEMO2 (Weka filesystem) ==
⚫
$ lfs quota -uh $(whoami) /pfs/work9 # bwUniCluster 3.0 specifically


Shows your current usage, quota limit, and available space on Lustre filesystems.
⚫
$ nemoquota # Shows HOME and workspace quotas

⚫
=== NEMO2 ===

⚫
$ nemoquota # Shows all quotas (HOME + workspaces)
$ df --si $(ws_find workspace_name) # Check specific workspace
$ df --si $(ws_find workspace_name) # Check specific workspace


The <tt>nemoquota</tt> command shows both HOME directory and workspace quotas.
== Helix (IBM Spectrum Scale) ==

=== Helix ===

⚫
$ workquotainfo # Shows workspace quota information


=== BinAC2 ===
⚫
$ workquotainfo # Shows workspace quota info


$ df # Check available space
⚫
== BinAC2 ==


* No quota limits enforced on workspaces
BinAC2 has no quota limits enforced on workspaces.
* Check available space with <tt>df</tt> command


== General tip ==
== Managing Quota ==


If you're running low on quota:
Always check disk usage before large data operations to ensure sufficient space is available.


* '''Release unused workspaces:''' <tt>ws_release workspace_name</tt>
For quota management strategies, see [[Workspaces/Advanced_Features/ws_release#Immediate_Deletion_.28Free_Quota_Instantly.29|Immediate Deletion]] methods.
* '''Immediate deletion:''' For instant quota relief, see [[Workspaces/Advanced_Features/ws_release#Immediate_Deletion_.28Free_Quota_Instantly.29|Immediate Deletion]]
* '''Note:''' Released workspaces may still count toward quota for ~1 hour until cleanup runs

Revision as of 17:33, 2 December 2025

Quotas & Limits

Cluster-Specific Workspace Limits

Each cluster has different workspace policies and quotas:

Cluster Default Lifetime Max Lifetime Max Extensions Storage Quota File Limit (Inodes)
bwUniCluster 3.0 1 day 60 days 3 times 40 TiB 20 million files
JUSTUS 2 7 days 90 days Unlimited 20 TiB 5 million files
Helix N/A 30 days 10 times 10 TiB No limit
BinAC2 N/A 30 days 5 times No limit No limit
NEMO2 30 days 100 days 100 times 5 TiB per workspace No limit

Important notes:

  • Default Lifetime: If you don't specify duration, this is used
  • Max Lifetime: Maximum duration you can request
  • Max Extensions: How many times you can extend a workspace
  • Storage Quota: Total space available for your workspaces
  • File Limit: Maximum number of files (inodes) you can create

Note: Limits may change. Check cluster-specific documentation for current values.

Grace Periods for Workspace Recovery

When workspaces expire or are released, they can be recovered for a limited time:

  • Expired workspaces: Recoverable for 7-30 days (cluster-specific)
  • Released workspaces: Recoverable until next cleanup cycle (~1 hour)

See ws_restore for recovery procedures.

Checking Your Quota Usage

bwUniCluster 3.0, JUSTUS 2

  $ lfs quota -uh $(whoami) /lustre/work
  $ lfs quota -uh $(whoami) /pfs/work9      # bwUniCluster 3.0 specifically

Shows your current usage, quota limit, and available space on Lustre filesystems.

NEMO2

  $ nemoquota                                # Shows all quotas (HOME + workspaces)
  $ df --si $(ws_find workspace_name)        # Check specific workspace

The nemoquota command shows both HOME directory and workspace quotas.

Helix

  $ workquotainfo                            # Shows workspace quota information

BinAC2

  $ df                                       # Check available space

BinAC2 has no quota limits enforced on workspaces.

Managing Quota

If you're running low on quota:

  • Release unused workspaces: ws_release workspace_name
  • Immediate deletion: For instant quota relief, see Immediate Deletion
  • Note: Released workspaces may still count toward quota for ~1 hour until cleanup runs
Retrieved from "https://wiki.bwhpc.de/wiki/index.php?title=Workspaces/Advanced_Features/Quotas&oldid=15613"