User Tools
The VACC support team has developed several tools, accessible throughout the VACC clusters, which assist in tracking accounting and Slurm job statistics.
my_help¶
Running the command my_help will print out a list of the rest of the tools listed below, with a brief summary of their function.
my_compute_usage¶
my_compute_usage reports the CPU hour, GPU hour, and Compute Unit usage of a VACC account. This report defaults to the past 1 year, but can be set to choose any timeframe. It prints the total usage of the account, as well as the statistics for each sponsored user.
| Command Line Argument | Description |
|---|---|
| -s, --starttime | Specifies the start time of the report. The valid date formats are mm/dd/yy, mm/dd/yyyy, or yyyy-mm-dd e.g. 01/01/24 - 01/01/2024 - 2024-01-01 - By default, the start of the report is 365 days ago. |
| -e, --endtime | Specifies the start time of the report. The valid date formats are mm/dd/yy, mm/dd/yyyy, or yyyy-mm-dd e.g. 01/01/24 - 01/01/2024 - 2024-01-01 - By default, the end of the report is the current date. |
| -y, --year | The calendar or fiscal year chosen for the report. This option is mutually exclusive with manually specifying a start or end time. Acceptable formats for fiscal year are FYyy or FYyyyy, e.g. FY2023 or FY23. Acceptable formats for the calendar year are yyyy or yy, e.g. 2023 or 23. If the current year or fiscal year is chosen, this displays the results for the year-to-date. |
| -a, --account | The Slurm account queried for the report. By default, this is the PI group of the the user that runs this command. |
| -c, --csv | Using this flag outputs a CSV file, rather than a readable table. This program prints to STDOUT, so if saving to a file is necessary, pipe the output to a file. E.G: my_compute_usage --csv >> results.csv |
| --cpu | The amount of Compute Units per CPU hour. As described in the VACC's Cost/Payment article, the default is 1 Compute Unit per CPU hour. --cpu 10 would increase the calculated rate to 10 Compute Units per CPU hour. |
| --gpu | The amount of Compute Units per GPU hour. As described in the link above, the default is 60 Compute Unit per GPU hour. --gpu 10 would decrease the calculated rate to 10 Compute Units per GPU hour. |
[testuser@vacc-login1 ~]$ my_compute_usage
Getting results from the Slurm job database.
This may take a moment...
CPU, GPU, and CU usage for the Slurm account testaccount
for the period: 2023-05-09 to 2024-05-08
---------------------------Usage per User----------------------------------
Account | Username | CPU Hours used | GPU Hours used | CUs used
testaccount | testuser | 10.00 | 5.50 | 340.00
testaccount | testuser2 | 15.00 | 0.00 | 15.00
----------------------Usage total for Account------------------------------
Account | | CPU Hours used | GPU Hours used | CUs used
testaccount | | 25.00 | 5.50 | 355.00
my_accounts¶
my_accounts shows which Slurm account(s) your VACC account can submit jobs as. You can also append a username to query another user's Slurm accounts. If you are in multiple groups, the bottom account listed is your "primary" account - the one used if no account is specified when you start a job.
[testuser@vacc-login1 ~]$ my_accounts
Account
--------------------
test-secondary-slurm-account-0
test-secondary-slurm-account-1
testaccount
[testuser@vacc-login1 ~]$ my_accounts otheruser
Account
--------------------
test-secondary-slurm-account-1
otheruseraccount
my_gpfs_quota¶
my_gpfs_quota is used to view usage and quota information for both your pi group and your personal usage.
[testuser@vacc-login1 ~]$ my_gpfs_quota
Group quota for your primary group: pi-testuser
Space limits
------------------------------------------------------------------------------
Filesystem type blocks quota limit in_doubt grace
gpfs1 GRP 20.51G 2T 4T 0 none
gpfs2 GRP 12.96G 4T 8T 0 none
gpfs3 GRP 0 0 0 0 none
------------------------------------------------------------------------------
File Limits
------------------------------------------------------------------------------
Filesystem type files quota limit in_doubt grace Remarks
gpfs1 GRP 86978 1048576 1536000 0 none
gpfs2 GRP 44383 1536000 3145728 0 none
gpfs3 GRP 1 0 0 0 none
------------------------------------------------------------------------------
SPACE occupied by testuser within the pi-testuser group
------------------------------------------------------------------------------
Filesystem blocks
gpfs1 20.22G
gpfs2 12.96G
gpfs3 0
------------------------------------------------------------------------------
FILES created by testuser within the pi-testuser group
------------------------------------------------------------------------------
Filesystem files
gpfs1 80526
gpfs2 44381
gpfs3 1
------------------------------------------------------------------------------
NOTE: Quotas are based on your group, so the figures in the first block are for
your group. Your personal usage is in the second block.