Skip to content

Commit

Permalink
DPDF PDF changes
Browse files Browse the repository at this point in the history
  • Loading branch information
womullan committed Sep 13, 2022
1 parent 973c39c commit c072f2c
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 4 deletions.
4 changes: 2 additions & 2 deletions proposal.tex
@@ -1,7 +1,7 @@
\section{Proposal} \label{sec:proposal}

Let us assume the resources available are fairly fixed in line with \secref{sec:resources}.
Hence we will need an arbitration committee \secref{sec:arbitration}
Hence we will need a resource allocation committee \secref{sec:arbitration} to arbitrate requests.

We promised some form of user batch which it seems likely will be needed at least initially as many users understand batch processing of images say. By batch here we should be clear we mean a BPS command line interface to something like PanDA. \secref{sec:bpsbatch}

Expand Down Expand Up @@ -63,7 +63,7 @@ \subsubsection{Non Rubin code} \label{sec:othercode}
If users wish only to write files they would have to go in their user space or potentially a VOSpace end point - the user would need to organize and track such files themselves.


\subsection{Arbitration or Resource Allocation Committee}\label{sec:arbitration}
\subsection{Resource Allocation Committee}\label{sec:arbitration}
As \secref{sec:resources} points out we will need an arbitration committee of some sort.
It seems this should also favor individuals from under represented and under resourced groups though that is being proposed here for the first time.
We note also proposals committing to releasing Level 3 data products that are made available to all data rights holders will also be allowed to be given a preference by the RAC.
Expand Down
6 changes: 4 additions & 2 deletions resources.tex
Expand Up @@ -48,7 +48,7 @@ \subsection{Quotas and allocation} \label{sec:quotas}
\citeds{DMTN-135} table 40 allocates 2PB in year 1 growing to 9PB in year 10 for science user home space.
This is still driven by the original requirement to support 7500 users. Table 40 assumes 5K users in year 1
yielding a limit of 40GB per user. Of course usage will not be even so we could set the limit higher like 60GB
and monitor what happens. On SDSS we kept the quota low and accepted justified requests to get more - most people kept within the quota by keeping their user space. Its not obvious what a good number is here but perhaps we should start the RSP users on 10GB quota.
and monitor what happens. On SDSS and BaBar the quota was kept low and justified requests to get more were accepted - most people kept within the quota by keeping their user space. Its not obvious what a good number is here but perhaps we should start the RSP users on 10GB quota.

KT points out on NCSA "9\% (81 of 892) of NCSA home directories had more than 10 GB on 2022-02-07."
This would indicate starting allocation on RSP of 10GB may work for 90\% of users - we can then increase on request for some users.
Expand All @@ -61,8 +61,10 @@ \subsection{Quotas and allocation} \label{sec:quotas}

\subsubsection{Peak times}
There are going to be known events such as a Data Release which we know will put pressure on the system.
For these event we would want to scale back to basic quotas like 0.5 core per user and disabling DASK or even batch execution.
For these event we would want to scale back to basic quotas like 0.5 core per user and potentially disabling DASK.
We should also experiment with paying for the surge and see if subsequent lulls even out the bill.
The latter approach would allow us to maintain a good service level and would be a more equitable approach since it would
not penalize the users who have no other form of access.

\subsubsection{Unused home space}
Space on cloud means cost.
Expand Down

0 comments on commit c072f2c

Please sign in to comment.