Permalink
Browse files

notes on local/laptop pilot development

  • Loading branch information...
1 parent e25dad3 commit 5136340ee87f0ce7fc7bc6581ebe7d73e171a661 @timf timf committed Nov 10, 2010
Showing with 98 additions and 5 deletions.
  1. +4 −4 docs/m4/worksp.lib.m4
  2. +1 −1 docs/src/dev/index.html
  3. +93 −0 docs/src/dev/reference.html
View
@@ -282,9 +282,9 @@ m4_define([[[_NIMBUS_LEFT2_DEV1_SIDEBAR',
<li>
<a href="../plugins/index.html" title="Extensibility" class="$2">Extensibility</a>
</li>
- <li>
+ <!-- <li>
<a href="apis.html" title="APIs" class="$3">APIs</a>
- </li>
+ </li> -->
<li>
<a href="sccs.html" title="Source Control" class="$4">Source Control</a>
</li>
@@ -314,9 +314,9 @@ m4_define([[[_NIMBUS_LEFT2_DEV2_SIDEBAR',
<li>
<a href="index.html" title="Extensibility" class="$2">Extensibility</a>
</li>
- <li>
+ <!-- <li>
<a href="../dev/apis.html" title="APIs" class="$3">APIs</a>
- </li>
+ </li> -->
<li>
<a href="../dev/sccs.html" title="Source Control" class="$4">Source Control</a>
</li>
View
@@ -10,7 +10,7 @@
_NIMBUS_CENTER2_COLUMN
_NIMBUS_2_6_DEPRECATED
-<h2>Developer Resources (2.5)</h2>
+<h2>Developer Resources (2.6)</h2>
<p>
To learn how to make Nimbus components behave differently (beyond
configuration), see the <a href="../plugins/index.html">Extensibility
@@ -24,6 +24,11 @@
</li>
<li>
<p>
+ <a href="#pilot-fake">Pilot development environment</a>
+ </p>
+ </li>
+ <li>
+ <p>
<a href="#change-wsdl">Changing the WSDL</a>
</p>
</li>
@@ -294,6 +299,94 @@
<br />
<br />
+<br />
+<a name="pilot-fake"> </a>
+<h2>Pilot development environment _NAMELINK(pilot-fake)</h2>
+
+<p>
+ The following steps will allow you to develop the <b>service</b> portion of the pilot setup without actually needing an LRM installed or hypervisors.
+</p>
+<ol>
+
+<li>
+ Activate the pilot plugin, copy "resource-locator-pilot.xml" to "resource-locator-ACTIVE.xml"
+</li>
+
+<li>
+ Edit that, add any string here (e.g. "fake") in order to activate SSH based notifications:
+<div class="screen">
+<pre><property name="sshNotificationInfo" value="fake" /></pre>
+</div>
+</li>
+
+<li>Edit "services/etc/nimbus/workspace-service/pilot.conf"
+<div class="screen">
+ pbs.submit.path=/tmp/fakeqsub
+ pbs.delete.path=/bin/true
+</div>
+</li>
+
+<li>
+Create "/tmp/fakeqsub"
+<div class="screen">
+#!/bin/sh
+sleep 3
+echo "asdsadasd" # This is the LRM job ID.
+</div>
+</li>
+
+<li>
+Edit "services/container-log4j.properties"
+<div class="screen">
+log4j.category.org.nimbustools=DEBUG
+log4j.category.org.globus.workspace=DEBUG
+</div>
+</li>
+
+<li>
+Edit "services/etc/nimbus/workspace-service/logging.conf"
+<div class="screen">
+log.state=on
+log.trace=on
+</div>
+
+Or in some cases you might even want to enable the scheduler logging in
+ "services/etc/nimbus/workspace-service/other/main.xml"
+<div class="screen">
+<pre><property name="scheduler" value="on" /></pre>
+</div>
+</li>
+
+<li>
+Start service in fake mode (edit "services/etc/nimbus/workspace-service/other/common.conf" )
+</li>
+
+<li>Start a vm with cloud client</li>
+
+<li>grep logs for "pilot command" and note the "-i" parameter, e.g. "1e372dca-de93-4fd9-a125-9d66842804cc". That is the SLOT ID assigned to the LRM job. If you are launching many pilots at once (i.e., a cluster of 50 VMs, but one LRM job), each pilot process will report back with the <b>same id</b> but different hostname.
+</li>
+
+<li>
+Simulate reserved notification:
+<div class="screen">
+./services/var/nimbus/msg-sinks/pilotnotifications write 1e372dca-de93-4fd9-a125-9d66842804cc+++localhost pilot-reserved 0 2010-11-07-16-12-01
+</div>
+<ul>
+ <li>
+ <p>arg1 ("1e372dca-de93-4fd9-a125-9d66842804cc+++localhost")</p>
+
+ <p>"1e372dca-de93-4fd9-a125-9d66842804cc" is slot id from service logs</p>
+ <p>"+++" is separator</p>
+ <p>"localhost" is hostname where pilot ended up running</p>
+ </li>
+
+ <li><p>arg2 state, e.g. pilot-reserved</p></li>
+ <li><p>arg3, return code, e.g. 0</p></li>
+ <li><p>arg4, timestamp, YYYY-MM-DD-HH-MM-SS (always UTC/GMT)</p></li>
+</ul>
+</li>
+
+</ol>
<br />
<a name="change-wsdl"> </a>

0 comments on commit 5136340

Please sign in to comment.