You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: documentation/md_testing.html
+6-5Lines changed: 6 additions & 5 deletions
Original file line number
Diff line number
Diff line change
@@ -135,9 +135,10 @@
135
135
</div><!--header-->
136
136
<divclass="contents">
137
137
<divclass="textblock"><p><aclass="anchor" id="autotoc_md93"></a> To run MFC's test suite, run </p><divclass="fragment"><divclass="line">./mfc.sh test -j <thread count></div>
138
-
</div><!-- fragment --><p>It will generate and run test cases, comparing their output to that of previous runs from versions of MFC considered to be accurate. <em>golden files</em>, stored in the <code>tests/</code> directory contain this data, by aggregating <code>.dat</code> files generated when running MFC. A test is considered passing when our error tolerances are met, in order to maintain a high level of stability and accuracy. Run <code>./mfc.sh test -h</code> for a full list of accepted arguments.</p>
138
+
</div><!-- fragment --><p>It will generate and run test cases, comparing their output to previous runs from versions of MFC considered accurate. <em>golden files</em>, stored in the <code>tests/</code> directory contain this data, aggregating <code>.dat</code> files generated when running MFC. A test is considered passing when our error tolerances are met in order to maintain a high level of stability and accuracy. Run <code>./mfc.sh test -h</code> for a full list of accepted arguments.</p>
139
139
<p>Most notably, you can consult the full list of tests by running </p><divclass="fragment"><divclass="line">./mfc.sh test -l</div>
140
-
</div><!-- fragment --><p>To restrict to a given range, use the <code>--from</code> (<code>-f</code>) and <code>--to</code> (<code>-t</code>) options. To run a (non-contiguous) subset of tests, use the <code>--only</code> (<code>-o</code>) option instead.</p>
140
+
</div><!-- fragment --><p>To restrict to a given range, use the <code>--from</code> (<code>-f</code>) and <code>--to</code> (<code>-t</code>) options. To run a (non-contiguous) subset of tests, use the <code>--only</code> (<code>-o</code>) option instead. To specify a computer, pass the <code>-c</code> flag to <code>./mfc.sh run</code> like so: </p><divclass="fragment"><divclass="line">./mfc.sh test -j <thread count> -- -c <computer name></div>
141
+
</div><!-- fragment --><p> where <code><computer name></code> could be <code>phoenix</code> or any of the others in the <ahref="https://github.com/MFlowCode/MFC/tree/master/toolchain/templates">templates</a>). You can create new templates with the appropriate run commands or omit this option. The use of <code>--</code> in the above command passes options to the <code>./mfc.sh run</code> command underlying the <code>./mfc.sh test</code>.</p>
141
142
<h2><aclass="anchor" id="autotoc_md94"></a>
142
143
Creating Tests</h2>
143
144
<p>To (re)generate <em>golden files</em>, append the <code>--generate</code> option: </p><divclass="fragment"><divclass="line">./mfc.sh test --generate -j 8</div>
<p>Finally, the case is appended to the <code>cases</code> list, which will be returned by the <code>list_cases</code> function.</p>
185
186
<h2><aclass="anchor" id="autotoc_md95"></a>
186
187
Testing Post Process</h2>
187
-
<p>To test updated post process code, append the <code>-a</code> or <code>--test-all</code> option: </p><divclass="fragment"><divclass="line">./mfc.sh test -a -j 8</div>
188
-
</div><!-- fragment --><p>This argument will re-run the test stack with <code>parallel_io=True</code>, which generates silo_hdf5 files. It will also turn most write parameters (<code>*_wrt</code>) on. Then, it searches through the silo files using<code>h5dump</code>to ensure that there are no NaNs or Infinitys. Although adding this option does not guarantee that accuratesilo files are generated, it does ensure that post process does not fail or produce malformed data. </p>
188
+
<p>To test the post-processing code, append the <code>-a</code> or <code>--test-all</code> option: </p><divclass="fragment"><divclass="line">./mfc.sh test -a -j 8</div>
189
+
</div><!-- fragment --><p>This argument will re-run the test stack with ‘parallel_io='T’<code>, which generates silo_hdf5 files. It will also turn most write parameters (</code>*_wrt<code>) on. Then, it searches through the silo files using</code>h5dump<code>to ensure that there are no</code>NaN<code>s or</code>Infinity<code>s. Although adding this option does not guarantee that accurate</code>.silo` files are generated, it does ensure that the post-process code does not fail or produce malformed data. </p>
0 commit comments