Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Recurso digital |
| Language: | |
| Published: |
Zenodo
2025
|
| Online Access: | https://doi.org/10.5281/zenodo.14889726 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Table of Contents:
- <h2>What's Changed</h2> <ul> <li>add timestamp to workflow by @rsriya in https://github.com/XENONnT/outsource/pull/192</li> <li>Transfer data to local after processing by @dachengx in https://github.com/XENONnT/outsource/pull/194</li> <li>Download log of jobs by @dachengx in https://github.com/XENONnT/outsource/pull/196</li> <li>Untar outpus if transferred to local by @dachengx in https://github.com/XENONnT/outsource/pull/197</li> <li>Check if there is no crucial user installed package by @dachengx in https://github.com/XENONnT/outsource/pull/198</li> <li>Upload miscellaneous information to DB by @dachengx in https://github.com/XENONnT/outsource/pull/199</li> <li>Ignore processed data while processing by @dachengx in https://github.com/XENONnT/outsource/pull/200</li> <li>Download <code>raw_records*</code> from only <code>raw_records_rse</code> by @dachengx in https://github.com/XENONnT/outsource/pull/201</li> <li>Use dependency tree for instruction of processing by @dachengx in https://github.com/XENONnT/outsource/pull/202</li> <li>[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/XENONnT/outsource/pull/204</li> <li>Limit the number CPU usage of JAX and TensorFlow by @dachengx in https://github.com/XENONnT/outsource/pull/209</li> <li>Optimize the order of data_types in processing by @dachengx in https://github.com/XENONnT/outsource/pull/210</li> <li>Clearly list the <code>data_type</code> to process when submitting job by @dachengx in https://github.com/XENONnT/outsource/pull/211</li> <li>If self-installed package, do not upload to rucio by @dachengx in https://github.com/XENONnT/outsource/pull/212</li> <li>Set environmental variable of CPUs usage for all jobs by @dachengx in https://github.com/XENONnT/outsource/pull/213</li> <li>Still need local sites even if do not transfer to local by @dachengx in https://github.com/XENONnT/outsource/pull/214</li> <li>Set defualt <code>dagman_maxjobs</code> to be 5000 by @dachengx in https://github.com/XENONnT/outsource/pull/215</li> <li>Fix $lte for single run by @shenyangshi in https://github.com/XENONnT/outsource/pull/217</li> <li>Ask reporter to include the <code>Outsource</code> section of <code>XENON_CONFIG</code> by @dachengx in https://github.com/XENONnT/outsource/pull/222</li> <li>Forbid using development container by @dachengx in https://github.com/XENONnT/outsource/pull/221</li> <li>No per-chunk processing of MV by @dachengx in https://github.com/XENONnT/outsource/pull/223</li> <li>Force renew <code>.dbtoken</code> before workflow submission by @dachengx in https://github.com/XENONnT/outsource/pull/224</li> <li>Limit the filename in 255 characters by @dachengx in https://github.com/XENONnT/outsource/pull/226</li> <li>Allow staging-out lower <code>data_types</code> and keeping downloaded <code>raw_records*</code> by @dachengx in https://github.com/XENONnT/outsource/pull/228</li> <li>Decide whether the dependency exists based on specified RSE by @dachengx in https://github.com/XENONnT/outsource/pull/229</li> <li>Add script to test the resources usage: memory, time, storage by @dachengx in https://github.com/XENONnT/outsource/pull/230</li> <li>Automatically assign resources by @dachengx in https://github.com/XENONnT/outsource/pull/231</li> <li>Fix bug when multiple json files exists by @dachengx in https://github.com/XENONnT/outsource/pull/232</li> <li>Keep the folder being tarred by @dachengx in https://github.com/XENONnT/outsource/pull/233</li> <li>Stage out lower, combine or upper level outputs by @dachengx in https://github.com/XENONnT/outsource/pull/234</li> <li>List a directory in DAV by @dachengx in https://github.com/XENONnT/outsource/pull/235</li> <li>FIx bug that non-LED <code>data_types</code> is not filtered out in LED mode by @dachengx in https://github.com/XENONnT/outsource/pull/236</li> <li>Assign the resources usage of LED calibration by @dachengx in https://github.com/XENONnT/outsource/pull/237</li> <li>Allow multiple <code>raw_records*</code> RSEs by @dachengx in https://github.com/XENONnT/outsource/pull/238</li> <li>Set same requirements for lower level and combine jobs by @dachengx in https://github.com/XENONnT/outsource/pull/239</li> <li>Only extract input and output folders by @dachengx in https://github.com/XENONnT/outsource/pull/240</li> <li>Prioritize the first assign RSE by @dachengx in https://github.com/XENONnT/outsource/pull/241</li> <li>Allow multiple per-chunk processing by @dachengx in https://github.com/XENONnT/outsource/pull/242</li> <li>Small updates and fixes by @cfuselli in https://github.com/XENONnT/outsource/pull/244</li> <li>Change logic for EU sites by @cfuselli in https://github.com/XENONnT/outsource/pull/245</li> <li>Print locations of <code>raw_records*</code> by @dachengx in https://github.com/XENONnT/outsource/pull/243</li> <li>Lower memory usage of lower level processing by @dachengx in https://github.com/XENONnT/outsource/pull/246</li> <li>Revert part of #244 and #245 by @dachengx in https://github.com/XENONnT/outsource/pull/247</li> <li>Set special memory usage for LED calibration runs by @dachengx in https://github.com/XENONnT/outsource/pull/249</li> <li>Add constraint for <code>SURFSARA2_USERDISK</code> by @dachengx in https://github.com/XENONnT/outsource/pull/250</li> <li>Set lowest disk requirement as 200MB by @dachengx in https://github.com/XENONnT/outsource/pull/251</li> <li>Update memory usage of upper level jobs by @dachengx in https://github.com/XENONnT/outsource/pull/252</li> <li>Save lineage of data_types in <code>summary.json</code> by @dachengx in https://github.com/XENONnT/outsource/pull/253</li> <li>Copy <code>.xenon_config</code> to avoid its change after the job submission by @dachengx in https://github.com/XENONnT/outsource/pull/254</li> <li>Remove "download" jobs because they are not used by @dachengx in https://github.com/XENONnT/outsource/pull/255</li> <li>Add option to first stage the rucio files then download by @dachengx in https://github.com/XENONnT/outsource/pull/256</li> <li>Piecewise function for NV disk usage by @dachengx in https://github.com/XENONnT/outsource/pull/257</li> <li>Add suffix of combine and untar jobs by @dachengx in https://github.com/XENONnT/outsource/pull/258</li> <li>Piecewise function for NV disk usage again by @dachengx in https://github.com/XENONnT/outsource/pull/259</li> <li>Update memory usage of NV data by @dachengx in https://github.com/XENONnT/outsource/pull/260</li> <li>Copy local files to workflow folder to avoid overwritten by @dachengx in https://github.com/XENONnT/outsource/pull/261</li> <li>First <code>dagman_static_retry</code> retries will use the same resources by @dachengx in https://github.com/XENONnT/outsource/pull/262</li> <li>Bump version: 0.4.0 → 0.4.1 by @dachengx in https://github.com/XENONnT/outsource/pull/263</li> </ul> <h2>New Contributors</h2> <ul> <li>@pre-commit-ci made their first contribution in https://github.com/XENONnT/outsource/pull/204</li> <li>@shenyangshi made their first contribution in https://github.com/XENONnT/outsource/pull/217</li> <li>@cfuselli made their first contribution in https://github.com/XENONnT/outsource/pull/244</li> </ul> <p><strong>Full Changelog</strong>: https://github.com/XENONnT/outsource/compare/v0.4.0...v0.4.1</p>