Add Out-of-Core option

Add MORSE_Desc_Create_OOC, which is like MORSE_Desc_Create, but does not actually allocate a matrix, thus letting the runtime allocate on-demand the tiles, possibly pushing them to the disk.

Add a --ooc option to tests to enable this.

The commit is meant for applications to be able to decide which matrix is OOC and which is not, and make tests enable it or not.

This is mostly to open the discussion about how it could look like. This commit is enough to start playing with it by setting STARPU_DISK_SWAP* environment variables. We may want to make the RAM limit set by the option, or set automatically by chameleon, or something else.

added 1 commit

• d974e89b - Check the tiles sizes for OOC

Compare with previous version

There is no need for new tests, the existing tests will already get the new --ooc and --noooc options. All one needs to do to test OOC is setting e.g. export STARPU_DISK_SWAP=/tmp export STARPU_DISK_SWAP_BACKEND=unistd_o_direct export STARPU_LIMIT_CPU_MEM=1024 and passing the --ooc option

@fpruvost Wait for this issue. We are discussing about it, because it has to be reshaped to take into account @sylvand descriptor and out-of-core descriptor together to see if we can avoid the multiplication of specific descriptors.

added 106 commits

• d974e89b...c3b46563 - 104 commits from branch solverstack:master
• 8082e601 - Add Out-of-Core option
• 0e79b22b - Check the tiles sizes for OOC

Compare with previous version

added 1 commit

• 68c516a4 - Some cleanup/factorization in descriptor.c

Compare with previous version

On my side, I'm ok with it. After discussion with Sam it is not handled the way I thought and it cannot be merge with things already done previously.

added 1 commit

• 717c1db6 - Minor on documentation

Compare with previous version

added 19 commits

• 717c1db6...24263d4c - 13 commits from branch solverstack:master
• a38dac3c - Silent warning from morse_tune when autotuning is disabled
• a0741640 - Forces a default for NB and IB in testing to avoid warnings linked to morse_tune
• 921ecb3d - Add Out-of-Core option
• a7b39c2f - Check the tiles sizes for OOC
• 3b3288d9 - Some cleanup/factorization in descriptor.c
• 02cf845e - Minor on documentation

Compare with previous version

I forced the rebase of this branch on top of the pull request !37 (merged) (So !37 (merged) needs to be merged first)

added 7 commits

• 94cf0fb4 - 1 commit from branch solverstack:master
• 3e6305c6 - Add Out-of-Core option
• 85cbb1a2 - Check the tiles sizes for OOC
• e427eecb - Some cleanup/factorization in descriptor.c
• 14ffa8ef - Minor on documentation
• 9b177ce0 - Add missing const to error/warning messages
• 0e6d45c1 - Add a new OOC_User function and simplifies OOC

Compare with previous version

enabled an automatic merge when the pipeline for 0e6d45c1 succeeds

merged

mentioned in commit d6cf7cb1