use memory of GPU for a process

[hainguyenct]

Hello everyone,
I have 2 GPUs with 12GB RAM for each. I would like to run a process which is able to use RAM of both 2GPU (for example, I need to run a process which needs 20GB of memory).
If you have information on this, please help me.
Thank you so much

[wanghechong]

do you solve the problem?
@hainguyenct

[VincentSC]

You cannot just sum the GPU-memories. Between the GPUs there needs to be data-sharing, which often goes via the PCI-bus. But Torch solves this differently.

First split your training-data in 2 sets, as you can merge the training data results. See torch/cutorch#42 for some pseudo code.

[hainguyenct]

Hi @wanghechong , I converted my code to Keras which supported with multi-GPUs