optimal params for training

[vinnitu]

I trying to build model on data in your code but I have limited memory on my GPU (8G on GTX 1080)

What best options to use this device?

Now I limited dataset from 15.437.674 to 5.000.000 lines
My ~/.theanorc

[global]
floatX = float32
device = gpu0

[nvcc]
fastmath = True

[lib]
cnmem = .9

but what about program options, now I have such

NUMBER_OF_ITERATIONS = 10000 # 20000
EPOCHS_PER_ITERATION = 1 # 5
RNN = recurrent.LSTM
INPUT_LAYERS = 2
OUTPUT_LAYERS = 2
AMOUNT_OF_DROPOUT = 0.3
BATCH_SIZE = 500
HIDDEN_SIZE = 700
INITIALIZATION = "he_normal" # : Gaussian initialization scaled by fan_in (He et al., 2014)
MAX_INPUT_LEN = 40
MIN_INPUT_LEN = 3
INVERTED = True
AMOUNT_OF_NOISE = 0.2 / MAX_INPUT_LEN
NUMBER_OF_CHARS = 100 # 75
CHARS = list("abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ .")

What can you advice me?

Thank you for any help.