This talk aim to present the use of some tensor decomposition methods in neural netwoks for frugality. Tensor decomposition can be used for compression neural networks but could also be used to grow neural networks at trainning time.