text: There could be an interesting idea here,  but the limitations and applicability of the proposed approach are not clear yet.  More analysis should be done to clarify its potential.  Besides, the paper seriously needs to be reworked.  The text in general, but also the notation, should be improved. In my opinion, the authors should explain how to apply their algorithm to more general network architectures, and test it, in particular to convnets.  An experiment on a modern dataset beyond MNIST would also be a welcome addition. Some comments:- The method is present as a fully-connected network training procedure.  But the resulting network is not really fully-connected, but modular.  This is clear in Fig. 1 and in the explanation in Sect. 3.1.  The newly added hidden neurons at every iteration do not project to the previous pool of hidden neurons.  It should be stressed that the networks end up with this non-conventional “tiled” architecture.  Are there studies where the capacity of such networks is investigated, when all the weights are trained concurrently. - It wasn’t clear to me whether the memory reallocation could be easily implemented in hardware.  A few references or remarks on this issue would be welcome. - The work “Efficient supervised learning in networks with binary synapses” by Baldassi et al. (PNAS 2007) should be cited.  Although usually ignored by the deep learning community, it actually was a pioneering study on the use of low resolution weights during inference while allowing for auxiliary variables during learning. - Coming back my main point above, I didn’t really get the discussion on Sect. 5.3.  Why didn’t the authors test their algorithm on a convnet?  Are there any obstacles in doing so?  It seems quite important to understand this point,  as the paper appeals to technical applications and convolution seems hard to sidestep currently. - Fig. 3: xx-axis: define storage efficiency and storage requirement. - Fig. 4: What’s an RSBL?  Acronyms should be defined. - Overall, language and notation should really be refined.  I had a hard time reading Algorithm 1,  as the notation is not even defined anywhere.  And this problem extends throughout the paper. For example, just looking at Sect. 4.1, “training and testing data x is normalized…”, if x is not properly defined, it’s best to omit it;   “… 2-dimentonal…”, at least major typos should be scanned and corrected.