dynet modifications



Modifications between v1.19 and v1.22

Version 1.22 is completely compatible with all files (in particular specfiles, temporal pattern files and weight files) from version 1.19.

1. Missing values in the external inputs of the temporal pattern files now trapped by dynet if they are written as "x" or "X". Note that dynet cannot cope with missing values, but this modification means that dynet exists graciously rather than crashing. External epochs at final epoch are not used by dynet, and do not now have to be specified. Before you had to give them a numeric value anyway, but now you can use the "no data" symbol, "x" or "X".

2. The dynetsubs.c program has been rearranged and renamed netsubs.c (as it is general to more than just dynet) and the stuff in dynet.h specific to netsubs.c has been put into the new file netsubs.h. The subroutine wderr() has also been moved from netsubs.c to dynet.c.

3. Default beta changed from 1 to 6.0. This is roughly a 10% error when using variance scaling.

4. Default alpha_HY changed from 0.04 to 0.0, i.e. no regularisation on the hidden-output weights.

5. If using scaling and all inputs or state variables are the same for a given node, then standard deviation is forced to 1.0 to avoid divide by zero in datascale(). Although this error was trapped previously, dynet did not allow you to proceed.

6. The option "MAC:convergence_tolerance_gradient" is now used to specify the convergence tolerance *gradient* rather than the square of the gradient. However, the old version, "MAC:convergence_tolerance" is retained for backwards compatibility.

7. Set a few more defaults and trapped a few more non-set parameters in specfile.

8. Error training file (.err file) bug corrected so that it doesn't write a bogus first line and that it does always report the final error and gradient.

9. Minor improvements to the manual, and the addition of two new sections, "Tips on using dynet" and "Modifications since the previous release version".


Return to the dynet page.


Coryn Bailer-Jones, calj at mpia-hd.mpg.de
Last modified: 2 March 1999