LSTM Recurrent Neural Network (RNN):
LSTM with Forget Gates and Peephole Connections
(still Quick-and-Dirty, but compiles under gcc version 4.1.0):
LSTM.tgz.
LSTM Latex Pseudo Code:
LSTM-FgPH-PseudoCode.tex,
LSTM-FgPH-PseudoCode_twopage.tex
Feed-Forward Neural Network (FFN, FNN, NN, MLP):
FFN implementing Back-Propagation (BP) with Momentum.
The network is based on a Masked-Matrix C++ class
to switch on/off=grow/prune connections in the network.
C++ source:
FNN + Masked Matrix.
This package also includes a simple Bayes-Feature detector
(not tested and maintained for some time).
Masked Matrix Class:
The FNN above is bases on this Matrix C++ class and Masked-Matrix class.
The matrix class includes all basic matrix
operations (scalar-matrix, vector-matrix, matrix-matrix):
FNN + Masked Matrix .
CoDi Cellular Automata (CA):
X11 Simulator based directly on Xlib
CoDi.tgz.
See the
Codi Java applet, download:
Java-Source.
Cluster:
XCluster: A X11 GUI
(based on motif or lesstif (for Linux), which is open-source)
for clustering algorithms
(k-means and some of my own inventions are included).
It is easy to add you own clustering
algo, load data and see what it is doing.
The package also contains an executable for Linux:
XCluster.tgz.
Chaos:
Cobweb (Cobweb.tgz)
and
BifurcationDiagram (BifurcationDiagram.tgz),
Qt - KDE based visualization for the one-dimensional
(sometimes chaotic) logistic map.
The two dimensional diagram for the Henon map
(Henon.tgz).
All in one: chaos.tgz.
Unix Shell Scrips:
Built a Cross Compilor with gcc
for the Target Architecture: MIPS SGI IRIX6:
build-cross-compiler.sh
Backup (burn) your home-directory
encrypted (twofish) on a CD/DVD:
secure_backup.sh
Create an encrypted directory
(with twofish, blowfish, etc.) to be (un-)mountable for a common user:
cryptdir.sh
Create an index.html that mimics the web server
directory index:
make_dir_index.sh
ActionScript 2.0 / Flash MX 2004
OOP Example:
oop.zip
Four Regions Task (thanks to Nic Schraudoiph)
4regions.tgz:
2-dimensional set with local (one-hot) output encoding
with 10201 Train and and 10201 Test points and C code.
Two Spirals
twsp.tgz:
2-dimensional set with 192 Train and 192 Test points and C code.
Time Series
Embedded Reber Grammar
E_Reber.tgz:
Test and Train sets with 500 strings each, encoded locally
with 7 inputs and 7 outputs.
Mackey Glass Time Series (Train and Test):
mackey-glass.tgz:
One-dimensional set with 3100 Train and 600 Test points.
Santa Fe FIR laser emission series, Set A (Train and Test):
A.tgz:
One-dimensional set with 1000 Train and 100 Test points.
LICENSE
THESE PROGRAMS ARE GRANTED FREE OF CHARGE FOR RESEARCH AND EDUCATION
PURPOSES. FOR COMMERCIAL PURPOSES, HOWEVER, A LICENSE FROM THE AUTHOR
IS NECESSARY.
SCIENTIFIC RESULTS PRODUCED USING THE SOFTWARE PROVIDED SHALL
ACKNOWLEDGE THE USE OF THE SOFTWARE BY CITING THE ACCORDING PAPERS.
THE SOFTWARE MUST NOT BE MODIFIED AND DISTRIBUTED WITHOUT PRIOR
PERMISSION OF THE AUTHOR.
BY USING THE SOFTWARE YOU AGREE TO THE LICENSING TERMS.
NO WARRANTY
BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY
FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT
WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER
PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND,
EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE
PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME
THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR
REDISTRIBUTE THE PROGRAM, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF
THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO
LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY
YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY
OTHER PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED
OF THE POSSIBILITY OF SUCH DAMAGES.