### Code

See readme in the packages for installation and usage.

**
**

Proximal Mapping for Deep Regularization | ||

[GitHub] | ||

Certified Robustness of Graph Convolution Networks for Graph Classification under Topological Attacks | ||

[GitHub] | ||

Generalised Lipschitz Regularisation Equals Distributional Robustness | ||

[GitHub] | ||

Generalized Conditional Gradient (GCG) | ||

[link] | ||

GCG is an open source Matlab solver for gauge (norm) regularized problems, that are commonly used in sparse coding and compressive sensing. Examples include matrix completion, dictionary learning, and structured sparse estimation. | ||

Smoothing for
Multivariate Scores (SMS) |
||

[link] |
||

SMS is an open source, extensible and scalable convex solver for a number of machine learning problems cast in the form of regularized risk minimization problem. It is particularly advantageous for optimizing multivariate performance measure. The implementation is "extensible" because the (problem-specific) loss function modules are encapsulated with a common interface for the main optimizer. Thus it is very simple to incorporate solutions to new problems. | ||

Convex Subspace Learning |
||

[link] |
||

This Matlab package implements the convex subspace learning model proposed at NIPS'12 and AAAI'12. The optimization is based on alternating direction of multiplier method. Example applications include semi-supervised learning, image denoising, and multi-label learning. | ||

Bayesian
Online Multilabel Classification (BOMC) |
||

[link] |
||

BOMC is an open source toolkit for
online multilabel classification using Bayesian models. It is
implemented in F# 1.9.3.4 on Microsoft Visual Studio 2008, and can be
compiled and run on Linux systems via Mono. The graphical model is
extend from TrueSkill^{TM} [2] to deal with
multilabel, and the inference engine is expectation propagation. |
||

Conditional Random Fields
for Policy Gradient Multi-agent Reinforcement Learning |
||

[tar.bz2
700 KB] [paper] |
||

This package implements the tree sampling for inference in conditional random fields. With the sampled states and approximate expectations, the package implements the natural actor-critic which performs collaborative multi-agent reinforcement learning. Three simulators are provided namely grid gate control, sensor network, and traffic light control. | ||

Faster Rates for Training
SVMs using Optimal Gradient based Methods |
||

[tar.bz2 800
KB] [paper] |
||

This package implements the three
versions of Nesterov's first-order methods proposed in
1983,
2005 and
2007. Its rate of convergence is O(1/k^2), which is
proved to be optimal in this class of optimizers. The 1983
version optimizes a smooth function with Lipschitz continuous
gradient. The 2005 version extends to the primal-dual
setting, and the 2007 version can automatically estimate the unknown
Lipschitz constant of the gradient.
This code is built upon the package BMRM. |
||

Hyperparameter
Learning for Graph based Semi-supervised Learning Algorithms |
||

[tar
100 KB] [paper] |
||

This package implements the
leave-one-out method for learning the hyperparameters in graph based
semi-supervised learning. Practical efficiency is achieved
via the Sherman–Morrison formula and by facting out the common terms in
feature weight updates.
This code relies on the math library of Matlab. See this link for details. |

I am collecting some tricks in coding for machine learning. Coming soon.

I am also polishing some code for massaging datasets. Mostly written in C++ for handling large datasets.