Software
DRIBO: Robust Deep Reinforcement Learning via Multi-View Information Bottleneck
- A new multi-view information bottleneck (MIB) objective that maximizes the mutual information between sequences of observations and sequences of representations while reducing the task-irrelevant information identified through the multi-view observations.
- State-of-the-art results on the DeepMind Control Suite (with videos playing in the background as visual distractors) and the Procgen Benchmark (in terms of the performance of generalizing the learned policy to unseen levels).
- Github link: https://github.com/BU-DEPEND-Lab/DRIBO
- Related publication:
- Jiameng Fan and Wenchao Li. DRIBO: Robust Deep Reinforcement Learning via Multi-View Information Bottleneck. The 39th International Conference on Machine Learning (ICML), 2022 (to appear).
AdvIBP: Certified Adversarial Training by Combining Adversarial Training and Provable Robustness Verification in a Principled Way
- State-of-the-art verified (certified) error on MNIST and CIFAR: for MNIST, 6.60% at epsilon=0.3 and 12.30% at epsilon=0.4 (for L_infinity norm perturbations); and for CIFAR, 66.57% at epsilon=8/255 and 76.05% at epsilon=16/255 (also for L_infinity norm perturbations).
- Github link: https://github.com/BU-DEPEND-Lab/AdvIBP
- Related publication(s):
- Jiameng Fan and Wenchao Li. Adversarial Training and Provable Robustness: A Tale of Two Objectives. The 35th AAAI Conference on Artificial Intelligence (AAAI), February 2021.
ReachNN*: Reachability Analysis Tool of Neural Network Controlled Systems (NNCSs)
- ReachNN* uses Bernstein polynomials to approximate neural networks with general types of activation functions. It also offers a feature to automatically retrain a verification-friendly network.
- Github link: https://github.com/BU-DEPEND-Lab/ReachNNStar
- Related publication(s):
- Jiameng Fan, Chao Huang, Xin Chen, Wenchao Li and Qi Zhu. ReachNN*: A Tool for Reachability Analysis ofNeural-Network Controlled Systems. The 18th International Symposium on Automated Technology for Verification and Analysis (ATVA), October 2020.
- C.Huang, J.Fan, W.Li, X.Chen, and Q.Zhu. ReachNN: Reachability Analysis of Neural-Network Controlled Systems. ACM Transactions on Embedded Computing Systems (TECS), 18:1–22, October 2019.
- J.Fan, C.Huang, W.Li, X.Chen, and Q.Zhu. Towards Verification-Aware Knowledge Distillation for Neural-Network Controlled Systems. International Conference on Computer Aided Design (ICCAD), November 2019.