Paper: Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K. R., & Samek, W. (2015). On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLOS ONE. [PDF]

Overview

Read more »

Paper: Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimization. [PDF]

Overview

Read more »

Paper: Koh, P. W., Nguyen, T., Tang, Y. S., Mussmann, S., Pierson, E., Kim, B., & Liang, P. (2020). Concept Bottleneck Models. In Proceedings of the 37th International Conference on Machine Learning (ICML 2020). [PDF]

Overview

Concept Bottleneck Models (CBMs) are a novel neural network architecture proposed to address the “black box” problem in deep learning. The core idea is to introduce an intermediate layer of human-interpretable concepts between the input and the final prediction, making the model’s decision process transparent and explainable.

Read more »

Paper: Gao, Y., Sun, T., Zhao, L., & Hong, S. (2022). Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignment. [PDF]

Overview

This paper addresses a critical flaw in CNN predictions: spurious correlations. The authors propose the Reasonability Matrix and the GRADIA algorithm as solutions, enabling human experts to interactively correct model attention through visual annotations.

Read more »

Paper: Kim, C., Gadgil, S. U., DeGrave, A. J., Omiye, J. A., Cai, Z. R., Daneshjou, R., & Lee, S.-I. (2024). Transparent Medical Image AI via an Image-Text Foundation Model Grounded in Medical Literature. In Nature Medicine. [PDF]

Overview

MONET (Medical Concept Retriever) is an improved version of OpenAI’s CLIP model, specifically designed as a medical concept extractor. It assigns interpretable concept scores to medical images and enables transparent AI diagnosis through Concept Bottleneck Models (CBMs).

Read more »

Overview: Machine learning is not a monolithic field—it's a diverse ecosystem of approaches, each defined by a fundamental question: Who is the teacher? This post explores the taxonomy of machine learning, organizing the field based on the nature of supervision signals.
Read more »

Paper: Bau, D., Zhu, J.-Y., Strobelt, H., Lapedriza, A., Zhou, B., & Torralba, A. (2020). Understanding the Role of Individual Units in a Deep Neural Network. In Proceedings of the National Academy of Sciences (PNAS). [PDF]

Overview

This paper investigates how individual neurons in deep neural networks encode semantic concepts. The core finding: whether in CNNs (for recognition) or GANs (for generation), interpretable mechanisms emerge spontaneously—individual units become carriers of specific semantic concepts.

Read more »

Welcome! I'm Zion Peng, a researcher passionate about implementing effective, high-reliability machine learning methods to address real-world problems. This is my personal academic homepage where I share research updates, technical notes, and professional growth.
Read more »
0%