There are many tools to help make feature activations in Computer Vision interpretable by humans.
Class Activation Mapping [0] and Salience Maps are some of the most used and intuitive approaches. Lime and Shap [1] are tools to visually represent feature activation in an understandable way.
The idea that we have no idea what is going on with machine learning models is just flat out wrong.
Class Activation Mapping [0] and Salience Maps are some of the most used and intuitive approaches. Lime and Shap [1] are tools to visually represent feature activation in an understandable way.
The idea that we have no idea what is going on with machine learning models is just flat out wrong.
[0]http://cnnlocalization.csail.mit.edu/
[1]https://github.com/slundberg/shap
reply