Underrated But Fascinating ML Concepts #5 – CST, PBWM, SARSA, & Sammon Mapping

There are a few exciting machine learning concepts that do not receive nearly enough attention. Let's look at Constructing skill trees, Prefrontal cortex basal ganglia working memory, State–action–reward–state–action, and Sammon mapping. Constructing Skill Trees Constructing skill trees (CST) is a hierarchical reinforcement learning technique that can create skill trees from a series of example solution trajectories gathered through demonstration. CST segments each demonstration route into skills and integrates the results into a skill tree using an incremental MAP (maximum a posteriori) change point detection technique. It uses a changepoint detection algorithm to partition each trajectory into a skill chain by recognising a suitable abstraction change or a segment too compl