This paper studies non-parametric combinations of density forecasts. We introduce a regression tree-based approach that allows combination weights to vary on the features of the densities, time-trends or economic indicators. In two empirical applications, we show the benefits of this approach in terms of improved forecast accuracy and interpretability.