Machine learning (ML) and reinforcement learning algorithms are making it possible to uncover new insights from the EHR and related observational datasets. This area of research aims to develop and apply new techniques to characterize and detect disease and to optimize actions. Issues related to how to systematically capture these insights in models and properly evaluate their efficacy are studied.