Deep Learning Inside Out (DeeLIO) is the first workshop on knowledge extraction and integration for deep learning architectures. It aims to bring together the interpretation, extraction and integration lines of research, and cover the area in between. It will explore the introduction of external knowledge in deep learning models and representations, the types of linguistic and real-world knowledge neural nets encode, the extent to which this can be used for building resources, and whether this knowledge can be beneficial to them, by being re-integrated in the models, compared to external hand-crafted knowledge. Furthermore, the proposed workshop has a strong focus on structurally diverse languages with varying semantic-syntactic properties (going way beyond English) and low-data regimes. The workshop’s aim is also to inspire novel variation-aware transfer learning and multilingual solutions on how to use the knowledge from resource-rich languages (both extracted from large models as well as the knowledge from readily available repositories in the source language) to inform deep learning architectures where external repositories are scarce or missing. Unlike BlackboxNLP and other related initiatives, the focus of the DeeLIO workshop is on “deeper” lexico-semantic knowledge than can be recovered from or integrated into deep learning methods across a variety of languages. |