Conference PaperWTR: A Test Collection for Web Table RetrievalChen, Zhiyu; Zhang, Shuo; Davison, Brian D.nullWe describe the development, characteristics and availability of a test collection for the task of Web table retrieval, which uses a large-scale Web Table Corpora extracted from the Common Crawl. Since a Web table usually has rich context information such as the page title and surrounding paragraphs, we not only provide relevance judgments of query-table pairs, but also the relevance judgments of query-table context pairs with respect to a query, which are ignored by previous test collections. To facilitate future research with this benchmark, we provide details about how the dataset is pre-processed and also baseline results from both traditional and recently proposed table retrieval methods. Our experimental results show that proper usage of context labels can benefit previous table retrieval methods.2021-07-1110279625Proceedings of 44th International ACM SIGIR Conference on Research and Development in Information Retrieval2514 to 2520https://doi.org/10.1145/3404835.34632601816325National Science Foundation