Search for: All records

The long-standing one-to-many problem of gold standard responses in open-domain dialogue systems presents challenges for automatic evaluation metrics. Though prior works have demonstrated some success by applying powerful Large Language Models (LLMs), existing approaches still struggle with the one-to-many problem, and exhibit subpar performance in domain-specific scenarios. We assume the commonsense reasoning biases within LLMs may hinder their performance in domain-specific evaluations. To address both issues, we propose a novel framework SLIDE (Small and Large Integrated for Dialogue Evaluation), that leverages both a small, specialized model (SLM), and LLMs for the evaluation of open-domain dialogues. Our approach introduces several techniques: (1) Contrastive learning to differentiate between robust and non-robust response embeddings; (2) A novel metric for semantic sensitivity that combines embedding cosine distances with similarity learned through neural networks, and (3) A strategy for incorporating the evaluation results from both the SLM and LLMs. Our empirical results demonstrate that our approach achieves state-of-the-art performance in both the classification and evaluation tasks, and additionally, the SLIDE evaluator exhibits a better correlation with human judgments. 

Organic trisradicals featuring three-fold symmetry have attracted significant interest because of their unique magnetic properties associated with spin frustration. Herein, we describe the synthesis and characterization of a triangular prism-shaped organic cage for which we have coined the name PrismCage6+ and its trisradical trication—TR3(•+). PrismCage6+ is composed of three 4,4'-bipyridinium dications and two 1,3,5-phenylene units bridged by six methylene groups. In the solid state, PrismCage6+ adopts a highly twisted conformation with close to C3 symmetry as a result of encapsulating one PF6− anion as a guest. PrismCage6+ undergoes stepwise reduction to its mono-, di- and trisradical cations in MeCN on account of strong electronic communication between its 4,4'-bipyridinium units. TR3(•+), which is obtained by reduction of PrismCage6+ employing CoCp2, adopts a triangular prism-shaped conformation with close to C2v symmetry in the solid state. Temperature-dependent continuous-wave and nutation frequency-selective EPR spectra of TR3(•+) in frozen N,N-dimethylformamide indicate its doublet ground state. The doublet-quartet energy gap of TR3(•+) is estimated to be −0.06 kcal mol−1 and the critical temperature of spin-state conversion is found to be ca. 50 K, suggesting that it displays pronounced spin-frustration at the molecular level. To the best of our knowledge, this example is the first organic radical cage to exhibit spin frustration. The trisradical trication of PrismCage6+ opens up new possibilities for fundamental investigations and potential applications in the fields of both organic cages and spin chemistry. 

Abstract A workshop on The Next Generation Gamma-Ray Source sponsored by the Office of Nuclear Physics at the Department of Energy, was held November 17-19, 2016 in Bethesda, Maryland. The goals of the workshop were to identify basic and applied research opportunities at the frontiers of nuclear physics that would be made possible by the beam capabilities of an advanced laser Compton beam facility. To anchor the scientific vision to realistically achievable beam specifications using proven technologies, the workshop brought together experts in the fields of electron accelerators, lasers, and optics to examine the technical options for achieving the beam specifications required by the most compelling parts of the proposed research programs. An international assembly of participants included current and prospective γ -ray beam users, accelerator and light-source physicists, and federal agency program managers. Sessions were organized to foster interactions between the beam users and facility developers, allowing for information sharing and mutual feedback between the two groups. The workshop findings and recommendations are summarized in this whitepaper.