skip to main content

Title: The most efficient sequence of study depends on the type of test

Across three experiments featuring naturalistic concepts (psychology concepts) and naïve learners, we extend previous research showing an effect of the sequence of study on learning outcomes, by demonstrating that the sequence of examples during study changes the representation the learner creates of the study materials. We compared participants' performance in test tasks requiring different representations and evaluated which sequence yields better learning in which type of tests. We found that interleaved study, in which examples from different concepts are mixed, leads to the creation of relatively interrelated concepts that are represented by contrast to each other and based on discriminating properties. Conversely, blocked study, in which several examples of the same concept are presented together, leads to the creation of relatively isolated concepts that are represented in terms of their central and characteristic properties. These results argue for the integrated investigation of the benefits of different sequences of study as depending on the characteristics of the study and testing situation.

more » « less
Award ID(s):
Author(s) / Creator(s):
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Applied Cognitive Psychology
Page Range / eLocation ID:
p. 82-97
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Cross‐task generalization is a significant outcome that defines mastery in natural language understanding. Humans show a remarkable aptitude for this, and can solve many different types of tasks, given definitions in the form of textual instructions and a small set of examples. Recent work with pre‐trained language models mimics this learning style: users can define and exemplify a task for the model to attempt as a series of natural language prompts or instructions. While prompting approaches have led to higher cross‐task generalization compared to traditional supervised learning, analyzing ‘bias’ in the task instructions given to the model is a difficult problem, and has thus been relatively unexplored. For instance, are we truly modeling a task, or are we modeling a user's instructions? To help investigate this, we develop LINGO, a novel visual analytics interface that supports an effective, task‐driven workflow to (1) help identify bias in natural language task instructions, (2) alter (or create) task instructions to reduce bias, and (3) evaluate pre‐trained model performance on debiased task instructions. To robustly evaluate LINGO, we conduct a user study with both novice and expert instruction creators, over a dataset of 1,616 linguistic tasks and their natural language instructions, spanning 55 different languages. For both user groups, LINGO promotes the creation of more difficult tasks for pre‐trained models, that contain higher linguistic diversity and lower instruction bias. We additionally discuss how the insights learned in developing and evaluating LINGO can aid in the design of future dashboards that aim to minimize the effort involved in prompt creation across multiple domains.

    more » « less
  2. Harmata, Michael (Ed.)
    Several years ago, a small family of diterpenoid natural products attracted our attention as novel targets for synthesis studies. Initially, four compounds were independently characterized by the research teams of Vidari1 and Steglich.2 Trichoaurantianolides AeD (1e4 of Fig. 9.1) were isolated from fruiting bodies of the mushrooms Tricholoma aurantium and Tricholoma fracticum in 1995. Subsequent efforts of Stermer and coworkers3 described the isolation of the closely related lepistal (5) and lepistol (6) of Fig. 9.2 as the corresponding C8 deoxygenated compounds of this family. In addition, the corresponding acetate of trichoaurantianolide B was discovered and named as 6-O-aetyl- trichoaurantin (7).2 Structure assignments were based upon extensive nuclear magnetic resonance (NMR) studies, and the features of relative stereo- chemistry were confirmed by an X-ray crystallographic analysis of trichoaurantianolide B (2).1b,2 These original investigators described the trichoaurantianolides as examples of a new class of diterpenes named as neodolastanes that signified a structural relationship to the tricyclic metabo- lites of marine origins known as dolastanes as represented by dolatriol (8)4 and the clavularane 95 of Fig. 9.2. Neodolastanes were defined as substances in which the bridgehead methyl substituent appears in a vicinal relationship with respect to the isopropyl group as exemplified in 4,5-deoxyneodolabelline (10) of Fig. 9.2, a related class of marine natural products.6 Steglich and coworkers2 also indicated an assignment of absolute stereo- chemistry for 2 that was based on Hamilton’s applications of linear-hypothesis testing of crystallographic data. This seldom-used technique was in agreement with the proposed absolute configuration of 2 that was advanced by Vidari, based on an assessment of the observed Cotton effects in CD spectroscopy. In 2003, Ohta and coworkers7 reported the discovery of related neodolastanes tricholomalides A, B, and C (structures 11, 12, and 13 of Fig. 9.3) from Tricholoma sp. They concluded that the tricholomalides possessed the opposite absolute configuration claimed for the trichoaurantianolides. This conclusion was based upon the independent analysis of their circular dichroism studies. By application of the octant rule for substituent effects on cisoid a,b- unsaturated ketones,8 Ohta and coworkers suggested a revision of the prior assignment of absolute configuration for the trichoaurantianolides. This asser- tion was advanced in spite of the consistently positive specific rotations recorded in different solvents for trichoaurantianolides A, B, and C1,2 versus the negative values of tricholomalides A (11) and B (12) (compare values in Figs. 9.1 and 9.3). Note that tricholomalide C (13) only differs from trichoaurantianolide B (2) as a C-8 diastereomeric alcohol, presented in the antipodal series. The specific rotation of 13 was of little value since it was recorded as [a]0 (c 0.01, MeOH).7 In 2006, Danishefsky described a pathway for the total synthesis of racemic tricholomalides A and B, and this effort led to a revision of the relative C-2 stereochemistry (Fig. 9.3; revised structures 14 and 15).9 It seemed rather unusual that genetically similar fungi would produce closely related metabolites as enantiomers, but certainly this is not unprecedented. As a starting point, this issue lacked clarity, and we concluded that our synthesis plans must unambig- uously address the issues of absolute configuration. The chemistry of dolabellane and dolastane diterpenes has been reviewed.10 The proposed pathway for biosynthesis of the trichoaurantianolides and related compounds (Fig. 9.4) follows an established sequence from geranyl- geranyl pyrophosphate (16), which undergoes p-cation cyclization to initially form the eleven-membered ring of 17. The event is followed by a second cyclization to form the dolabellane cation 18, and this [9.3.0]cyclotetradecane skeleton is central to several families of natural products. Direct capture or elimination from 18 leads to the 3,7-dolabelladiene 19, which presents the most common pattern of unsaturation within this class. Compounds within this group are traditionally numbered beginning with C-1 as the bridgehead carbon bearing the methyl group rather than following the connectivity presented in ger- anylgeranyl 16. The cation 18 also undergoes a 1,2-hydrogen migration and elimination, which leads to a transannular cyclization yielding the 5e7e6 tri- cyclic dolastane 20. The secodolastanes, represented by 21, are a small collec- tion of marine natural products, which arise from oxidative cleavage of C10eC14 in the parent tricycle 20. In analogous fashion, the neodolabellane structure 22 is produced from 18 by stereospecific backbone migrations that result in the vicinal placement of the bridgehead methyl and isopropyl substituents. Transannular cyclizations, stemming from 22, yield the class of neodolastane diterpenes (23). Trichoaurantianolides and the related lepistal A (5) are the result of oxidations and cleavage of the C-ring (C4eC5) of 23, which leads to the features of an unusual butyrolactone system. The guanacastepenes, such as 24,11 and heptemerones, such as 25,12 are primary examples of the 5e7e6 neodolastane family, and these metabolites have also been isolated from fungi sources. A characteristic structural feature is the vicinal, syn-relationship of the bridgehead methyl and isopropyl sub- stituents as compared with the 1,3-trans relationship found in dolastanes (Fig. 9.2, structures 8 and 9). Guanacastepenes have proven to be attractive targets for synthesis studies.11,13 However, these fungal metabolites exhibit the antipodal, absolute stereochemistry as compared with neodolastanes from marine origins, such as sphaerostanol (26) (Fig. 9.5).14 
    more » « less
  3. High-impact academic experiences, particularly research and internship experiences, have positive impacts for engineering students on engineering task self-efficacy (ETSE), a measure of students’ perception of their ability to perform technical engineering tasks. However, under- represented racial/ethnic minority students (URM) and women in engineering are found to have relatively lower self-perceptions across several academic and professional self-efficacy measures. Previous studies examined the impact of research and internship experiences on ETSE for students categorized by gender and URM status separately. The current study explores the impact of these experiences on ETSE for the intersection between these two identity categories. This study found that both non-URM and URM women that participated in research and internship experiences had lower ETSE scores than non-URM and URM men, respectively. However, URM women that participated in both research and internship experiences had a statistically similar ETSE score to non-URM men that had not participated in either. This study uses multiple linear regression to measure the association between engineering internships and student’s reported ETSE (effects of participating in research were not found to be significant across identities). Preliminary findings indicate that differences in ETSE between internship participants and non-participants are highest for URM women when compared to their counterparts. Consistent with the literature, this research finds that there is a greater positive effect in ETSE scores, as a result of participation in both research and internship experiences, for URM women than their majority counterparts. These preliminary results provide a foundation for further studies to causally investigate the link between academic experiences and self-efficacy levels for students who are underrepresented in engineering programs. Future implications of this work include the creation of targeted intervention efforts to increase support for all URM students’ access and participation in research and internship experiences. Additionally, this work seeks to challenge the bias towards monolithic interpretations of women and URM engineering students as separate categories and encourage intersectional perspectives when analyzing data to produce more inclusive results. Key Concepts: intersectionality, self-efficacy, engineering task self-efficacy, learning outcomes, academic pathways, inclusion, engineering experiences, research, internships 
    more » « less
  4. Abstract Motivation

    The discovery of relationships between gene expression measurements and phenotypic responses is hampered by both computational and statistical impediments. Conventional statistical methods are less than ideal because they either fail to select relevant genes, predict poorly, ignore the unknown interaction structure between genes, or are computationally intractable. Thus, the creation of new methods which can handle many expression measurements on relatively small numbers of patients while also uncovering gene–gene relationships and predicting well is desirable.


    We develop a new technique for using the marginal relationship between gene expression measurements and patient survival outcomes to identify a small subset of genes which appear highly relevant for predicting survival, produce a low-dimensional embedding based on this small subset, and amplify this embedding with information from the remaining genes. We motivate our methodology by using gene expression measurements to predict survival time for patients with diffuse large B-cell lymphoma, illustrate the behavior of our methodology on carefully constructed synthetic examples, and test it on a number of other gene expression datasets. Our technique is computationally tractable, generally outperforms other methods, is extensible to other phenotypes, and also identifies different genes (relative to existing methods) for possible future study.

    Availability and Implementation

    All of the code and data are available at∼dajmcdon/research/.

    Supplementary information

    Supplementary material is available at Bioinformatics online.

    more » « less
  5. Abstract

    Careful evaluation of the local geochemical conditions in past marine settings can provide a window to the average redox state of the global ocean during episodes of extensive organic carbon deposition. These comparisons aid in identifying the interplay between climate and biotic feedbacks contributing to and resulting from these events. Well‐documented examples are known from the Mesozoic Era, which is characterized by episodes of widespread organic carbon deposition known as Oceanic Anoxic Events. This organic carbon burial typically leads to coeval positive carbon‐isotope excursions. Geochemical data are presented here for several palaeoredox proxies (Cr/Ti, V, Mo, Zn, Mn, Fe speciation, I/Ca and sulphur isotopes) from a section exposed at Furlo in the Marche–Umbrian Apennines of Italy that spans the Cenomanian–Turonian boundary. Here, Oceanic Anoxic Event 2 is represented by aca1 m thick radiolarian‐rich millimetre‐laminated organic‐rich shale known locally as the Bonarelli Level. Iron speciation data for thin organic‐rich intervals observed below the Bonarelli Level imply a local redox shift going into the Oceanic Anoxic Event, with ferruginous conditions (i.e. anoxic with dissolved ferrous iron) transiently developed prior to the event and euxinia (i.e. anoxic and sulphidic bottom waters) throughout the event itself. Pre‐Oceanic Anoxic Event enrichments of elements sensitive to anoxic water columns were due to initial development of locally ferruginous bottom waters as a precursor to the event. However, the greater global expanse of dysoxic to euxinic conditions during the Oceanic Anoxic Event greatly reduced redox‐sensitive trace‐metal concentrations in seawater. Pyrite sulphur isotopes document a positive excursion during the Oceanic Anoxic Event. Carbonate I/Ca ratios were generally low, suggesting locally reduced bottom‐water oxygen conditions preceding the event and relatively increased oxygen concentrations post‐event. Combined, the Furlo geochemical data suggest a redox‐stratified water column with oxic surface waters and a shallow chemocline overlying locally ferruginous bottom waters preceding the event, globally widespread euxinic bottom waters during the Oceanic Anoxic Event, followed by chemocline shallowing but sustained local redox stratification following the event.

    more » « less