Search for: All records

Idle vehicle relocation is crucial for addressing demand-supply imbalance that frequently arises in the ride-hailing system. Current mainstream methodologies - optimization and reinforcement learning - suffer from obvious computational drawbacks. Optimization models need to be solved in real-time and often trade off model fidelity (hence quality of solutions) for computational efficiency. Reinforcement learning is expensive to train and often struggles to achieve coordination among a large fleet. This paper designs a hybrid approach that leverages the strengths of the two while overcoming their drawbacks. Specifically, it trains an optimization proxy, i.e., a machine-learning model that approximates an optimization model, and then refines the proxy with reinforcement learning. This Reinforcement Learning from Optimization Proxy (RLOP) approach is computationally efficient to train and deploy, and achieves better results than RL or optimization alone. Numerical experiments on the New York City dataset show that the RLOP approach reduces both the relocation costs and computation time significantly compared to the optimization model, while pure reinforcement learning fails to converge due to computational complexity. 

Baculoviruses are large dsDNA viruses that are virulent pathogens of certain insect species. In a natural host, Trichoplusia ni, infection by the model baculovirus Autographa californica Multiple Nucleopolyhedrovirus (AcMNPV) begins when the occluded form of the virus disassembles in the midgut and virions infect midgut epithelial cells to establish the primary phase of the infection. To better understand the primary phase of the AcMNPV infection cycle, newly molted 5 th instar T. ni larvae were orally infected with AcMNPV occlusion bodies and transcriptional responses of the T. ni midgut were analyzed at various times from 0-72 hours post infection, using RNA-Seq analysis and a T. ni reference genome. The numbers of differentially expressed host genes increased as the infection progressed, and we identified a total of 3,372 differentially expressed T. ni transcripts in the AcMNPV-infected midgut. Genes encoding orthologs of HMG176, atlastin, and CPH43 were among the most dramatically upregulated in response to AcMNPV infection. A number of cytochrome P450 genes were downregulated in response to infection. We also identified the effects of AcMNPV infection on a large variety of genes associated with innate immunity. This analysis provides an abundance of new and detailed information on host responses to baculovirus infection during the primary phase of the infection in the midgut, and will be important for understanding how baculoviruses establish productive infections in the organism. IMPORTANCE Baculoviruses are virulent pathogens of a number of important insect pest species. In the host Trichoplusia ni , infection begins in the midgut when infectious virions of the occulsion derived virus (ODV) phenotype enter and subsequently replicate in cells of the midgut epithelium. A second virion phenotype (budded virus or BV) is produced there and BV mediates systemic infection of the animal. Most prior detailed studies of baculovirus infections have focused on BV infections of cultured cells. In this study, we examined the transcriptional responses of the T. ni midgut to infection by ODV of the baculovirus AcMNPV, and identified a variety of host genes that respond dramatically to viral infection. Understanding transcriptional responses of the host midgut to viral infection is critically important for understanding the biphasic infection in the animal as a whole. 

ABSTRACT The baculovirus Autographa californica multiple nucleopolyhedrovirus (AcMNPV) is a large double-stranded DNA (dsDNA) virus that encodes approximately 156 genes and is highly pathogenic to a variety of larval lepidopteran insects in nature. Oral infection of larval midgut cells is initiated by the occlusion-derived virus (ODV), while secondary infection of other tissues is mediated by the budded virus (BV). Global viral gene expression has been studied in detail in BV-infected cell cultures, but studies of ODV infection in the larval midgut are limited. In this study, we examined expression of the ∼156 AcMNPV genes in Trichoplusia ni midgut tissue using a transcriptomic approach. We analyzed expression profiles of viral genes in the midgut and compared them with profiles from a T. ni cell line (Tnms42). Several viral genes ( p6.9 , orf76 , orf75 , pp31 , Ac-bro , odv-e25 , and odv-ec27 ) had high expression levels in the midgut throughout the infection. Also, the expression of genes associated with occlusion bodies ( polh and p10 ) appeared to be delayed in the midgut in comparison with the cell line. Comparisons of viral gene expression profiles revealed remarkable similarities between the midgut and cell line for most genes, although substantial differences were observed for some viral genes. These included genes associated with high level BV production ( fp-25k ), acceleration of systemic infection ( v-fgf ), and enhancement of viral movement ( arif-1/orf20 ). These differential expression patterns appear to represent specific adaptations for virus infection and transmission through the polarized cells of the lepidopteran midgut. IMPORTANCE Baculoviruses such as AcMNPV are pathogens that are natural regulators of certain insect populations. Baculovirus infections are biphasic, with a primary phase initiated by oral infection of midgut epithelial cells by occlusion-derived virus (ODV) virions and a secondary phase in which other tissues are infected by budded-virus (BV) virions. While AcMNPV infections in cultured cells have been studied extensively, comparatively little is known regarding primary infection in the midgut. In these studies, we identified gene expression patterns associated with ODV-mediated infection of the midgut in Trichoplusia ni and compared those results with prior results from BV-infected cultured cells, which simulate secondary infection. These studies provide a detailed analysis of viral gene expression patterns in the midgut, which likely represent specific viral strategies to (i) overcome or avoid host defenses in the gut and (ii) rapidly move infection from the midgut, into the hemocoel to facilitate systemic infection. 

The cabbage looper,Trichoplusia ni, is a globally distributed highly polyphagous herbivore and an important agricultural pest.T. nihas evolved resistance to various chemical insecticides, and is one of the only two insect species that have evolved resistance to the biopesticideBacillus thuringiensis(Bt) in agricultural systems and has been selected for resistance to baculovirus infections. We report a 333‐Mb high‐qualityT. nigenome assembly, which has N50 lengths of scaffolds and contigs of 4.6 Mb and 140 Kb, respectively, and contains 14,384 protein‐coding genes. High‐density genetic maps were constructed to anchor 305 Mb (91.7%) of the assembly to 31 chromosomes. Comparative genomic analysis ofT. niwithBombyx morishowed enrichment of tandemly duplicated genes inT. niin families involved in detoxification and digestion, consistent with the broad host range ofT. ni. High levels of genome synteny were found betweenT. niand other sequenced lepidopterans. However, genome synteny analysis ofT. niand theT. niderived cell line High Five (Hi5) indicated extensive genome rearrangements in the cell line. These results provided the first genomic evidence revealing the high instability of chromosomes in lepidopteran cell lines known from karyotypic observations. The high‐qualityT. nigenome sequence provides a valuable resource for research in a broad range of areas including fundamental insect biology, insect‐plant interactions and co‐evolution, mechanisms and evolution of insect resistance to chemical and biological pesticides, and technology development for insect pest management.