<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Enhancing distance learning of science—Impacts of remote labs 2.0 on students' behavioural and cognitive engagement</title></titleStmt>
			<publicationStmt>
				<publisher></publisher>
				<date>08/27/2021</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10290459</idno>
					<idno type="doi">10.1111/jcal.12600</idno>
					<title level='j'>Journal of Computer Assisted Learning</title>
<idno>0266-4909</idno>
<biblScope unit="volume"></biblScope>
<biblScope unit="issue"></biblScope>					

					<author>Shannon H. Sung</author><author>Chenglu Li</author><author>Xudong Huang</author><author>Charles Xie</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[BackgroundWith the increasing popularity of distance education, how to engage students in online inquiry-based laboratories remains challenging for science teachers. Current remote labs mostly adopt a centralized model with limited flexibility left for teachers' just-in-time instruction based on students' real-time science practices.ObjectivesThe goal of this research is to investigate the impact of a non-centralized remote lab on students' cognitive and behavioural engagement.MethodsA mixed-methods design was adopted. Participants were the high school students enrolled in two virtual chemistry classes. Remote labs 2.0, branded as Telelab, supports a non-centralized model of remote inquiry that can enact more interactive hands-on labs anywhere, anytime. Teleinquiry Instructional Model was used to guide the curriculum design. Students' clickstreams logs and instruction timestamps were analysed and visualized. Multiple regression analysis was used to determine whether engagement levels influence their conceptual learning. Behavioural engagement patterns were corroborated with survey responses.Results and ConclusionsWe found approximate synchronizations between student–teacher–lab interactions in the heatmap. The guided inquiry enabled by Telelab facilitates real-time communications between instructors and students. Students' conceptual learning is found to be impacted by varying engagement levels. Students' behavioural engagement patterns can be visualized and fed to instructors to inform learning progress and enact just-in-time instruction.ImplicationsTelelab offers a model of remote labs 2.0 that can be easily customized to live stream hands-on teleinquiry. It enhances engagement and gives participants a sense of telepresence. Providing a customizable teleinquiry curriculum for practitioners may better prepare them to teach inquiry-based laboratories online.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><p>labs regardless of physical and instrumental constraints. We formulated a guided inquiry lab model, coined as teleinquiry throughout the rest of this paper, to promote scientific practices and facilitate synchronous interactions between instructors and students in a computer-supported learning environment <ref type="bibr">(Hossain et al., 2018;</ref><ref type="bibr">Xenofontos et al., 2020)</ref>. We would like to investigate the behavioural engagement patterns between teachers and students during the teleinquiry sessions and determine the impacts of engagement on conceptual learning.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.1">| Engagement in inquiry-based laboratory</head><p>Engaging students in learning is challenging for teachers in online education <ref type="bibr">(Carey, 2020;</ref><ref type="bibr">Dixson, 2012)</ref>. As physical labs are often used in science education to intrigue and captivate students, we assumed that Telelab, which represents good approximations to physical labs, can achieve similar effects to a certain degree. Considering that Telelab is still undergoing early stages of development, as a first step, we would like to study how innovative technology could facilitate inquiry-based instruction in distance learning. In other words, research as to how teleinquiry can improve students' engagement in the remote labs and how their behaviour impacts the acquisition of science concepts and practices are needed <ref type="bibr">(Childers &amp; Jones, 2015;</ref><ref type="bibr">Lowe et al., 2013;</ref><ref type="bibr">Post et al., 2019;</ref><ref type="bibr">Villanueva &amp; Zimmermann, 2020)</ref>. This demand becomes more pressing as distance education grows, especially when schools are shut down due to disasters.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">| BACKGROUND</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1">| Reality check for inquiry-based laboratory</head><p>The inquiry-based laboratory has been a controversial topic supporting student-centred pedagogy <ref type="bibr">(Beck et al., 2014;</ref><ref type="bibr">Zacharia et al., 2015)</ref>. Practitioners and students shared mixed feelings toward this type of open ended-learning. The merits of inquiry-based learning are that the activities are more authentic, engaging, and the inquiry processes leverage their self-efficacy <ref type="bibr">(Branan &amp; Morgan, 2010;</ref><ref type="bibr">Fisher, 2016)</ref>, learning gain <ref type="bibr">(Silva &amp; Galembeck, 2017)</ref>, and enhance their scientific practices <ref type="bibr">(Cunningham et al., 2006)</ref>. Some drawbacks of inquiry-based labs were equally prevailing. For instance, educators expressed concerns about their insufficient pedagogical knowledge, impeding effective learning <ref type="bibr">(Zacharia et al., 2015)</ref>. Others criticized that the inquiry-aligned curricula are too cumbersome to foster targeted understanding systematically <ref type="bibr">(Eastwell &amp; MacKenzie, 2009)</ref>. Indeed, inquiry-based labs require an intentional instructional design to scaffold learning processes and keep learners cognitively engaged <ref type="bibr">(Sedwick et al., 2018;</ref><ref type="bibr">Shea &amp; Bidjerano, 2009)</ref>. Labs that adopt guided inquiry may enculturate the classroom ecology of shared duty on labdesign ideation before moving to the next steps of the investigations <ref type="bibr">(Farley et al., 2021;</ref><ref type="bibr">Sedwick et al., 2018)</ref>. Since conducting experiments in physical labs is disrupted during the pandemic, it is urgent to search for an avenue that could foster the teacher-student interactions mentioned above and support scientific experimentation in online settings.</p><p>Virtual labs are one of the most popular and convenient approaches to supplement, even supplant, physical labs <ref type="bibr">(Darrah et al., 2014;</ref><ref type="bibr">de Jong et al., 2013;</ref><ref type="bibr">Yaron et al., 2010;</ref><ref type="bibr">Zacharia &amp; Olympiou, 2011)</ref>. Even though dynamic simulation and visualizations are commonly adopted in science learning, the American Chemical Society's policy position suggests that computer simulations can be a supplement but not a substitute in the laboratory (2017). In other words, virtual labs or simulationbased labs that lack physical components would deprive students of the opportunities to engage in an authentic experience with the material world. Another alternative to cultivate first-hand practices in science is through remote labs, which allow students to interact with actual experiments through the Web.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.2">| Remote labs broaden participation in science</head><p>The remote labs concept emerged from a proposal by <ref type="bibr">Aburdene et al. (1991)</ref> at the beginning of the Internet era. Remote labs retain many characteristics of physical labs in the promotion of science-aspractices, such as authenticity, complexity, uncertainty, errors, and psychology of presence <ref type="bibr">(Azad et al., 2003;</ref><ref type="bibr">Colwell et al., 2002;</ref><ref type="bibr">Heradio, de la Torre, Galan, et al., 2016;</ref><ref type="bibr">Ma &amp; Nickerson, 2006;</ref><ref type="bibr">Post et al., 2019)</ref>. <ref type="bibr">Colwell et al. (2002)</ref> described how they successfully extended access to students who could not attend conventional labs in physical science and engineering classes, mainly due to a range of disabilities. <ref type="bibr">Heradio, de la Torre, Galan, et al. (2016)</ref> reviewed publications about the eligibility of adopting virtual and remote labs in teaching automatic control education. They concluded that online labs have substantial potential in improving and broadening participation in control education. <ref type="bibr">Ma and Nickerson (2006)</ref> reviewed the literature on three laboratory modes: hands-on, simulated, and remote. They concluded that regardless of the pros and cons of each mode, the psychology of presence is as critical as the technology itself. In almost two decades of exploratory research, remote labs have provided students access to dangerous measurements (e.g., detecting radioactivity, <ref type="bibr">Sauter et al., 2013)</ref> and expensive apparatuses (e.g., electron scanning microscopes, <ref type="bibr">Childers &amp; Jones, 2015</ref><ref type="bibr">, 2017;</ref><ref type="bibr">Jones et al., 2003)</ref>. Biological instruments such as biotic processing units <ref type="bibr">(Hossain et al., 2016;</ref><ref type="bibr">Hossain et al., 2018;</ref><ref type="bibr">Washington et al., 2019)</ref> and engineering shops that have special equipment <ref type="bibr">(Cooper &amp; Ferreira, 2009;</ref><ref type="bibr">Heradio, de la Torre, &amp; Dormido, 2016;</ref><ref type="bibr">Lowe et al., 2013;</ref><ref type="bibr">Martin et al., 2019)</ref> are also popular forms of web labs. Doubts about the effectiveness of remote labs could be mitigated as studies showed that the differences in learning outcomes between remote and local labs <ref type="bibr">(Roschelle et al., 2017)</ref>. Remote labs may help broaden participation in science with comparable affordances and promote equity in education by giving anyone-including those in underserved communities and those with physical disabilities-access to scarce laboratory resources.</p><p>2.3 | Toward a non-centralized and scalable model of remote labs 2.0 Despite their remarkable successes, most reported remote labs are based on a somehow centralized model in which the experiments are, for the most part, designed and operated by an expert provider at a well-equipped facility. Students and teachers then work with such remote experiments through computer interfaces that control a set of parameters allowed by the expert designers. While this ensures the efficiency, reliability, and reproducibility of the experiments, it limits students' and teachers' abilities to choose their own topics, subjects, and methods <ref type="bibr">(Roschelle et al., 2017)</ref>. For remote labs to become a cyberinfrastructure that supports online experimentation on a large scale, they must first meet teachers' needs to address diverse content and customize laboratory setup. A non-centralized (as opposed to the conventional remote labs that are mostly centralized), scalable, social, and secure model of remote labs-remote labs 2.0-that can accommodate multiple remote experiments is demanded <ref type="bibr">(Xie et al., 2022)</ref>.</p><p>The teachers can conveniently live-stream lab sessions on any topics of their interest at a place of their own choice. The bottom-up design gives teachers and students autonomy to conduct experiments distinctive from most traditional remote labs that usually offer top-down service for users to merely work with the pre-defined parameters set by remote lab experts. Like the concept of breakout rooms in virtual meetings that anyone can initiate and invite others to join, such an open cyberinfrastructure will engender many educational innovations.</p><p>For example, teachers co-design experiments with students, stream live data captured by sensors and cameras to students' devices for real-time analysis, discuss the results as they emerge, and then lead students to iterate through a circle of inquiry. The prototype of remote labs 2.0 that promotes shared-lab resources and the teleinquiry above is called Telelab (see more information in Section 5).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">| THEORETICAL FRAMEWORK</head><p>Remote labs support some of the critical practices in science experimentation, such as observation and analysis. Currently, the key research direction for remote experiments is to explore ways to increase students' epistemic agency <ref type="bibr">(Ko &amp; Krist, 2019;</ref><ref type="bibr">Miller et al., 2018)</ref> and sense of presence <ref type="bibr">(Childers &amp; Jones, 2015)</ref> in remote experiments to reproduce as many educational effects of their local counterparts as possible. For example, <ref type="bibr">Childers and Jones (2015)</ref> found that simply allowing students to choose their subjects of observation could enhance their perception of ownership and realism. Our goal is to provide a remote laboratory platform that can augment student's hands-on minds-on experience and increase science experimentation competency on the Web.</p><p>Along this line of thinking, we envision an open cyberinfrastructure with which teachers can explore teleinquiry to support remote experimentation with a broad range of possibilities and flexibilities. In contrast to relying on a central provider, with their own remote labs powered by a common platform, teachers only need to attend to the requests from their students. Being the owners of remote labs, they also have the freedom to explore various subject matter and enact guided inquiry labs that may be most appropriate for their students <ref type="bibr">(Clar&#224;, 2019;</ref><ref type="bibr">Lakkala et al., 2005)</ref>. Students can jointly explore a more expansive problem space in online settings under their teacher's guidance, which benefits the coaching of experiment design skills <ref type="bibr">(Ma &amp; Nickerson, 2006)</ref>. Figure <ref type="figure">1</ref> shows a simplified illustration highlighting the synchrony portion of this instructional model, referred to as Teleinquiry Instructional Model (TIM) in this study. From a practical point of view, TIM is similar in many ways to how teachers use demonstration experiments to engage students in the classroom (except we streamed real-time data to the students through the Internet). In this preliminary study, we would like to investigate the impact of applying TIM in facilitating students' behavioural and cognitive engagement during the science teleinquiry processes. We primarily focus on the student-teacher-lab interactions to study the relationship between behaviour patterns and conceptual learning. The exploratory research on TIM is crucial because there is no unanimous protocol to determine students' effortful engagement during inquirybased, synchronous remote laboratories.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">| ENACTING TIM VIA TELELAB</head><p>Telelab is a sophisticated cyber-physical system that connects experimental objects in labs with students and teachers through the Internet of Things <ref type="bibr">(Jiang et al., 2021</ref><ref type="bibr">, Sung et al., 2021</ref><ref type="bibr">, Xie et al., 2021)</ref>. It is developed to support secure data sharing, remote control, telepresence, and collaborative learning in real-time. We adopted the thermal imaging technology and Infrared Explorer app <ref type="bibr">(Xie 2011</ref><ref type="bibr">(Xie , 2012</ref><ref type="bibr">(Xie , 2019;;</ref><ref type="bibr">Xie &amp; Hazzard, 2011;</ref><ref type="bibr">Xie et al., 2022;</ref><ref type="bibr">Jiang et al., 2021)</ref> to investigate how the curriculum could be developed to support synchronous science experimentations via Teleinquiry Instruction Model-consisting of three interaction cycles among students, teacher, and Telelab-introduced below.</p><p>Teacher-lab live-stream cycle. The instructor and the lab assistant collaborated to prepare and perform the lab activity via Telelab. When equipped with a thermal imaging system, a vivid visualization of what is happening energetically can be transmitted to students' devices (Figure <ref type="figure">2</ref>), enabling students to explore the questions that would otherwise be too difficult to tackle without the instrument.</p><p>The instructor or lab host live-streams the teleinquiry activity on the Telelab platform and feeds the data to facilitate the student-lab interaction cycle, where the guiding questions can be tackled (see the purple dash-dot lines in Figure <ref type="figure">1</ref>). The teacher or lab host sets up sensors to gather time-varying data (the thermal energy released or absorbed in an experiment can be turned into colourful indicators under a thermal camera, see Figure <ref type="figure">2</ref>).</p><p>Student-teacher interaction cycle. Students submit their requests to the instructor. The lab host then uses their proposals for conducting remote experiments where students can test their hypotheses (see red line pointing from student to teacher in Figure <ref type="figure">1</ref>). The proposed experiments are then realized by the teacher and a lab assistant in Telelab and the data are instantaneously shared with the students in a live session that they joined through the Internet.</p><p>Student-lab interaction cycle. Local supporting apps, such as IR explorer, stream all sensor data, including thermal imaging to students' devices through the Telelab platform (see purple dash-dot line pointing from Teacher-Led Live-stream Cycle to Student-Lab Interaction Cycle in Figure <ref type="figure">1</ref>). Students observe, analyse, and discuss the initial results and then make requests to speed up, slow down, or reverse the reaction that offers the entrance to the student-teacher interaction cycle (see the red line pointing from student to teacher in Figure <ref type="figure">1</ref>). During the live-stream session, students observe the thermal images generated in the experiment (see black dot lines in Figure <ref type="figure">1</ref>) and analyse the temperature data distributed to them in real-time with a user interface in their Web browsers. The experiments can also be recorded and published by the teacher in the online library of Telelab so that students can revisit them later if needed. The remote labs 2.0 model presents the key features of the envisioned remote teleinquiry labs distinctive from the previous generations.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1">| Research questions</head><p>Considering the novelty of the non-centralized remote labs, our central focus is to research the behavioural and cognitive engagement </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5">| METHODS</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.1">| Context and participants</head><p>The four-phases teleinquiry curriculum for chemical reaction laboratory was developed following the Teleinquiry Instructional Model (see Table <ref type="table">1</ref>). The student-teacher-lab interactions and the modes of learning activities for each phase are also described in Table <ref type="table">1</ref> (see Supporting Information Appendix). Among the 59 students who enrolled in a virtual summer school, 37 consented to participate in the teleinquiry activity. Thirty-three participants attended at least one live-stream session, and 23 of them also completed both pre-and post-tests. One of the goals of this study is to examine whether students' engagement levels during teleinquiry could help with science learning. Therefore, this study only focuses on the 23 participants who have pre-and post-test scores. Among the 23 participants, 13 were female and 10 were male, with English being the primary language at home (n English = 21). The participants are from diverse ethnicities (n White/Caucasian = 15, n Asian/Pacific Islander = 3, n Black/African American = 2, n Hispanic = 1, n MiddleEast = 2).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.2">| Data and data analysis</head><p>Student engagement is strongly correlated with their performances in traditional classrooms and online learning environments <ref type="bibr">(Martin &amp; Bolliger, 2018;</ref><ref type="bibr">Pardo et al., 2016;</ref><ref type="bibr">Vytasek et al., 2020)</ref>. In online learning contexts, numerous researchers have suggested that students' interactions with the learning platform can be important indicators for their engagement level <ref type="bibr">(Lu et al., 2017;</ref><ref type="bibr">Mubarak et al., 2021)</ref>.</p><p>In these studies, students' interactions are often captured with log data recorded by the learning system. The advancement in technolo- what experiments they would like the teacher to conduct, and post their ideas on the discussion board via the internal learning management system 3. Teacher reviews students' ideas and selects experiment(s) that help address learning objectives Live stream #2: Factors that impact reaction rate Synchronous 1. The teacher carries out and streams an experiment that is slightly modified from students' proposals in real time 2. Teacher prompts students to predict the results and collect data to support their prediction 3. Students ask questions and discuss the results with the teacher and peers via online chat 4. Students finish the lab report for Livestream #2 based on the screenshots and graphs collected from Telelab contexts through various methods (Pe&#241;a-Ayala, 2018). For example, researchers <ref type="bibr">(Jo et al., 2017)</ref> used students' frequency and duration of a learning platform usage to construct variables that provide information on students' interaction patterns and examined how these variables associated students' performances. Other than computing numeric metrics, studies have shown that visualizing students' temporal interaction logs can also effectively reveal students' engagement <ref type="bibr">(Chen, 2014;</ref><ref type="bibr">Dobashi et al., 2019;</ref><ref type="bibr">Ginda et al., 2019)</ref>. For example, Dobashi Given its effectiveness and appropriateness for studies at a small scale in this study, temporal visualizations of students' interactions with Telelab were adopted to help dissect students' engagement both at collective and individual levels. Moreover, engagement metrics were calculated for a multiple regression analysis to understand the relationship between students' different engagement levels and performance. Telelab records every mouse click and keystroke made by students with detailed information. For example, when a student creates a thermometer, the system not only logs such an action but also retains information such as the coordinate of the newly created thermometer, so we can take advantage of this capacity to determine the displacement of the virtual thermometers from the backend logs. This study used 9164 entries of log data from the 23 students who attended the live sessions in Phase 4 who also completed the pre-and post-tests. Table <ref type="table">2</ref> illustrates each type of interaction in the live-stream lab sessions. The following sections explain the details on how we process the log data for analysis. H1: The guided teleinquiry pedagogy facilitates student-teacher interactions. We tested this hypothesis using a mixed-methods approach <ref type="bibr">(Johnson &amp; Christensen, 2019)</ref> based on multiple data sources. For example, similar to using data analytics to measure student engagement in learning management systems and other digital learning environments <ref type="bibr">(Vytasek et al., 2020)</ref>, students' activity logs collected in the backend were analysed to provide quantitative indicators of engagement. Specifically, during student-teacher and studentlab interaction cycles, a student was likely not engaged if no interaction data was ever logged in her/his account when the teacher prompted them to respond to questions or collect data on Telelab.</p><p>The backend log data could offer hints as to whether a student was persistent during teleinquiry or had given up the quest if her/his trace of digital footprints was discontinued. Specifically, we addressed H1 by tackling how the instructions impacted students' interaction with the Telelab features, such as creating, moving, or removing thermometers, online chatting, and taking screenshots or toggle graphs.</p><p>We selected Phase 4 (i.e., the second live-streaming class listed in Table <ref type="table">1</ref>) to test H1 because the lab was designated to test student's experimentation ideas proposed in the previous phase. We first transcribed the live conference video, then we coded and highlighted the timestamps of teacher actions as follows: prompt students to type (PT), prompt to use Telelab features (PF), and respond to questions (R/Q), which were used to construct the instruction stamps on the xaxis of the student-teacher-lab interaction heatmap. More specifically, each students' lab-interaction log data (see Table <ref type="table">2</ref> for the definition of each interaction) was chucked into subsets in units of 60 s after the onset of each instruction stamp. We then transformed the data to quantify and compare engagement levels.</p><p>H2: The remote labs 2.0 model facilitates student's scientific teleinquiry.</p><p>To understand how students interacted with Telelab features from a collective perspective over the entire time-series of both live-stream sessions, we aggregated all students' log data by minute to get frequencies of lab interactions. We visualized the collective investigation and data collection behaviour to substantiate teleinquiry. Also, an end-of-course/ post-lab survey and a short post-lab reflection survey were filled out by the participants and instructor, respectively, to evaluate the effectiveness of the teacher-lab live-stream cycle design development team could use for modifying and designing future teleinquiry curriculum.</p><p>In addition to the whole-class data analytics, we also identified a student who completed all tasks with flying colour and held a positive attitude toward the teleinquiry lab as the subject for our case study.</p><p>We adopted three methods to visualize an exemplary active teleinquiry during the live-stream lab session(s). The analysis helps researchers better understand the teleinquiry learning processes demonstrated by an individual student when interacting with Telelab.</p><p>First, similar to the collective visualization, we aggregated a representative student's log data by minute and plotted a line graph depicting the student's usage frequency of each feature against time during the two live sessions during Live-streaming #2. Second, to add a sequential dimension to the analysis, we sorted the student's log data by timestamp and used a sequence plot to show the student's time-series interactions with Telelab.</p><p>Finally, we assessed how well a student could follow instructional signals during teleinquiry using one example-computing the distance between locations where the student was instructed to place the thermometers instead of the actual positions the thermometers were placed during the lab. Students' thermometer-movement behaviour within 45 s before and after the substance was added to each petri dish can be visualized and compared between two instructional signals. The purpose of this analysis is to demonstrate how a pre-defined computational algorithm could be easily customized to satisfy instructional needs. It has the potential to support lab instructors in formatively assessing whether students actually follow along during teleinquiry.</p><p>H3: Students' engagement levels can predict their learning gains.</p><p>Laboratory experiences are prominent in accomplishing three- The energy change would______ the previous reaction with less baking soda. Explain your response.</p><p>With the assistance of Telelab features, such as colour heat map, thermometer reading, and automatically populated graphics <ref type="bibr">(Jiang et al., 2021;</ref><ref type="bibr">Sung et al., 2021)</ref>, we expect that students can explain that different factors, such as temperature, can impact chemical reaction rate (NGSS Lead States, 2013).</p><p>The learning gains were calculated as the differences between the post-and pre-test scores. Students' occurrences of different engagement levels were computed based on the result of instruction heatmap visualization generated from H1. For example, level 5 engagement means a student's interaction frequency was above the 75th percentile among peers at five different instruction stamps. Preand post-test scores were transformed to percentages of correct answers to ease of interpretation. Students' pre-test scores are the only independent variable (X 1 ), and their learning gains are the dependent variable (Y) in the base regression model (see Equation <ref type="formula">1</ref>). Then, students' occurrences of different engagement levels and their pretest scores were used as independent variables for the final model to find the additional variances explained by engagement levels (X 2 represents high levels of engagement, X 3 represents low levels of engagement) compared with the base model. To better understand how the levels of engagement interact with each other, we included interaction terms in the analysis (i.e., X 2 X 3 ). Multicollinearity was checked with variance inflation factors (VIF) which are commonly used in regression analysis <ref type="bibr">(Alin, 2010)</ref>, and the occurrence of medium engagement level was dropped to eliminate multicollinearity (see Equation <ref type="formula">2</ref>). The regression models were defined as followed:</p><p>where i is the observation number, and e is the error term.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6">| RESULTS</head><p>H1: The guided teleinquiry pedagogy facilitates student-teacher interactions. In Figure <ref type="figure">5</ref>, we showcased a series of behavioural engagement patterns. We selected a representative student who used all Telelab features and frequently responded to the action prompts during the live-stream teleinquiry session (student A4). In the left IR image of F I G U R E 4 Collective feature-interaction frequencies against time during the second live-stream teleinquiry from the first class (a) and the second class (b) [Colour figure can be viewed at wileyonlinelibrary.com]</p><p>chemical reaction. We could use this imagery to triangulate the accuracy of the thermometer locations before and after the reaction. Figure <ref type="figure">5</ref> (5.2) indicates that the positions of three thermometers on Figure <ref type="figure">5</ref> (5.1) were stable before and after the reaction. The analysis presented in Figure <ref type="figure">5</ref> (5.2) is accomplished by identifying the precise timing just before chemical reactions were about to take place. The y-axis of this visualization is the minimum distance among all thermometers placed by a student relative to a petri dish's centre point. The x-axis shows the discrete steps before and after a signal point.</p><p>The minimal distance discrepancy between the actual and ideal locations also implies that A4 follows this particular instructional signal well. Figures 5 <ref type="bibr">(5.3-5.4</ref>) demonstrated that the student used the chat feature throughout the session, and the overall engagement patterns were very rich, indicating a high level of behavioural engagement.</p><p>The post-lab survey from Student A4 revealed positive attitudes toward the teleinquiry activities. For example, when asked what features of the remote lab engaged them most, Student A4 responded: 'I liked the fact that we could ask questions and have discussions live.</p><p>Also, I liked the fact that a teacher was there explaining what was going on instead of just a sheet of paper explaining'. This response reinforces the merit of the remote labs 2.0 in promoting social cognitive learning <ref type="bibr">(Bandura, 1986)</ref>. As for the question prompting them to reflect on how they used Telelab to gather evidence, the student stated: 'I used the remote lab to be able to take live evidence and screenshots so I could remember the data points better. Also, we could compare our findings with other students to see how each of ours compared and if what we found was just an outlier. Also, because we had an IR camera which not a lot of us have, we were able to use thermometers in order to see the true temperature changes between B t Significance Pre-test Base model 0.45 1.763 0.098 Full model 0.57* 4.024 0.002 engagement_low &#192;6.27* &#192;5.430 0.000 engagement_high &#192;0.46 &#192;0.457 0.656 engagement_low:engagement_high 0.69* 2.579 0.024 *Indicates significance. R 2 adj:R 2 base &#188; 0:116, R 2 adj:R 2 full &#188; 0:741. the three petri dishes and therefore see if the reaction rate of warmer vinegar really was higher'. The response reassured that remote labs 2.0 opened up equal access to lab instruments which helped him proceed with the scientific teleinquiry. Similar comment was found in his end-of-course survey in the eight-week summer course: 'The lab component was not extremely helpful to me &#8230; but that was expected because at home there isn't as much access to equipment. However, all of the equipment did function well and I especially liked the baking soda vinegar reaction because I think I learned a lot with the IR camera'. Student A4 shared two things he liked best about this course and provided suggestions on how it could be even better by stating: 'I liked the IR camera lab because we didn't have to gather materials but we still got to learn a lot. Also, we did it with other people&#8230; so it was more engaging and easier to gain live feedback. I would like if we could talk about what things may have caused the reaction more and also what factors could have impacted it a little more'.</p><p>H3: Students' engagement levels can predict their learning gains.</p><p>Table <ref type="table">3</ref> shows the results of regression analysis. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="7">| DISCUSSIONS</head><p>This study speaks specifically to the impact of remote labs 2.0 on inquiry-based lab instruction and student learning outcomes during mandated distance learning. As suggested in the literature <ref type="bibr">(Childers &amp; Jones, 2017)</ref>, a key challenge in developing remote labs is to give students the feeling of being there through telepresence. The effectiveness of this live-stream lab activity in enhancing telepresence could be summarized in one participant's end-of-course survey: 'I thought it was really cool that although we are all so far apart in distance, we were all able to participate in the live experiment together in realtime'. This response was not a standalone reflection of only a few participants but a shared experience among more than half students.</p><p>They self-reported that they enjoyed the augmented interaction with other peers/instructor and with data offered by Telelab.</p><p>The student-teacher-lab interaction heatmap shows highly synchronous interactions between the intensity of student's feature Compared with previous generations of remote labs that are more fixated on the experimental subject and design, remote labs 2.0 will preserve a higher degree of open-endedness of authentic science investigations, increase student agency, and foster student-teacher interactions. In other words, the instructional model may provide a promising avenue to incorporate student's experimental design <ref type="bibr">(Farley et al., 2021)</ref> that is grounded in the shared responsibility of instructors and students <ref type="bibr">(Sedwick et al., 2018)</ref>. By so doing, one's self-efficacy in scientific inquiry and practices can also be cultivated.</p><p>Despite the strong recommendation on promoting student-teacher interactions during distance learning, we recognized that for students to receive timely feedback, teachers should acquire more understanding of the students' learning patterns during teleinquiry, which could also be very time-consuming. The teacher also shared similar complaints in the post-lab survey responses. Regardless of praising the power of Telelab in facilitating scientific practices, he expressed his concerns about the amount of preparation time required to enact the lesson. Suppose the teachers feel that the teleinquiry instruction model requires disproportional preparation time and unpredictable learning processes. In that case, they might not buy in the idea of adopting such inquiry-based labs on their own <ref type="bibr">(Chang et al., 2008)</ref>. One way to mitigate the reported instruction load is to create a teacher dashboard that projects student behaviour during the student-lab interaction cycle as students interact with Telelab features. For example, Figure <ref type="figure">5</ref> (5.2) was a graph transformed from Figure <ref type="figure">5</ref> (5.1) to detect how far away Student A4 placed his thermometers from the ideal locations (i.e., one thermometer at the centre of each petri dish) pre-identified by the instructor. By seeing the stable thermometer positions on the dashboard, the instructors may conclude that Student A4 places the thermometers very close to the location where they are expected to be. The synchronous student-lab interaction patterns during an ongoing live lab would help teachers and researchers monitor students' behavioural engagement without interfering with the natural instructional flow <ref type="bibr">(Shute et al., 2016)</ref>. Doing so reduces the time for instructors to correct students' mistakes after the live session and miss the prime time to enact just-in-time instructions.</p><p>In response to the second hypothesis, generally speaking, we found that remote labs 2.0 can support students' scientific teleinquiry.</p><p>In addition to the rich collective teleinquiry patterns shown in Enacting a teleinquiry curriculum using the remote labs 2.0 platform (see Table <ref type="table">1</ref>) promises to facilitate scientific practices. Such practices include but not limited to planning and carrying out investigations (e.g., identifying variables to be studied), analysing and interpreting data (e.g., colour heat map, add and move thermometers and populate data in toggle graph), communicating information (e.g., chat on Telechat and conference call). Specifically, based on the case study of Student A4, who felt that IR technology enabled him to provide his rationales to respond to the hypotheses using the Telelab data. He also felt confident (7 out of 10) using Telelab to collect evidence and extract interpretation and inferences based on the collected data.</p><p>Student A4's self-reported engagement level in the post-survey and end-of-course survey triangulated with the learning processes depicted in the visual aids. His conceptual understanding also improved from pre-to post-test (60%-75%), which is not impressive.</p><p>Still, the improvement is indeed an encouraging finding, given that the instructor spent much less time lecturing during the guided teleinquiry. The learning gain, however, is not intended to be compared with other modes of inquiry-based learning. It is presented to affirm the interested educators that such a method did not necessarily hinder conceptual knowledge acquisition.</p><p>Another contribution of this study is that we showcased how we operationally defined and measured engagement behaviour and measuring engagement in science, which has often been a daunting task for educators <ref type="bibr">(Sinatra et al., 2015;</ref><ref type="bibr">Vytasek et al., 2020)</ref>. We performed innovative analysis methods by adopting a mixed-methods approach using data such as the student-teacher-lab interaction heatmap by combining video analysis with backend data logs. We used the mentioned data to construct an interaction heatmap to indicate a rich engagement pattern.</p><p>Besides sending time-series data to students, Telelab also uses Infrared cameras and IR Explorer apps to stream live views to closely observe the experiments, act on teachers' instruction, and listen to the live questions and answers all mimic the interactions in a 'brick-and-mortar' school.</p><p>Augmenting social cognitive learning helps establish a sense of participation in distance learning settings. Even though we did not include a control group in this study, student's behavioural and cognitive engagement patterns on this prototype remote lab resonated with Sauter and her colleagues' finding where students felt most engaged with the task when they participated in live sessions <ref type="bibr">(Sauter et al., 2013)</ref>.</p><p>The regression result indicates a strong correlation between low engagement levels and low learning gain. The finding implied that the less engaged a student is on Telelab, the less likely s/he would attain a good learning gain. The strong correlation between low engagement levels and low learning gain has instructional implications. We recommend lab instructors scaffold teleinquiry by enhancing student-lab and student-teacher interactions. The result also suggests that students' engagement patterns and experimentation sequences identified during innovative teleinquiry might be valuable for teachers to monitor students' learning processes closely. Student's acceptance and engagement when using innovative technology during remote labs would be reassuring for teachers who are uncertain about the feasibility of adopting multimedia and might be more likely to try out teleinquiry. In the meantime, the data analytics presented in this paper offer a promising approach for lab instructors to customize the inquiry-based laboratory to fit students' needs with the tested curriculum during distance learning. It is also worth noting that the computational algorithms applied in studying user experience in Figure <ref type="figure">5</ref> (5.2) could be easily modified to address teacher's demands.</p><p>The teleinquiry activities model after the 'lab-on-the-chip' innovation in health sciences <ref type="bibr">(Dittrich &amp; Manz, 2006)</ref> transcends the limitations of physical presence and resources. The platform promotes the telepresence of both teachers and students during the real-time handson inquiry. In the era of a highly connected social network, where every voice counts <ref type="bibr">(Chen et al., 2018)</ref>, Telelab offers a promising and scalable platform for teachers who wish to share responsibility with their students during the scientific inquiry. It also enables anyone to access and engage in scientific experimentation from anywhere at any time.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="8">| LIMITATIONS AND FUTURE STUDIES</head><p>Among the 37 students who consented to participate in this study, The development of a teleinquiry curriculum might be a foreign or even intimidating idea for many science educators who are already bombarded with virtual learning responsibilities. The scalability of Telelab would be a common platform to support science teachers and students to cloud-sourcing for more experimentation ideas that could leverage and streamline the teleinquiry instruction to the next level.</p><p>conclusions or recommendations expressed in this material, however, are those of the authors and do not necessarily reflect the views of NSF. We thank Kim Spangenberg and Stephen Sobolewski from VHS Learning to collaborate on this research. We also thank Elena Sereiviene for coordinating the live-streaming labs and serving as the lab host on Telelab.</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="4" xml:id="foot_0"><p>SUNG ET AL.</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" n="10" xml:id="foot_1"><p>SUNG ET AL.</p></note>
		</body>
		</text>
</TEI>
