<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Agile robotic inspection of steel structures: A bicycle‐like approach with multisensor integration</title></titleStmt>
			<publicationStmt>
				<publisher>Wiley</publisher>
				<date>03/01/2024</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10509065</idno>
					<idno type="doi">10.1002/rob.22266</idno>
					<title level='j'>Journal of Field Robotics</title>
<idno>1556-4959</idno>
<biblScope unit="volume">41</biblScope>
<biblScope unit="issue">2</biblScope>					

					<author>Son Thanh Nguyen</author><author>Kien Thanh La</author><author>Hung Manh La</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[<title>Abstract</title> <p>This paper introduces an innovative and streamlined design of a robot, resembling a bicycle, created to effectively inspect a wide range of ferromagnetic structures, even those with intricate shapes. The key highlight of this robot lies in its mechanical simplicity coupled with remarkable agility. The locomotion strategy hinges on the arrangement of two magnetic wheels in a configuration akin to a bicycle, augmented by two independent steering actuators. This configuration grants the robot the exceptional ability to move in multiple directions. Moreover, the robot employs a reciprocating mechanism that allows it to alter its shape, thereby surmounting obstacles effortlessly. An inherent trait of the robot is its innate adaptability to uneven and intricate surfaces on steel structures, facilitated by a dynamic joint. To underscore its practicality, the robot's application is demonstrated through the utilization of an ultrasonic sensor for gauging steel thickness, coupled with a pragmatic deployment mechanism. By integrating a defect detection model based on deep learning, the robot showcases its proficiency in automatically identifying and pinpointing areas of rust on steel surfaces. The paper undertakes a thorough analysis, encompassing robot kinematics, adhesive force, potential sliding and turn‐over scenarios, and motor power requirements. These analyses collectively validate the stability and robustness of the proposed design. Notably, the theoretical calculations established in this study serve as a valuable blueprint for developing future robots tailored for climbing steel structures. To enhance its inspection capabilities, the robot is equipped with a camera that employs deep learning algorithms to detect rust visually. The paper substantiates its claims with empirical evidence, sharing results from extensive experiments and real‐world deployments on diverse steel bridges, situated in both Nevada and Georgia. These tests comprehensively affirm the robot's proficiency in adhering to surfaces, navigating challenging terrains, and executing thorough inspections. A comprehensive visual representation of the robot's trials and field deployments is presented in videos accessible at the following links:<ext-link href='https://youtu.be/Qdh1oz_oxiQ'>https://youtu.be/Qdh1oz_oxiQ</ext-link>and<ext-link href='https://youtu.be/vFFq79O49dM'>https://youtu.be/vFFq79O49dM</ext-link>.</p>]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><p>The American Society of Civil Engineers (ASCE) has compiled regular "report cards" on the state of US infrastructure since the 1980s. In its 2021 report <ref type="bibr">(ASCE, 2021)</ref>, the ASCE found that the nation's infrastructure averaged a "C-," up from a "D+" in 2017 and the highest grade in 20 years. This is good news and an indication we have headed in the right direction, but a lot of work remains. The federal government requires a strategic and holistic plan to renew, modernize, and invest in our infrastructure.</p><p>Besides leadership and intensive investment, resilience is one of the key requirements in this strategy. We must utilize new approaches, materials, and technologies to ensure our infrastructure can withstand or quickly recover from natural or manmade hazards.</p><p>However, applying technology in risk assessment/inspection, and maintenance of existing structures is still limited especially steel structures because of their special properties in terms of material and variety of nonstandard architectures. Until today, these tasks are still manually conducted by professional human inspectors who visually inspect damages and detect faults on or inside these structures <ref type="bibr">(Ahmed, La, &amp; Gucunski, 2020;</ref><ref type="bibr">Ahmed, La, &amp; Tran, 2020;</ref><ref type="bibr">Billah et al., 2019</ref><ref type="bibr">Billah et al., , 2020))</ref>. Although human-carried inspections are usually highly time-consuming, costly, and risky.</p><p>For instance, it is highly dangerous for an inspector to climb up and hang on cables to inspect far-reached areas of bridges (Figure <ref type="figure">1a</ref>) or offshore oil rigs (Figure <ref type="figure">1b</ref>). Even the inspection of less complicated structures such as ship shells (Figure <ref type="figure">1c</ref>) and gas/oil tanks/piles (Figure <ref type="figure">1d</ref>) is also highly challenging due to their large scales.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.2">| Literature review</head><p>Utilizing robots with sensing tools to automate inspection is an emerging solution <ref type="bibr">(Ahmed et al., 2019</ref><ref type="bibr">(Ahmed et al., , 2023;;</ref><ref type="bibr">Ahmed, Tavakkoli, et al., 2022;</ref><ref type="bibr">Ding et al., 2020;</ref><ref type="bibr">Gucunski et al., 2023;</ref><ref type="bibr">La, Gucunski, Kee, &amp; Nguyen, 2014;</ref><ref type="bibr">La et al., 2013</ref><ref type="bibr">La et al., , 2015;;</ref><ref type="bibr">La, Gucunski, Kee, Yi, et al., 2014;</ref><ref type="bibr">Le et al., 2017;</ref><ref type="bibr">Otsuki et al., 2023;</ref><ref type="bibr">Peidr&#243; et al., 2019;</ref><ref type="bibr">Wang &amp; Kawamura, 2016;</ref><ref type="bibr">Yasmin et al., 2022)</ref>. Several innovative robot designs including conventional wheeled robots inspired designs <ref type="bibr">(Guo et al., 2014;</ref><ref type="bibr">Kamdar, 2015;</ref><ref type="bibr">La et al., 2019;</ref><ref type="bibr">Pham et al., 2020</ref><ref type="bibr">Pham et al., , 2022;;</ref><ref type="bibr">Pham &amp; La, 2016;</ref><ref type="bibr">Sirken et al., 2017;</ref><ref type="bibr">Zhu et al., 2012)</ref> and tank-like tracks widening the contacting areas of the robots on steel surfaces <ref type="bibr">(Lee et al., 2012;</ref><ref type="bibr">Nguyen &amp; La, 2021</ref><ref type="bibr">, 2019a;</ref><ref type="bibr">Seo &amp; Sitti, 2013;</ref><ref type="bibr">Shen et al., 2005;</ref><ref type="bibr">Song et al., 2022)</ref> have been presented in recent years. Such designs can work well on structures with large surfaces such as ships or tanks but encounter difficulties on complex surfaces, for example, bridges and oil rigs. Inspired by the mobility capacity of climbing animals, spider-like robots <ref type="bibr">(Bandyopadhyay et al., 2018)</ref>, legged robots <ref type="bibr">(Mazumdar &amp; Asada, 2009)</ref>, inchworm-like robots <ref type="bibr">(Lin et al., 2023;</ref><ref type="bibr">Ward et al., 2015)</ref>, and hybrid robots <ref type="bibr">(Bui et al., 2020;</ref><ref type="bibr">Nguyen et al., 2020;</ref><ref type="bibr">Pham et al., 2021)</ref> were designed and examined. However, it is challenging to design a controller for the complexity of robot mechanics in real-world applications. The recent development of aerial robots provides an alternative inspection solution <ref type="bibr">(Elios, 2018;</ref><ref type="bibr">McConnell &amp; Zuleger, 2019)</ref>. Nonetheless, conventional drones may not be feasible with installing touched sensors required for in-depth inspections of fatigue cracks or thickness of steel structures. Other nonstandard moving mechanisms were proposed accordingly <ref type="bibr">(Eto &amp; Asada, 2020;</ref><ref type="bibr">Md-Yusoff et al., 2022;</ref><ref type="bibr">Nguyen &amp; La, 2019b;</ref><ref type="bibr">Takada et al., 2017)</ref>. The notable state-of-the-art climbing robots for inspection are listed in Figure <ref type="figure">2</ref>. SAIR ( <ref type="formula">2016</ref>) is an improved version of a two-magnetic wheeled robot with modification of the rear wheel as Omni. This function helps the robot to get a large steering angle which is useful in narrow spaces. However, mainly designed for pipe inspection, the robot is unable to pass difficult obstacles. BridgeBot <ref type="bibr">(Sirken et al., 2017)</ref> is a soft frame four-magnetic wheeled robot. The idea is to make BridgeBot flexible to fully adhere to any steel surface and pass transitions. Even though, thin edge or small cylindrical structures is impossible for this robot. Proposed as high mobility with four sphere wheels and two-degree-of-freedom rotational magnetic adhesion mechanism, Eto and Asada (2020) can work well on curved surfaces and pass transition except for edges. Priorly proposed bikelike robots such as <ref type="bibr">T&#226;che et al. (2009)</ref> and <ref type="bibr">Caprari et al. (2012)</ref> do not have high directional flexibility, limiting mobility in narrow spaces.</p><p>The rigid shapes of such robots restrict their maneuverability for passing extreme obstacles, such as thin edges or acute corners.</p><p>Except <ref type="bibr">(Bike, 2016)</ref>, these mechanical designs do not have a mechanism for touched sensors that are essential in structural inspection tasks, for example, measuring material thickness, paint quality, and structural vibration. Ship Inspection Robot <ref type="bibr">(ETH Z&#252;rich &amp; ZHdK, 2015)</ref> is a rare robot designed to pass thin edges for internal ship inspection. Nonetheless, the robot cannot deploy on curved curvatures. A high-strength multisteering climbing robot for steel bridge inspection <ref type="bibr">(Motley et al., 2022)</ref> is developed by the Advanced Robotics and Automation (ARA) lab for heavy load applications. Four independent steering capabilities of moving wheels make the robot multidirectional. However, with this configuration, the robot only can work on continuous flat surfaces. A hybrid worming-mobile robot <ref type="bibr">(Nguyen et al., 2020)</ref> combines both the advantages of wheeled locomotion on continuous surfaces and the flexibility of inchwormlike movement on transitions. The ARA robot's design applies to navigation on various steel structures. However, its complex mechanical system results in difficulty in control architecture and causes limitations in industrial approaches, which require simplicity and optimization. None of the above-mentioned robots can achieve radical climbing capability on complex structures, including flat, concave, convex, and curved curvatures, and edge transition in a simple form of robot design. They are the most challenging architectures described in Figure <ref type="figure">3</ref>. In practice, the tough environments that a crawling robot needs to deal with include I-shape beams, cylindrical structures, and transitions/joints as shown in Figure <ref type="figure">3a</ref>,b; flanges in pipelines Figure <ref type="figure">3c</ref>, and reinforced edges Figure <ref type="figure">3d</ref> in ships, tanks, or bridges as well as limited space in those structures. This paper presents a novel two-wheeled-climbing robotic system to provide an efficient inspection solution for complex steel structures. We focus on optimizing the climbing capability and the multidirectional locomotion of a bike-liked wheeled-climbing robot, making it maneuver on complex ferromagnetic structures. We also developed a transforming mechanism enabling the robot to reconfigure to overcome concave and convex-edged obstacles, such as L-, T-, and I-shaped beams or thorny corners/edges. Robot architecture allows us to equip a sensor deploying mechanism for both an ultrasonic-based steel thickness measurement sensor and a camera in the most space-efficient package. This study is a full and upgraded version evolved from our initial prototypes of <ref type="bibr">Nguyen et al. (2022)</ref> and <ref type="bibr">Ahmed, Nguyen et al. (2022)</ref>. This upgraded version has improved robot stability when traversing horizontally on cylindrical structures by generating a new locomotion mode. Moreover, a simpler but more efficient method of a flexible material in the contacting part helps enhance the sensor deploying mechanism function. We demonstrated the robot's working principles and functionalities through laboratory and field tests. Video of this deployment can be seen from the ARA Laboratory's website at this link: <ref type="url">https://ara.cse.unr.edu/?page_   id=11</ref>.</p><p>The rest of the paper is organized as follows. Section 2 describes the overall robot design. Section 3 presents a detailed mechanical design and magnetic force analysis of the robot when moving on surfaces with different inclinations. Section 4 analyzes magnetic force on different surface curvatures under both static and dynamic conditions. Section 5 demonstrates various experiments to verify the proposed robot design and validate the magnetic force analysis, robot locomotion, and transformation. Finally, the conclusion and discussion of future work are presented in Section 6.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">| OVERALL DESIGN</head><p>The front view and the back view of the robot are depicted in Figure <ref type="figure">4a</ref>.</p><p>We added a steel thickness measurement transducer in the space between the two wheels. This location is ideal for protecting the sensor when traveling and allows good contact for measurements, whether the robot is working on flat or curved surfaces. The robot's mass is 1.2 kg, including the sensors (a thickness measurement sensor and a camera).</p><p>We used three-dimensional (3D)-printed ABS plastic to manufacture the frame for a lightweight robot. When powered by a 700-mAh LiPo battery, a human operator can remotely control the robot to work for 30 min. Figure <ref type="figure">4b</ref> shows the overall mechanical design of the robot. The robot's dimension is 150 mm &#215; 80 mm &#215; 90 mm. We place the ring magnets at the cores of the two rubber-covered wheels, driven by two high-torque gear direct current motors (100 kg &#8901; cm torque each). The steering actuators and transforming mechanisms are controlled by two servos (32 kg cm torque each). The front and the back of the frame are linked by a bearing acting as a dynamic joint.</p><p>For high mobility, two revolute joints are installed, making two steering units (Figure <ref type="figure">5</ref>). These two units allow the robot to work in two modes: bicycle-like and multisteering modes. The bicycle-like mode is utilized when the robot operates on large surfaces with only one activated steering unit (Figure <ref type="figure">5a</ref>). On narrow surfaces, the robot can change direction by activating the rear steering unit instead of the front one (Figure <ref type="figure">5b</ref>). In locations that require sideway movements, the multidirectional mode is enabled. In this mode, two steering units are active simultaneously as in Figure <ref type="figure">5c</ref>. The maximum turning angle is kept at less than 90&#176;to maintain the robot's stabilization in this mode. In  F I G U R E 5 Design concept shows the maneuverability of the robot with active joints colored green (for the front joint) and blue (for the rear joint). Two independent steering actuators allow the robot to enable bicycle-like moving modes: (a) when only the front steering unit is activated, (b) when only the rear steering unit is activated to change direction on narrow surfaces, (c) when two steering units are activated simultaneously; the robot can move sideways, and (d) the mix of bicycle and multidirectional modes. On horizontal traversing, the bicycle shape is weak in maintaining adhesive torque. This mode improves this disadvantage with wheel paralleling configuration but is still able to turn. ICR, Instantaneous Center of Rotation. and multidirectional mode (Figure <ref type="figure">5d</ref>) is switched to enhance safety. The kinematic of robot mobility with Instantaneous Center of Rotation is described in Figure <ref type="figure">6</ref>, which represents all four different modes corresponding to the ones described in Figure <ref type="figure">5</ref>.</p><p>In addition, a free joint (orange joint in Figure <ref type="figure">7</ref>) working as a dynamic connection between two halves of the robot's body allows the two wheels to stick to surfaces effectively, even on uneven ones, such as two flat curvatures (Figure <ref type="figure">7a</ref>), positive curvatures (Figure <ref type="figure">7b</ref>), or negative curvatures (Figure <ref type="figure">7c</ref>). Our design also enables the robot to pass thin edges and acute corners with two other revolute joints shown in Figure <ref type="figure">8</ref>. These two joints allow the distance between the two wheels to be adjustable based on surfaces as shown in Figure <ref type="figure">8c</ref>,<ref type="figure">d</ref>. F I G U R E 7 Free joint (orange) in the middle of the robot's body helps its wheels to better adhere to uneven surfaces, for example, (a) two flat curvatures, (b) positive curvatures, and (c) negative curvatures.</p><p>F I G U R E 8 Our design allows the distance between the two wheels to be adjustable with two revolute joints. The robot can pass corners without activating the two joints in normal conditions (a, b). However, the robot can adjust the wheels' distance (the two joints are activated, hence colored purple) to be small to pass a thin edge (c) or large to pass an acute corner (d).</p><p>The bicycle robot is also designed to work in extreme situations such as horizontally traveling on a cylindrical structure as shown in control loops. These servo motors orchestrate the movement of different components, including front and rear steering units, front and rear mobile motors, gel pumping mechanisms, and sensor deployment and transformation mechanisms.</p><p>The adoption of this well-structured hierarchical control approach empowers the robot to accomplish its designated tasks with notable efficiency and accuracy. The high-level control facilitated by ROS manages data processing and seamless communication, while the low-level control, orchestrated through the Arduino platform, ensures responsive and precise actuation of the robot's servo motors. This intricate interplay allows the robot to execute a diverse range of movements and tasks with agility and precision. This dichotomy of control levels establishes a resilient and versatile robot control system, tailored to diverse application scenarios and environments.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">| MECHANICAL DESIGN AND ANALYSIS</head><p>This section provides a detailed mechanical analysis of our robot, including the analysis of the robot transformation, the robot maneuverability, and the sensor deployment mechanism. F I G U R E 10 The robot's control system with Arduino board, and sensor integration with onboard computer. Rx, receiver; Tx, transmitter.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1">| Robot transformation analysis</head><p>We use reciprocating mechanisms to allow the distance between the two wheels to be adjustable. Due to the high load of attractive force when the two wheels are close, a feed screw is applied for the slidercrank part. The mechanism can transform the robot into three different shapes depending on particular situations, as shown in Figure <ref type="figure">11</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1.1">| Kinematic analysis</head><p>The kinematic is analyzed in Figure <ref type="figure">12</ref>, where W is the wheel center, reciprocating mechanism XYZ, and z XS = , we have</p><p>Square then sum both sides of ( <ref type="formula">1</ref>) and ( <ref type="formula">2</ref>), we have</p><p>(3)</p><p>resulting in a function &#948; f z = ( ).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1.2">| Force</head><p>The robot's shape transformation is the combination of controlling &#948; in Figure <ref type="figure">13</ref> and moving wheels simultaneously. The load (the magnetic force between the two wheels) is shared between the two wheels and the reciprocating mechanism. From Figure <ref type="figure">13</ref>, with F as the attractive force between the two wheels, M load is the torque that feeds screw bears, and i is the feed screw's transmission ratio, we have</p><p>load wheel</p><p>(5)</p><p>3.2 | Robot maneuverability analysis</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.1">| Adhesive force</head><p>We analyze the adhesive force that the robot needs to climb reliably in any normal working conditions. We perform the analysis in an extreme situation where the adhesive force between the magnetic </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>F I G U R E 12</head><p>The reciprocating mechanism's kinematic.</p><p>wheels and the contacting structures is minimal Figure <ref type="figure">14</ref>. Here, X 1 and X 2 are two contact points of the back wheel and front wheel, respectively. We call P the robot's weight, and h is the distance from the center of mass of the robot to X 1 . If F 2 is an adhesive force of the front wheel at X 2 then F 2 is at its minimum when the front wheel hits the corner. To keep the robot safe, the following condition needs to be satisfied:</p><p>According to ISO 3691 (IEC60034, 2022) for safe weight lifting, a safety factor of 5 was selected. Therefore, the real adhesive force F 2 needs to be at least five times greater than the result from the above theoretical calculation in (6).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.2">| Extreme locomotive situations</head><p>This analysis calculates the necessary motor torque when the robot stands the highest load. The highest load occurs when the robot passes an internal corner between two perpendicular surfaces (Figure <ref type="figure">15</ref>), the front wheel bears an additional force F 2.2 , which is the adhesive force of the front wheel on the surface 2. Similarly, F 2.1</p><p>is the adhesive force of the front wheel on surface 1. F f2 is the friction of the front wheel on surface 2, r is the wheel's radius, k is the static friction coefficient (between rubber and steel in our design). The minimum force of the front wheel that allows the robot to be able to overcome the corner must satisfy</p><p>Therefore, the moving motor torque needs to satisfy</p><p>According to IEC 60034 (ISO3691, 2020), the actual torque selected is at least double that of the theoretical calculation in (8).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.3">| Steering</head><p>An analysis is conducted to investigate the load torque on the revolute joints. Two forces affect each other as illustrated in</p><p>Figure <ref type="figure">16</ref>: the static friction and the attractive force at the two magnetic wheels. Let F 12 be the adhesive force of wheel 1 affecting F I G U R E 13 Force analysis of the reciprocating mechanism.</p><p>F I G U R E 14 A situation where the adhesive force is minimal, resulting in a high chance of falling over. In this case, the adhesive force of the front wheel is significantly reduced when the robot hits an edge.</p><p>F I G U R E 15 When the robot passes an internal corner between two perpendicular surfaces, the robot's load increases significantly.</p><p>wheel 2, F f be the friction at X 2 . The measured load-force at point L (Figure <ref type="figure">16a</ref>) has to satisfy the following condition:</p><p>Thus, the steering servo torque needs to satisfy</p><p>steering 12 2</p><p>(10)</p><p>On the basis of IEC 60034 (ISO3691, 2020), the actual servo's torque is chosen to be at least twofold compared to that of the theoretical calculation in (10).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.4">| Horizontal traversing</head><p>This analysis provides a solution when fulling torque dramatically reduces when the robot travels horizontally on a cylindrical structure Figure <ref type="figure">17a</ref>. Because crank l 2 is short, the torque to keep the robot avoid turnover is weak as below:</p><p>To improve the safety factor in this situation, the robot should transform to the mixed mode as Figure <ref type="figure">5d</ref>. Crank l 1 is much longer than l 2 , so the fulling torque becomes</p><p>1 1 2 2</p><p>(12)</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3">| Sensor deployment mechanism analysis</head><p>A four-bar mechanism is designed for generating vertical movements of the transducer, as shown in Figure <ref type="figure">18</ref>. A compression spring is added together with an angle lock to avoid the overload of servo motors and enhance contact between the transducer and the working surfaces.</p><p>We analyze the mechanism using a simplified model shown in </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3.1">| ACE analysis</head><p>From Figure <ref type="figure">19</ref>, we have</p><p>Applying the similar approach as in ( <ref type="formula">1</ref>) and ( <ref type="formula">2</ref>) for ( <ref type="formula">13</ref>) and ( <ref type="formula">14</ref>), we have </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3.2">| BDE analysis</head><p>From Figure <ref type="figure">19</ref>,</p><p>where y x BF = -. Similarly, (18) presents a function &#946; f y = ( ).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3.3">| Servo crank analysis</head><p>From Figure <ref type="figure">20</ref>, we have</p><p>Square and sum both sides of ( <ref type="formula">19</ref>) and ( <ref type="formula">20</ref>) then simplify, we have</p><p>presenting a function f &#945; &#1013; = ( ).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.4">| Wheel tire and couplant pumping</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.4.1">| Wheel tire design</head><p>Wheel tires require a particular pattern to warranty the robot's stability in extreme situations; particularly, when the robot's body</p><p>The four-bar mechanism. A flexible part (thermoplastic polyurethane [TPU]) acts as a soft contact between the probe and surfaces. An angle lock is added to create a range of free movement of the probe when approaching uneven surfaces.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>F I G U R E 19</head><p>The four-bar mechanism's kinematic.</p><p>F I G U R E 20 The kinematic of the four-bar mechanism (AGHK) with HK is the servo arm.</p><p>is horizontal as it travels along a cylinder bar. Figure <ref type="figure">21</ref> depicts a cross-section in this situation. With one strip of tire for the entire wheel, the robot's body is inclined because of gravity (Figure <ref type="figure">21a</ref>), causing drifting when the robot turns. To fix the drifting issue, two separated rubber strips are applied to improve the approaching area between the tire and curved surfaces. As shown in Figure <ref type="figure">21b</ref>, using two strips, the turning point L is created, and the torque eF mag is generated to stabilize the robot's body.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.4.2">| Couplant</head><p>Since we use an ultrasonic sensor for thickness measurement, couplant is necessary to fill the air gap between the transducer and the test specimen <ref type="bibr">(Otsuki et al., 2022)</ref>. The couplant with high viscosity is utilized to stick well on surfaces, even in upside-down or vertical positions. We selected the peristaltic pump type for highviscosity gel. We also chose the syringe mechanism for gel storage because it can work on any robot pose. The pump is described in Figure <ref type="figure">22</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">| MAGNETIC FORCE ANALYSIS</head><p>The previous analysis is only applied when the robot moves on flat steel surfaces. However, there are also structures, which have curved surfaces and extreme cases when magnetic force significantly increases or decreases. So, the following analysis will help determine the impact of the magnetic force created.</p><p>We conducted experiments with different steel shapes in real conditions to verify the performance of the magnetic wheel in both static and dynamic conditions.</p><p>The wheels tested is N52 neodymium magnet with a dimension of 2.5&#8243; od &#215; 1/2&#8243; id &#215; 1&#8243; thick. In static conditions, the minimum pull force is 205N at 100mm diameter steel cylinder. At an edge, the force drops to 145N. In the 90&#176;internal corner, the force hit 345N. In dynamic conditions, with the robot's velocity of 20 cm/s, adhesive force falls to around 10%.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1">| Static condition</head><p>To measure the adhesive force created by permanent magnets, we set up Figure <ref type="figure">24</ref> shows the testing results of a noncoated magnetic wheel on flat and different curved surfaces. On a flat surface magnetic force gets a maximum of nearly 300 N. With 0.5 mm rubber coated, the force decreases by around 9%. Figure <ref type="figure">25</ref> the testing results of a noncoated magnetic wheel on 90&#176;internal (345N)</p><p>and external corners (145N). These are two extreme cases that the robot deals with complex steel structures.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2">| Dynamic condition</head><p>We also measure the adhesive force of the robot in a moving state as shown in Figure <ref type="figure">26</ref>. Each measurement is conducted three times. On average, the adhesive force in the dynamic condition is lower than approximately 10% compared to the static state.</p><p>In this experiment, the full force the robot's body is measured. The adhesive force is generated by two wheels, and P in Equation ( <ref type="formula">22</ref>  In the worst situation, when a robot passes a thorny edge, two coated wheels contact least to the structure. The adhesive force of each wheel is lowest by 145N-9% of coated tire reduction-10% of force losing in dynamic conditions =119N.</p><p>Two wheels generate 238N, robot's weight is 2 kg, which still satisfies Equation ( <ref type="formula">6</ref>). Therefore, the robot is safe in surveyed situations.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5">| ROBOT DEPLOYMENT</head><p>To evaluate the design and performance of the robot, experiments for evaluating the magnetic force created by magnetic wheels have been conducted. The ability of climbing and failure avoidance were tested. During the test, a LiPo battery (two cells) 7.4 V 900</p><p>milliampere-hour (mAh) is used to power the robot for about 30 min of working. One laptop which can connect to a wireless LAN is used as a ground station. The robot's mass m = 2kg, and if we assume that the gravitational acceleration g = 10m&#8725;s 2 , the total weight of the robot is approximately P mg = =20N.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.1">| Laboratory tests</head><p>We built an indoor structure comprising typical parts of general steel structures (cylinder, L-, I-, U-shaped beams) with structural transition joints to validate the robot's locomotion functionalities. Our robot can traverse smoothly to all locations in the testing structure.</p><p>Figure <ref type="figure">27</ref> shows the verification of the robot design in extreme conditions. The robot crosses convex and concave surfaces. The robot makes a 90&#176;turn on internal and external corners. Figure <ref type="figure">28</ref> illustrates that the robot is working on a cylindrical shape. The robot in bicycle mode gets sliding when trying to transit between two surfaces. The robot can pass it smoothly in multidirectional mode.</p><p>Figure <ref type="figure">29</ref> shows the robot working on a cylindrical structure.</p><p>Figure <ref type="figure">30</ref> illustrates the process by which the robot passes a thorny edge. A transforming mechanism is utilized in this situation. Figure <ref type="figure">31</ref> describes the process by which the robot transforms in shape to adapt to an acute corner. Once the front wheel can hit the second surface, the transition is conducted easily. Figure <ref type="figure">32</ref>   </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.2">| Field tests</head><p>Several robot implementations on local and highway bridges have been conducted to verify robot performance in real working conditions. The robots deployed on three bridges with two main structures: cylindrical and I-shape beams. The first test is on a cylindrical type bridge as shown in Figure <ref type="figure">35</ref>. The bridge's structure includes cylindrical surfaces of 30 and 22 cm diameters.</p><p>The robot performs thickness measurements in some areas that are rusty to check how severe the corrosion is. However, our sensor deployment mechanism cannot reach the internal angles of some rusted spots due to the vertical height limit of the four-bar mechanism.</p><p>We deployed the robot in a field test during a bi-annual Highway inspection in Nevada, USA. The bridge is located on Highway-80 in Lovelock City. Figure <ref type="figure">36</ref> shows the robot's performance in a real application, and the robot was able to traverse stably on the structure and collect data on this bridge.</p><p>The robot reliably passes extreme cases of I-shape beam structures, including internal and external corners. In real conditions, thick dust may reduce the pulling force and friction factor.</p><p>However, a high safety factor helps the robot get in no trouble (Figure <ref type="figure">37</ref>).</p><p>There is a data synchronization with the robot's pose presented when the robot deploys on a Highway bridge I-75 in Georgia, USA (Figure <ref type="figure">38</ref>).</p><p>The robot successfully passes all the tests both indoors and outdoors. In actual working conditions, dust and rusty particles are further challenges that the robot must deal with. They reduce adhesive force and friction constant.</p><p>The robot tests and deployments with an ultrasonic sensor for steel thickness measurement are demonstrated in this video: https:// youtu.be/Qdh1oz_oxiQ.</p><p>In our rust detection approach, we harnessed the effectiveness of the Unet architecture alongside a ResNet-18 encoder for the identification of rust on steel structures <ref type="bibr">(Ahmed, Nguyen, et al., 2022)</ref>.</p><p>The choice of this particular encoder was driven by its demonstrable superior performance in comparison to alternative encoders, namely, ResNet-34, RegNet-X-2, Efficient-b0, and Efficient-b2. Similarly, we also leveraged the DeepLab architecture, this time coupled with a ResNet-18 encoder, which yielded enhanced rust detection capabilities when contrasted with other encoder options <ref type="bibr">(Ahmed &amp; La, 2022;</ref><ref type="bibr">Ahmed, Nguyen, et al., 2022)</ref>.</p><p>For our investigation, we compiled a data set comprising 1500 steel images sourced from bridges and assorted steel structures in Vietnam <ref type="bibr">(Pham et al., 2024)</ref>. This data set was employed to train the architecture-encoder pairs. Upon conducting comprehensive offline training sessions for these pairs, we proceeded to validate their efficacy. This validation phase F I G U R E 37 Robot smoothly traverses an edge of I-shape beam on the deployment on Highway-80. F I G U R E 38 Robot deployment and data collection on a bridge on Highway I-75 in Georgia, USA. Robot positions and steel thickness data are synchronized in real-time. The robot path is represented in white color. Steel thickness measuring positions are red dots. Thickness data (numbers in green color) is shown in inch units.  One particularly intriguing trajectory for future exploration involves the integration of advanced 3D cameras. Such an augmentation could pave the way for autonomous localization, navigation, and inspection via image processing, thereby ushering in a new era of fully automated inspection tasks. As we steer towards these future horizons, this paper sets the foundation for a dynamic evolution of steel structure inspection, with the bicycle-like robot poised to become an indispensable tool in this domain.</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_0"><p>15564967, 2024, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1002/rob.22266 by University Of Nevada Reno, Wiley Online Library on [23/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License</p></note>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_1"><p>NGUYEN ET AL. 15564967, 2024, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1002/rob.22266 by University Of Nevada Reno, Wiley Online Library on [23/05/2024]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License</p></note>
		</body>
		</text>
</TEI>
