
==== Front
Nat Commun
Nat Commun
Nature Communications
2041-1723
Nature Publishing Group UK London

39227604
51633
10.1038/s41467-024-51633-x
Article
Motor-free telerobotic endomicroscopy for steerable and programmable imaging in complex curved and localized areas
http://orcid.org/0000-0001-5095-5372
Yuan Sishen 1
http://orcid.org/0000-0001-8096-7489
Xu Chao 2
http://orcid.org/0009-0009-7900-8032
Cui Beilei 1
http://orcid.org/0000-0001-8559-4458
Zhang Tinghua 2
Liang Baijia 1
http://orcid.org/0000-0001-9405-519X
Yuan Wu wyuan@cuhk.edu.hk

2
http://orcid.org/0000-0002-6488-1551
Ren Hongliang hlren@ee.cuhk.edu.hk

1
1 grid.10784.3a 0000 0004 1937 0482 Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
2 grid.10784.3a 0000 0004 1937 0482 Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
3 9 2024
3 9 2024
2024
15 76806 5 2024
12 8 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by-nc-nd/4.0/ Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
Intraluminal epithelial abnormalities, potential precursors to significant conditions like cancer, necessitate early detection for improved prognosis. We present a motor-free telerobotic optical coherence tomography (OCT) endoscope that offers high-resolution intraluminal imaging and overcomes the limitations of traditional systems in navigating curved lumens. This system incorporates a compact magnetic rotor with a rotatable diametrically magnetized cylinder permanent magnet (RDPM) and a reflector, effectively mitigating thermal and electrical risks by utilizing an external magnetic field to maintain temperature increases below 0.5 °C and generated voltage under 0.02 mV. Additionally, a learning-based method corrects imaging distortions resulting from nonuniform rotational speeds. Demonstrating superior maneuverability, the device achieves steerable angles up to 110° and operates effectively in vivo, providing distortion-free 3D programmable imaging in mouse colons. This advancement represents a significant step towards guidewire-independent endomicroscopy, enhancing both safety and potential patient outcomes.

Abnormalities in intraluminal epithelium can point to serious diseases. Here, the authors present a mono-magnet actuated OCT endoscope that enables high-resolution, programmable imaging in complex lumens without local heat effects, with safety and quality in thermoelectrically sensitive scenarios.

Subject terms

Biomedical engineering
Optoelectronic devices and components
Mechanical engineering
Biophotonics
This work was supported by the Hong Kong Research Grants Council (CRF C4026-21G, RIF R4020-22, GRF 14216022, NSFC/RGC Joint Research Scheme N_CUHK420/22) and the Shenzhen Science, Technology and Innovation Commission (SGDX20210823103535014), granted to Prof. Ren Hongliang.This work was also supported by the Hong Kong Research Grants Council (ECS24211020, GRF14203821, GRF14216222), the Hong Kong Innovation and Technology Fund (ITS/240/21), and the Shenzhen Science, Technology and Innovation Commission (SGDX20220530111005039), granted to Prof. Yuan Wu.issue-copyright-statement© Springer Nature Limited 2024
==== Body
pmcIntroduction

Abnormalities in intraluminal epithelium can herald the onset of serious diseases such as cervical cancer1,2, bladder cancer3, esophageal cancer4, lung cancer (especially bronchial carcinoma)5, and pancreatic cancer6. The importance of early detection and intervention strategies by imaging membrane microstructures, like the mucosa, are broadly acknowledged in the literature7. Optical coherence tomography (OCT) generates high-resolution images with an axial resolution of ~1–15 µm8,9. Its penetration depth is tissue-dependent, spanning 0.1–2.0 mm, relatively inferior to that afforded by ultrasound10. Other methods, like confocal endoscopy, offer higher resolution (0.5–1 µm) but limited imaging depth (up to 250 µm)11. By striking a balance between imaging resolution and depth, OCT emerges as a promising modality for intraluminal imaging. It has also been validated for accurately diagnosing coronary artery disease and thrombus formation12,13 (see

However, the complex structure of internal lumens14 and their dynamic nature15, as well as the mechanical rotational resistance encountered during imaging, impose challenges to conventional OCT endoscopes operating in proximal scanning mode12. This mode involves the torque transmission from a proximal motor via a torsion spring. It is not applicable for deployment in certain in vivo settings12, such as the nearly perpendicular intersection between the pancreatic duct entrance and the duodenum16, and the large subcarinal angles of the anterior segment of the left main bronchi17. The sharp turns introduce uneven pressure along the torsion spring, hindering smooth torque transmission. As a consequence, nonuniform distal rotation and imaging distortions occur. To overcome these obstacles, the miniature permanent magnet synchronous motor (PMSM) presents a promising alternative for directly driving the distal end of the probe18,19. However, the use of PMSM inevitably generates local heat, which may trigger thermal injuries and leads to thrombus formation and blood–brain barrier disruptions20–23. In addition, potential voltage leakages are unacceptable for their potential to induce arrhythmias, respiratory arrest, seizures, or even direct brain damage and paralysis24–26. Electrical shock injuries may stimulate a rise in thrombin levels, thereby leading to vasoconstriction and thrombus formation27–29. These potential risks have precluded the use of PMSM-based endomicroscopy in thermoelectric-sensitive scenarios.

Previous studies have demonstrated the application of an external magnetic field to a magnetized object, enabling both rotational and linear movements30. The telerobotic mono-magnet actuator has recently demonstrated potential in tasks such as guidewire navigation31 and stent deployment32, owing to its operational flexibility, ease of implementation, and compact design. Moreover, its ability to continuously achieve a 0–30 Hz magnetic field working frequency without significant heat effect and to avoid substantial interference with ferromagnetic surgical instruments enhances its safety and clinical potential33–35 (see Supplementary Note 1). This has led to the replacement of internal electromagnetic motors in PMSMs with external magnetic actuators, circumventing the risks of local heat and voltage leakage36,37. However, the exploration of mono-magnet-actuated robotic systems for OCT imaging in complex and curved environments is still limited. In particular, the effects of a 6-degree-of-freedom (DoF) mono-magnet, allowing translation along x, y, z axes and rotation around three axes (see Fig. 1a), in a nonlinear magnetic field (0–10 mT/mm), along with the difficulties in designing and fabricating a millimeter-scale probe, on imaging quality, remain poorly understood. Furthermore, the simultaneous remote optical scanning and steering entails further research.Fig. 1 Overview of the MMAT-OCT system and its capacities.

a A 6-degree-of-freedom (6-DoF) robotic arm terminated with a magnetic actuator for probe navigation and OCT imaging in in vivo scenarios. The black box represents the MMAT-OCT probe. BEPM indicates the magnetic field generated by the actuator. b Schematic of the ultrahigh-resolution 800-nm SD-OCT endoscopic system. AC achromatic collimator, PP prism pair, M mirror, PC polarization controller, CLTS computerized linear translation stage. c Assembly design (I) and photography (II) of the MMAT-OCT probe. d Schematic illustration of steering MMAT-OCT in a phantom model. Fmag denotes the magnetic force, Tmag denotes the magnetic torque. e The angular scanning MMAT-OCT with a pullback CLTS, enabling programmable imaging of the targeted tissue. r denotes the inner diameter of the cavity; θ is the scanning angle; and l represents the laser’s path during the angular scanning. The cross-sections display the representative angular scans of the mouse colon tissue. a, b Created with BioRender.com released under a Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/deed.en).

Here, we present the mono-magnet actuated OCT (MMAT-OCT), a telerobotic-OCT endoscope that incorporates a rotatable diametrically magnetized cylinder permanent magnet (RDPM) controlled by the mono-magnet actuator, enabling high-resolution navigational imaging in complex lumens (see Fig. 1a, b). The externally driven magnetic field eliminates heat effects induced by current and voltage, achieving a maximum generated voltage of less than 0.02 mV (estimated current of less than 0.016 mA as opposed to 0.7–3.8 A in PMSMs19,38), and a temperature rise of less than 0.5 °C (compared to 2–8 °C in PMSMs19,38) after an hour of continuous operation (see Supplementary Note 2). The proposed MMAT-OCT probe is produced utilizing a simple and economical laboratory technique, with a total cost not exceeding US$ 14 (as opposed to US$ 1000–2000 in commercial PMSMs, see Fig. 1c and Supplementary Table II)38,39. Despite the challenges posed by the small probe size, making closed-loop feedback control unfeasible, and the introduction of nonuniform rotational distortion (NURD) during open-loop sampling, a neural network trained with synthetic data is employed to effectively identify and correct distorted regions in OCT images (see Figs. 2 and 3). The 3D imaging performance of MMAT-OCT has been further validated on in vivo mouse colon and rat esophagus (see Fig. 3c, d). The mono-magnet actuated RDPM inside the probe distal allows for maximum steering of 110° at a working distance of 30 mm (magnetic field strength ~500 mT, gradient ~0.06 mT/mm). We demonstrate the guidewire-free navigation of MMAT-OCT under extreme bending conditions using an ex vivo vascular phantom (see Figs. 1d and 4). This feature improves the utility of MMAT-OCT in thermoelectrically sensitive cavities by addressing issues such as guidewire shadow that obstruct tissue or stent visualization. It also prevents OCT endoscope entrapment and tissue damage during guidewire withdrawals in distal, calcified, or curved vessels12. The mono-magnet actuator reliably controls the RDPM’s orientation with an average open-loop angle control error of ~4°, facilitating programmable 3D imaging (see Figs. 1e and 5). These advancements have the potential to greatly enhance microscopic mucosal imaging technologies, opening up possibilities for targeted imaging, diagnosis, and therapy40.Fig. 2 Quantitative evaluation of the MMAT-OCT’s scanning performance.

a Operational configuration of the EPM and MMAT-OCT probe within the robotic system (I), inclusive of RDPM force analysis (II), and the simulated and theoretical impact of relative positioning (i.e., working distance) on the magnetic forces (III1 and IV1) and torques (III2 and IV2) exerted on the RDPM (FEM refers to the finite element method; MDM refers to the magnetic dipole model). Plane abcd serves as the central radial section of the EPM for reduced 2D dynamics analysis of the RDPM. L indicates the working distance. The forces and torques analyzed include the magnetic force Fm, gravity G, normal force Fn, and coulomb friction Ff from the enclosure, along with magnetic torque Tm and frictional torque Tf, and n represents the RDPM’s magnetic moment, and α indicates the contact point position between the RDPM and the enclosure. b Comparison of simulated and example measured rotation dynamics (n = 3) under variant L ranging from 45 to 65 mm, based on three independent measurements, along with the corresponding box plots from 100 samples, consistent with the measured data. Mean friction coefficients in simulated conditions are: μ¯c1 = 0.12; μ¯c2 = 0.325; μ¯c3 = 0.53. Cubic spline interpolation is used to approximate the rotation dynamics in the left figure. c Comparison of OCT images at sampling frequencies of 20 Hz, 30 Hz, and 40 Hz for a rated rotation frequency of 10 Hz. Blue arrows indicate missing A-line regions, while red arrows indicate strut locations. In all box plots, the center line represents the median. The red hollow square in the middle indicates the mean. The bounds of the box indicate the 25th (Q1) and 75th (Q3) percentiles. The whiskers extend to the smallest and largest values within 1.5 times the interquartile range (IQR) from the bounds of the box (Q1 − 1.5IQR, Q3 + 1.5IQR). Data points outside this range are considered outliers and are plotted individually. Source data are provided as a Source Data file.

Fig. 3 NDNC-Net modeling RDPM rotation dynamics for correcting OCT NURD.

a Synthetic data generation involves distortion-free B-frame resampling with theoretical and measured rotation dynamics. The integrated area (e.g., s1 and s’1, unit: rad) of rotational speed (unit: rad/s) over the sampling interval (i.e., λ1 and λ′1, unit: second) represents the displacement of the acquired A-line. The matched index pairs (e.g., 1 and 1’) describe the same column pixel. The intervals between adjacent A-lines in resampled images either stretch or shrink compared to the distortion-free B-frame due to nonuniform rotation dynamics during resampling. Conversely, NURD correction is the inverse operation of synthetic data generation. The estimated rotation dynamics are derived from NCNet. b Inference phase: Struct detection network and NDNet detect struct regions and stretching regions. Preprocessing steps, including cropping and padding, estimate the rotation dynamics using NCNet. The unit “a.u.” stands for arbitrary units. The final corrected image is obtained by resizing and concatenating the stretch-corrected regions, stretch-free regions, and struct regions. c, d Test NDNC-Net on mouse colon (n = 4 biological replicates) and rat esophagus (n = 4 biological replicates) images, demonstrating high-resolution tissue microstructures correlating well with histological micrographs. Scale bars are 250 µm.

Fig. 4 Design and evaluation of the steerable MMAT-OCT for luminal navigation.

a Design of the Flexible–Soft–Rigid segmented gradient stiffness distribution of the MMAT-OCT. b Analytical and experimental results (n = 3) of the maximum bending angle in the orthographic (OPA, I and II) and lateral (LPA, III) projection areas. A dashed line indicates the fit. Data are presented as mean values +/− SD. c MMAT-OCT with a 10° pre-bend (a) tested on a transparent, rigid vascular phantom (I). The gray arrows indicate the feed or withdrawal direction of the MMAT-OCT. The blue arrows represent the resistance applied by the phantom on the probe. The red arrows denote the steerable force/torque. Manual advancement without rotation. Path 1 (a1–e1) shows navigation challenges overcome by EPM-induced 20° deflection at 00.24 s. Successful lumen retraction between 00.44 s and 00.46 s. At 00.53 s, the probe traps at c1, likely due to frictional self-locking. (II). Effective navigation of a longer, curved lumen (a2–g2) demonstrates the Flexible–Soft–Rigid design’s efficiency (III). The probe’s position is indicated by a red square marker. Source data are provided as a Source Data file.

Fig. 5 Programmable imaging of the MMAT-OCT facilitated by angle control.

a (I) The input magnetic field in the PMSM’s coordinate system {N} is unobservable due to catheter deformation, making positional information alone in the global coordinate system {M} insufficient for precise angular control. (II) The state of the EPM’s fixed coordinate system {Q} is observable. With the known origin of probe’s coordinate system {P}, effective angular control in {M} is feasible. b Raw B-frames of scanning angle of 90° (I) and 360° (II), with red boxes signifying similar tissue areas. (III) The effective scanning area scales from -15% to 15%, using the circular scan image as a template for feature matching. The full-circle scanning duty cycle is set to 1 by default. The unit “a.u.” stands for arbitrary units. c Angular errors (n = 5) increase with the predefined scanning angle. Data are presented as mean values +/− SD. d Polar plots of post-processed OCT angular scanning. The red arrows indicate the epidermis; the blue arrows indicate the dermis, and the blue asterisks indicate the air gaps. e 3D programmable imaging of the capital “CUHK” on mouse colon tissue. (I) Targeted 3D scanning region defined as the capital letters “CUHK”. (II) 3D reconstruction via back-projection to reflect the pattern’s morphology. (III) Patterned scanning results (top view) on mouse colon tissue. Scale bars are 250 µm. (IV) Representative B-scan images at 200 µm intervals. Source data are provided as a Source Data file. a Created with BioRender.com released under a Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/deed.en).

Results

Design of MMAT-OCT endoscopic system

The endoscopic system consists of an 800-nm spectral-domain OCT (SD-OCT) engine (see Fig. 1b and “Methods”) and an integrated MMAT-OCT probe (see Fig. 1c). The MMAT-OCT probe is made of two key parts, including the optical assembly and the rotational assembly (see Supplementary Fig. S1). The optical assembly utilizes a gradient-index (GRIN) lens-based approach, common in OCT endoscopes41,42. Traditional designs use BK7 lenses as spacers, increasing assembly complexity and insertion loss due to additional reflective surfaces. We have replaced the BK7 lens with UV glue as a lower dispersion spacer material. This change led to several optimizations: First, we optimized the UV glue-based spacer length (distance between the single-mode fiber end facets and the GRIN lens) to achieve a high lateral resolution of ~7.6 µm. Second, we set the reflector’s angle to 54°, resulting in a back-reflection level of less than −60 dB. The use of UV glue also reduced the chromatic shift to 74 µm, compared to 133 µm with BK7 lenses, and achieved an optimal axial resolution of 2.4 µm. In addition, using UV glue reduces the number of reflective surfaces in the optical path, thus lowering insertion loss and simplifying the assembly process compared to BK7 lenses. The rotational assembly is made of a reflector affixed to a cylindrical magnet (or rotor component, see “Methods”). The reflector redirects the focused laser beam onto the adjacent tissue.

The distal enclosure of the probe is designed with a 1.3-mm outer diameter and 1-mm inner diameter, matching the dimensions of the GRIN lens and reflector integrated within. To optimize the functionality of the probe, we opted for nickel-titanium as the enclosure material instead of the commonly used stainless steel 316. This choice was made due to nickel-titanium’s weak magnetism, which allows for better interaction with the RDPM and reduces rotational damping. To fabricate the enclosure, laser micromachining was employed to create three struts occupying a 12° area. In addition, a 5° chamfer was added at the root of each strut to prevent breakage under significant external loads (see Supplementary Fig. S1). The length of the struts, 1.7 mm, was carefully chosen to ensure adequate assembly tolerance and unobstructed laser beam transmission (see Fig. 1cI and Supplementary Movie S1). It is important to note that the current MMAT-OCT probe can be further downsized to accommodate smaller lumens (see “Discussion”).

The length of the probe’s distal rigid part poses challenges in cavity navigation and should be minimized43,44. To minimize the rigid length, we designed a hemisphere-shaped stopper using a 0.05-mm thick 304 stainless steel sheet (see Supplementary Fig. S2). The stopper’s weak magnetism guarantees the magnet’s stability even under vertical gravity, while the rotational friction between the stopper and RDPM is negligible. The length of rotor consisting of RDPM and stopper is about 1.28 mm or 2.28 mm (see Fig. 1cI, II). This size (1.28 mm) is ~40% smaller than commercial miniature PMSMs (see Supplementary Fig. S1). The air gap (l2) between the GRIN lens and the reflector is correlated with the working distance (see Supplementary Fig. S1 and Supplementary Note 3). The probe fabrication involves five steps (see “Methods”) and costs about US$ 14 (see Supplementary Table II). This represents a significant cost reduction of more than 95% compared to commercial PMSMs, making it an attractive option for cost-effective, single-use applications in clinical settings. To facilitate 3D imaging of luminal organs, a computerized linear translation stage (CLTS, Fig. 1b) is employed to perform the pullback motion of the MMAT-OCT probe, while it conducts circumferential scanning within the luminal organ.

Characterization of MMAT-OCT

Considering safety and spatial constraints (see Supplementary Note 2), we propose utilizing a mono-magnet-based external magnetic actuator to remotely drive the RDPM in probe (see Fig. 2a). A 6-DoF robotic arm was used to carry a servo motor and an external diametrically permanent magnet (EPM, 50 mm in length and diameter, see “Methods”). L is defined as the working distance between EPM and RDPM (see Fig. 2aI, II). However, this configuration introduces a nonlinear driving magnetic field, necessitating a characterization using the finite element method (FEM) and a simplified magnetic dipole model (MDM, see Supplementary Note 4 and “Methods”). For instance, when L is 55 mm, we note torque fluctuations between ±0.125 mN·m (see Fig. 2aIII1) and force fluctuations between ±3.8 mN (see Fig. 2aIII2). This nonlinearity correlates with L, as torque and force decrease cubically and quartically, respectively (see Fig. 2aIV)30. Our findings indicate an operational range for L of 45–65 mm, beyond which magnetic field strength is inadequate for stable torque, causing unstable rotation of RDPM (1 mm in length and diameter). A coplanar arrangement of EPM and RDPM was assumed (see Fig. 2aII), with non-coplanar effects discussed later.

Furthermore, fluctuations in rotational speed are not only influenced by the magnetic field, but also by the nonuniform distribution of the friction coefficient (FC) between the enclosure and RDPM (see Supplementary Note 5 and Supplementary Figs. S3–S6). Therefore, the rotation dynamics of the RDPM are influenced by a complex interplay of gravity, enclosure support, friction, and the magnetic field (see Fig. 2aII). These forces, along with the driving torque, exhibit nonlinearity and time dependence, resulting in an unpredictable rotational speed of the RDPM (see Supplementary Figs. S7–S10). For instance, while the rotation frequency oscillates around 10 Hz (see Supplementary Figs. S11–S13), OCT imaging reveals unexpected rotation frequencies exceeding 25 Hz in certain regions (see Fig. 2b). This discrepancy can be attributed to the reduced magnetic moment along the 1-mm long RDPM and the impact of the reflector on the rotational inertia. To minimize the nonuniform distribution of the FC, a smooth surface roughness of ~322 nm is achieved by coating 100 nm of silver and 200 nm of silica dioxide (see Supplementary Fig. S5I2, “Methods”). Furthermore, speed fluctuations are reduced within the range of L from 55 to 60 mm due to a decrease in the variation of the magnetic force (see Fig. 2aIV1).

We further develop an analytical rotation dynamic model that assumes the RDPM maintains pseudo-equilibrium through inertial forces (see Supplementary Note 6 and Supplementary Movie S2). Experimental data captured using a high-speed industrial camera (800 frames/s, see Supplementary Movie S3) confirms the validity of this model. Consequently, by assuming random FCs, a multitude of complex and random rotation dynamics curves can be generated. These curves can be utilized to generate synthetic data for training neural networks aimed at correcting distorted images. The rotational speed fluctuations observed in the RDPM are applicable to both PMSMs and EPM (see Supplementary Fig. S14). In EPM, these fluctuations contribute to errors that cause image distortion. These errors can be categorized into two types: high-frequency errors (see Supplementary Note 7), primarily caused by nonuniform friction between the rotor and enclosure, resulting from dynamic changes in FC and squeezing stress; and low-frequency errors (see Supplementary Note 7), primarily due to variations in the input torque to the rotor, leading to low-frequency components of angular speed variation. Inspired by the Nyquist sampling theorem, a rotation frequency (Fr) of 10 Hz can be paired with a sampling frequency (Fs) of 20 Hz to mitigate image distortions caused by high-frequency errors. As the Fr / Fs ratio increases, OCT images of mouse rectal mucosa exhibit reduced shrinkage (see Fig. 2c). In this study, all OCT image acquisitions followed this strategy, typically employing an Fr / Fs ratio of 2.

Deep-learning method for distortion correction

The nonuniform rotational speed of MMAT-OCT induces rotational distortions or NURD, which manifests as stretching and shrinking distortions in OCT images. Given the comparable lumen sizes (2–3 mm) of the luminal organs under study, namely the rat esophagus and the mouse colon, and the 1.8-mm outer diameter of MMAT-OCT, rotational distortions are more pronounced compared to the common distortions caused by translational displacement of tissue relative to the endoscope and the resultant radial sampling nonuniformity. To accurately correct rotational distortions, we have developed a deep-learning approach called NDNC-Net. This approach integrates the rotation dynamics model of the RDPM and is trained using synthetic data (see Fig. 3).

Synthetic data generation involves distortion-free B-frame resampling with theoretical (as described in “Characterization of MMAT-OCT”) and measured (see Fig. 2b and Supplementary Fig. S10) rotation dynamics. The displacement of the acquired A-line is determined by the integral of the rotational speed (unit: rad/s), denoted as s1 and s’1, over the sampling interval (unit: second), represented by λ1 and λ′1. Specifically, it indicates the actual positional difference between two points on the tissue; in the rotational scanning, this is the angular difference. As shown in Fig. 3a, the matched index pairs (e.g., 1 and 1’) describe the same column pixel. However, due to nonuniform rotation dynamics during resampling, the intervals between adjacent A-lines in resampled images either stretch or shrink compared to the distortion-free B-frame (see Supplementary Fig. S15). Conversely, NURD correction is the inverse operation of synthetic data generation. The estimated rotation dynamics are derived from NCNet. The efficacy of this approach is evaluated by the error between the estimated rotation dynamics and the preset ground truth within the synthetic dataset (see Supplementary Fig. S16 and “Methods”). This inverse mapping allows for the correction of NURD regions, resulting in corrected OCT images (see Supplementary Fig. S17).

NURD correction involves two-stage process of detection and correction. For the detection task, we devised a struct detection network to identify structs in raw B-frames and crop them into three subsections without any struts, named tissue regions (see Fig. 3b). Subsequently, a NURD Detection Network (NDNet) is implemented to localize stretching regions within the tissue regions, demarcating these regions with bounding boxes. Stretching regions represent high-frequency errors, while low-frequency errors are indicated by struts (detailed in Supplementary Note 7). For the correction task, we developed a NURD Correction Network (NCNet) to estimate the rotation dynamics between adjacent A-lines. During the inference phase, the struct detection network delineates bounding boxes for struct regions (blue, see Fig. 3c) and crops the B-frame into tissue regions. NDNet then is used to detect stretching distortions (red, see Fig. 3c) within tissue regions, followed by NCNet’s estimation of rotation dynamics to obtain corrected OCT images. Finally, struct regions are used to resize the corrected OCT images, producing undistorted images (see Supplementary Fig. S18).

To evaluate the imaging and distortion correction capabilities, we conducted in vivo investigations on mouse colon and rat esophagus tissues (see Supplementary Movie S4). Using MMAT-OCT, we captured and processed full circumferential scans in real-time at a rate of 20–40 frames per second, with each frame comprising 2048 ×  8196 pixels (axial × circumferential) as illustrated in Fig. 3c, d. The alignment of struts and scaling of A-lines were utilized to correct each B-frame prior to the 3D rendering of OCT volume. Representative OCT images, along with their fourfold magnified views, exhibit intricate tissue microstructures. The OCT images of the mouse colon depict distinct layers, including the upper colonic mucosa (CM), mucosal muscle layer (MM), submucosa (SM), internal muscle layer (MI), and external muscle layer (ME). Similarly, in the rat esophagus, the multi-layered structure is resolved, highlighting the keratinized stratified squamous epithelium (EP), lamina propria (LP), muscularis mucosae (MM), submucosa (SM), and muscularis propria (MP). These OCT images correspond well with hematoxylin and eosin (H&E)-stained histological micrographs, confirming the system’s potential for high-resolution, label-free imaging. Furthermore, in-situ OCT imaging of the porcine pancreatic duct was conducted to validate its deployment and application within the complex lumens of medium-sized mammals (see Supplementary Fig. S19).

Steerability of MMAT-OCT

Axially magnetized guidewires have been well-studied for intracorporeal navigation31,45. However, using a diametrically magnetized rotor, i.e., RDPM, for steering remains relatively underexplored30. The effect of the EPM on the RDPM can be evaluated within its working spaces: the orthographic (OPA) and lateral (LPA) projection areas (see Supplementary Fig. S20). The preferred working distance, ɦ, ranges from 30 to 60 mm31,32, contingent on the catheter’s stiffness and length31. To enhance the MMAT-OCT’s navigational performance and extend effective ɦ, we implemented a Flexible–Soft–Rigid segmented stiffness distribution (see Fig. 4a). This design includes two stiffness levels in the flexible section: ~200 GPa for the catheter body and ~140 GPa for the optical components. The 8-mm soft segment, with a Young’s modulus of 16–79 GPa, consists of the optical fiber and coating. The 7-mm rigid segment features a nickel-titanium enclosure for protecting the optical components. We evaluated the MMAT-OCT’s steering capabilities using an EPM-bending angle mapping model based on the potential energy optimization method (see Supplementary Note 8 and Supplementary Fig. S21)46. The distal shape is described by an iso-curvature model47. In the OPA configuration, EPM I can achieve a maximum turning angle of 110° at 30 mm and 5° at 60 mm (see Fig. 4bI, II). The LPA configuration showed a faster attenuation rate with increasing ɦ (see Fig. 4bIII). Experimental results indicated smaller deflection angles than theoretical estimates, decreasing from 40° to 15° as ɦ ranged from 35 to 50 mm, due to model errors, misalignment, and initial catheter state46. For larger bending angles, increasing the EPM volume is feasible. EPM II, with a diameter and height of 100 mm, has been validated for cerebral vessel navigation31. Simulations show a maximum deflection angle of ~123° within the 30-60 mm range (see Fig. 4bII), slightly decreasing in the LPA configuration from ~120° to ~106° (see Fig. 4bIII).

We further validated the MMAT-OCT’s navigational abilities using a transparent, rigid vascular phantom (30 mm thickness, 2–5 mm apertures) (see Fig. 4cI and Supplementary Movie S5). The MMAT-OCT’s flexible section has a pre-bend of 10° (see Fig. 4a) and was manually advanced without rotational maneuvers (see Fig. 4cII). In path 1 (a1–e1), an obstacle at b1 required an active deflection of ~5°. The endoscope’s ~7 mm rigid length risked entrapment at d1, and the structure at c1 limited pre-deflection. At 00.24 s, the EPM enabled a 20° active deflection, reaching e1. Smooth retraction within the lumen was demonstrated between 00.44 s and 00.46 s. However, at 00.53 s, the probe became entrapped at c1, likely due to frictional self-locking. We optimized segment lengths using Abaqus CAE, revealing that large bending angles reduce the minimum turning radius, necessitating adjustments for MMAT-OCT compatibility (see Supplementary Fig. S22).

We also tested a longer, continuously curved lumen (a2–g2) (see Fig. 4cIII and Supplementary Movie S5), requiring bending angles of 79° at b2 and 72° at f2. The combined use of the EPM and manual advancement allowed the MMAT-OCT to navigate the path smoothly, demonstrating its effective navigational abilities. This confirmed our Flexible–Soft–Rigid gradient stiffness design’s capability to transmit force and enable active deflection. Here we chose an axially magnetized EPM for its superior gradient distribution, enhancing navigation at equivalent distances. Moreover, in complex curved areas, the MMAT-OCT’s distal imaging window could be magnetically manipulated to attach to the target, ensuring optimal beam focus.

Programmable imaging using angle control

The MMAT-OCT angle control relies on the EPM’s ability to generate a magnetic field in any desired direction at the RDPM’s location (see Supplementary Fig. S23a). Ideally, a near-linear relationship between the magnetic field direction and EPM angle is observed when L is 45–100 mm (see Supplementary Fig. S23b). PMSMs have been used for B-scan angular imaging but are limited to in vitro settings or larger structures (diameter: 12 mm)38,48 due to catheter deformation, which obscures the magnetic field’s input signal coordinate system {N}. This makes global coordinate system {M} positional information insufficient for precise angular control without additional orientation feedback. In contrast, the EPM’s fixed coordinate system {Q} state is easily obtained, and with the OCT probe’s coordinate system {P} origin known, effective angular control in {M} is feasible if the probe’s axial direction is visible (see Fig. 5a).

Magnetic field attenuation due to L and friction between the RDPM and the enclosure complicate alignment. A direct mapping between the EPM and RDPM angles (see Supplementary Fig. S24 and Supplementary Note 9) addresses this. Numerical noise from friction coefficient variations (0.12–0.53) can be mitigated by filtering and approximating control sequences49. As L exceeds 65 mm, the gradient approaches zero, making control impractical (see Supplementary Fig. S24). Unstable states near 0° should also be avoided. This study focuses on angular imaging within 180°, operating within (−180°–0°) and (0°–180°) ranges, preferably around −90° or 90°.

To validate the angle control precision, we performed programmable B-scan imaging of human fingers50,51. The probe, positioned between the thumb and index finger, operated at four angles (90°, 120°, 180°, 360°) (see Fig. 5b, d). Angle control precision involves restricting scanning boundaries during open-loop operation. Additionally, angular scanning introduces NURD; however, these NURD areas have consistent features that can be corrected through NDNC-Net (see Fig. 3c). Here, we use shared features in B-frames from different angular scans (e.g., similar tissue areas indicated by the red dotted box in Fig. 5bI, II) for registration to characterize angle control precision. Specifically, the effective scanning area within the B-scan undergoes scaling between −15% and 15% to facilitate feature matching (see Fig. 5bII, Supplementary Fig. S25, and Supplementary Note 8II). The peak values (indicating the actual angular scanning boundary) of the matching coefficients correspond to image scaling ratios of ~-0.4%, ~2.2%, and ~4.7% (see Fig. 5bIII), respectively. The maximum angle errors, calculated from the peak values of the matching coefficients, suggest that a larger scanning range leads to a greater angle error, with an average angular error of ~4° (see Fig. 5d, versus about 6° in PMSMs38). Thus, the predetermined angle then can be viewed as the scanning border in B-scan during image processing (see Fig. 5d). Compared to the PMSM, the MMAT-OCT probe provides stepless angle adjustment with a comparable angle resolution38. By harnessing an external magnetic field for control, the rotor’s pose in {M} is secured, thus enhancing the safety margin for angle control, and holding promise for clinical applications such as targeted laser ablation52,53 or micrometer-scale photodynamic regional treatment54, in addition to optimizing OCT data collection and storage55.

The angle control capabilities have been extended to facilitate programmable pattern scanning, superimposing angle scanning on a linear motion with 5 µm/frame fiber retraction. Figure 5eI defines the targeted 3D scanning region as the capital letters “CUHK”. This is followed by generating corresponding 2D orthographic contours and 2D path planning (see Supplementary Note 8III). Ultimately, 3D reconstruction is achieved via back-projection to elucidate the pattern’s morphology (see Fig. 5eII). The 3D surface is then converted into a set of direction-scanning angle pairs, which serve as the input for the stepper motor. Figure 5eIII shows the patterned scanning results (top view) on mouse colon tissue (see Supplementary Movie S6), aligning with the planned target region. Representative B-scan images from 200 µm intervals further validate the MMAT-OCT’s superior angle control capabilities and potential for selective tissue mucosa scanning (see Fig. 5eIV). Representative B-scan images from 200 µm intervals, distinguishing between “CU” and “HK” to exemplify the EPM’s controllability within an absolute coordinate framework. Notably, the shape of the letter K has been modified to maintain the continuous beam scanning of SD-OCT.

Discussion

The Food and Drug Administration (FDA) approval for 1300 nm endoscopic OCT for gastrointestinal and coronary artery imaging reinforces its status as a minimally invasive, low-risk imaging modality56. The remote control of MMAT-OCT is accomplished through the utilization of a mono-magnet actuator, enabling improved pathological examination of living tissues in small, intricate lumens (see Fig. 6 and Supplementary Note 2), as well as heat-sensitive structures such as blood vessels (see Fig. 7 and Supplementary Note 10).Fig. 6 MMAT-OCT imaging performance in curved lumens.

a, b Experimental setup: MMAT-OCT navigated through four distinct lumens in a human lung phantom and an ex vivo rat trachea to assess imaging quality. Pathway I: Catheter route from trachea to the right lower lobe lateral basal segment, with a terminal curvature of 55°. Pathway II: Extends from left main bronchus to left upper lobe bronchus, showing continuous bending with a terminal angle of 101°. Pathway III: From right main bronchus to right upper lobe apical segment, with severe bending of 315°, causing catheter stress and wall pressure that induce NURD and axial resolution loss. Pathway IV: Starts at left main bronchus, ends at left upper lobe anterior segment; features 3D continuous bending and an interplanar angle of 62°, leading to rotational inhomogeneity and axial translation. c Quantitative analysis (n = 3) in imaging quality impact across four conditions. The high-frequency errors (Supplementary Note 7) have a mean of 47.06% with a standard deviation of 4.12%, while the low-frequency errors (Supplementary Note 7) have a mean of 5.73% with a standard deviation of 1.27%. Data are presented as mean values +/− SD. Source data are provided as a Source Data file.

Fig. 7 Electrical and thermal properties of MMAT-OCT.

a Leakage current: MMAT-OCT complies with FDA’s safety limit (0.1 mA) for cardiac floating-type devices. b Voltage characteristics: The MMAT-OCT’s 304 stainless steel stopper exhibits a voltage amplitude <0.02 mV, measured at 200 mV and 50 Hz using an oscilloscope and signal amplification filter circuit. c Clinical relevance: Intraluminal temperatures exceeding 41 °C are associated with esophageal ulceration. d Temperature monitoring: MMAT-OCT probe temperature, monitored by a thermal camera over 45 min, showed minimal fluctuations within ±0.5 °C from ambient conditions. Source data are provided as a Source Data file. a, c Created with BioRender.com released under a Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/deed.en).

The imaging quality in MMAT-OCT is influenced by the distance between RDPM and EPM. However, it remains robust due to several factors. First, the system has a fault-tolerant working range of 45–65 mm (see Fig. 2c), which allows for maintaining quality without the need for positional feedback. Second, the experiments were conducted on small animals, such as rats and mice, with body size variations under 20 mm. This ensures that the imaging is not significantly affected by anatomical differences. In addition, the pullback distance is 2.5 mm in Fig. 3c, d, and 0.4 mm for each pattern in Fig. 5e, which further minimizes anatomical variations to below 5 mm. Furthermore, the OCT image serves as a sensor during angle scanning, allowing for pre-configured adjustments based on observed rotational angles (see Supplementary Fig. S26). This strategy effectively corrects for working distance variations, with an acceptable distance error of 3–5 mm.

Despite a suitable working distance, there are still risks of misalignment due to angular discrepancies (Θ) as shown in Fig. 8a. Achieving and maintaining optimal alignment (Θ = 0°) without probe pose feedback is challenging. To evaluate the imaging quality of MMAT-OCT under non-ideal conditions, we conducted experiments and found that it remains robust up to a 40° angular deviation (see Supplementary Fig. S27a). Our findings indicate a linear relationship between the low-frequency error and Θ (see Supplementary Fig. S27b), suggesting the potential for implementing closed-loop feedback using distorted OCT image features (see Supplementary Fig. S27c). To explore this further, we designed an experiment that utilized OCT image feedback for servo control, with actions executed through teleoperation (see Fig. 8b). Post-processed OCT images with NDNC-Net were used to calculate the low-frequency error. The optimization of Θ involves two operations: negative action (NA), which deviates from the optimal configuration, and positive action (PA), which approaches the optimal configuration. An increase in the low-frequency error curve indicates NA, while a decrease indicates PA. The changes in the system configuration caused by NA (red arrows) and PA (blue arrows), specifically the 2D pose correction of the EPM, are visualized in Fig. 8b, where Θ is adjusted from the initial state of 30° to the final state of 5°.Fig. 8 OCT images as feedback control in MMAT-OCT for optimal imaging quality.

a Diagram showing the intersection angle (Θ) between the EPM and probe, influencing torque as T∙cos(Θ), with the mouse body thickness approximated to be 30 mm. b Post-processed OCT images using NDNC-Net can calculate the low-frequency error. The red arrows (left figure) indicate the position of the strut. The Θ optimization process involves two types of operations: negative action (NA, deviating from the optimal configuration) and positive action (PA, approaching the optimal configuration). An increase in the low-frequency error curve indicates NA, while a decrease indicates PA. Changes in system configuration caused by NA (red arrows, right figure) and PA (blue arrows) operations, specifically the EPM’s 2D pose correction, are visualized. Source data are provided as a Source Data file. a, b Created with BioRender.com released under a Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/deed.en).

MMAT-OCT utilizes a cost-effective design but requires compromises in probe dimensions—such as diameter and rigid tip length—due to the use of commercially sourced optical components. Future research should focus on miniaturizing the reflector to mitigate its impact on rotation dynamics and comply with the dimensions needed for submillimeter structures. While reducing commercial reflectors to 0.3 mm3 could increase costs 30-fold, using polished and electroplated capillary metal tubes might lower costs37, but potentially degrade image quality. In addition, replacing GRIN lenses with ball lenses to reduce probe dimensions has become common but may compromise image quality due to severe back-reflection37,57.

The main source of background noise in endoscopic OCT imaging arises from back reflections of optical surfaces in the optical path. To reduce the background noise in our OCT endoscope, we have implemented the following measures: first, the GRIN lens is designed with one flat end coated with anti-reflection material (reflection <0.5% @ 850 nm), while the other end is angled at 8° to minimize back-reflection; second, the 8° angled end of the single-mode fiber is precisely aligned with the 8° angled facet of the GRIN lens, and UV glue is utilized as the spacer material to minimize the refractive index difference between optical surfaces; lastly, we have incorporated a reflective mirror with a 54° angle to further minimize back-reflection from the plastic sheath. These measures collectively contribute to the reduction of back-reflection in our OCT endoscope, resulting in a back-reflection level of less than −60 dB.

The MMAT-OCT represents a significant advance in microscopic mucosal imaging, surpassing traditional OCT endoscopes in resilience to probe deformation and thermal-electrical effects, thus providing a robust and safe solution for in vivo imaging. Optimizing sampling frequency and applying learning-based corrections effectively mitigate stretch–shrink NURD, improving image quality. The integration of an RDPM enhances steering capabilities and ensures 3D imaging under extreme bending. In addition, its compatibility with standard optical devices and cost-effective production makes it economically viable, aligning with single-use interventional catheters. Despite challenges like small probe size and nonuniform friction, system optimizations have minimized tissue information loss and corrected distortions. Validated under various conditions, the system demonstrates versatility and reliability, enhancing early detection and supporting targeted therapies, thereby potentially revolutionizing mucosal imaging and expanding applications in controlled imaging, diagnosis, and treatment40,58.

Methods

Manufacture and fabrication procedures of MMAT-OCT probe

The construction of MMAT-OCT probe is a five-stage process. Initially, a rod reflector (OD 1 mm, reflection angle 54°, Foctek Photonics, China) is bonded to the RDPM (diametrically magnetized N52, 1 mm diameter, 1–2 mm length l3, Hangzhou Yongci Group Company Ltd.) using epoxy resin (G14250, Thorlabs Inc.), creating a magnetic reflector. The N-BK7 rod reflector features one 54-degree tilted flat surface with a silver coating for beam redirection and side-viewing. To reduce surface roughness, a surface coating process was implemented using the IVS EB-600 E-beam Evaporator. The RDPM surface was consecutively coated with 100 nm of Ag (Silver) and 200 nm of SiO2 (Silicon Dioxide), each applied at a rate of 0.1 nm/s.

Following this, a 780 HP single-mode fiber (SMF, 780HP, Thorlabs Inc., USA) is cleaved at an 8° angle using an automated glass processor (GPX3800, Thorlabs Inc.). This cleaved fiber is then affixed to a 3-mm-long GRIN lens (OD 1 mm, ComFiber Communications Technology, USA), maintaining a distance l1 of 275 μm between the distal end of the SMF and the GRIN lens for optimal optical performance, as determined by ray-tracing simulations. The gap is filled with an optical adhesive (NOA 68, Norland Product Inc., USA) and the SMF-GRIN-lens assembly is subjected to 4 h of UV light exposure (central wavelength of 365 nm, power density of 65 mW/cm2 on sample) to ensure complete polymerization and rigid bonding.

In the third stage, we employed the YC-SLC300 medical stent laser cutting machine (Kunshan Yunco Precision Co., LTD) to craft the desired light-transparent structure from a thin-walled, small-diameter nickel-titanium tube (inner diameter 1.1 mm, wall thickness 0.1 mm). Two perpendicularly oriented cameras equipped with a 10× objective oversee each step, monitoring the precise alignment and relative position of components in the longitudinal direction.

In the subsequent stage, the prefabricated elements are assembled within the enclosure. The rotor is inserted at the distal end of the enclosure, and the stopper is introduced to generate a magnetic attractive force and confine the reflector’s position longitudinally. The dome shape of the metal stopper minimizes friction during high-speed rotation. Epoxy resin is applied to the stopper’s brim to secure its position relative to the enclosure.

Finally, the SMF-GRIN-lens assembly is integrated within the preassembled enclosure. The distance l2 between the distal surface of the GRIN lens and the reflector’s front end is ~1.2 mm. l1 and l2 collectively fine-tune the focused beam spot size and the focal length. Epoxy resin fills the gap between the GRIN lens and the enclosure. A transparent plastic sheath of 1.8 mm OD and 200 μm wall thickness safeguards the MMAT-OCT probe during imaging. To ensure precise alignment, a custom-built platform, consisting of separate holders for the magnet, fiber, and prism mounted on independent translational and rotational stages, is used to assemble the optical components at the catheter’s distal end.

Surface roughness characterization

Under the operation of MarSurf MSW 8.6 software, high-resolution surface topographical maps of the RDPM and the enclosure were acquired using the MarSurf CM mobile confocal microscope. The aim of utilizing this apparatus was to ascertain the roughness characteristics of the rotating components. The arithmetical mean height (Sa), as defined by ISO 25178, is employed to measure and assess surface roughness, representing the mean deviation across a surface from a reference plane59.

Simulation of magnetic field

We developed a simulated workspace utilizing two cylindrical permanent magnets. An EPM measuring 50 mm in both diameter and length, and a RDPM of 1 mm in diameter and length were used. We employed the COMSOL Multiphysics platform for the simulation, using the ‘magnetic field, no current’ physics interface. Both magnets were assigned the same material—N52 (Sintered NdFeB). With respect to the magnetization model, we incorporated the remanent flux density, featuring a recoil permeability of 1.05 and a remanent flux density norm of 1.44 T. During the simulation, the mesh element size for the EPM was set to a maximum of 3 mm and a minimum of 2.88 mm. In contrast, the RDPM mesh had a maximum element size of 0.05 mm. The magnetization direction for both magnets was set diametrically. We calculated the magnetic field within a cubic space with a side length of 320 mm using a stationary study.

Robotic magnetic actuator

We utilized a 6-DoF Universal Robots UR5 serial robotic manipulator, capable of handling a 5-kg payload, to manipulate the actuator attached to its end-effector. For circumferential scanning, we employed an external motor, the RMD-L-90 (GYEMS), which incorporates a spherical permanent magnet (50 mm diameter, 50 mm height, NdFeB, N52 grade). For angular scanning, we deployed a planetary reduction stepper motor (80FXMA-016A, Shanghai Fengxin Transmission Machinery Co., Ltd).

Ultrahigh-resolution 800-nm SD-OCT endoscopic system

A near 800-nm SD-OCT distal scanning system (Fig. 1b) has been devised to enable ultrahigh-resolution tissue imaging. The system boasts a broadband super luminescent diode source (M-D-840-HP, Superlum, Ireland) with a central wavelength of 842 nm and a 3-dB bandwidth of 160 nm. A 2 × 2 broadband 50:50 fiber coupler (TW850R5A2, Thorlabs, USA) is utilized to construct the interferometric system. Within the detection arm, a high-speed spectrometer with 2048 pixels (CS800-800/300, Wasatch Photonics, USA) is employed, operating at a bandwidth from 650 to 950 nm and achieving a maximum scanning rate of 250 kHz. The light beam in the reference arm is collimated by a reflective fiber collimator (RC08APC-P01, Thorlabs, USA) and reflected by a protected silver mirror (PF05-03-P01, Thorlabs, USA). A pair of prisms (N-SF11, Edmund, USA) are integrated between them to balance the dispersion between the reference and sample arms. Furthermore, polarization controllers (FPC030, Thorlabs, USA) are deployed to regulate light polarization in the system and augment image contrast. In the sample arm, the imaging probe is affixed to a translational stage for longitudinal scanning. Unlike the traditional fiber-optic rotary joint used to drive the OCT catheter for circumferential tissue image acquisition, which incurs an insertion loss of ~3 dB, the MMAT-OCT probe negates the need for such a component. This led to a one-way transmission efficiency of ~90% and a back-reflection of less than −60 dB. The optimized imaging optics resulted in a working distance of 260 μm, an axial resolution of 2.4 µm, and a lateral resolution of 7.6 µm. The working distance is defined as the distance from the outer surface of the plastic sheath to the endoscope’s focal plane.

The OCT image acquisition is performed as follows: for continuous rotation scanning at frequencies ranging from 10 to 30 Hz, data from the initial and final phases were excluded, focusing solely on data obtained during regular rotation periods. In the case of angular scanning, data beyond the boundaries of the B-scan (see the red boxes in Supplementary Fig. S25) were discarded. The pertinent B-scan region (see the blue boxes in Supplementary Fig. S25), characterized by periodic decelerations (speed decreases) and accelerations (speed increases), is corrected using NDNC-Net.

NDNC-Net

Addressing the challenge of rotational distortion, we propose a bifurcated strategy delineated in Fig. 3, segregating the process into detection and correction phases. The initial phase employs a struct detection network to locate struct regions within raw B-frames using a semi-supervised object detection framework60. This framework introduces a soft teacher-student training paradigm, where the student model is trained with robustly augmented data and the teacher model with mildly augmented data, generating high-fidelity pseudo boxes. The composite loss function combines supervised and unsupervised loss elements, optimizing performance across both labeled and pseudo-labeled data:1 L=1Nl∑i=1NlLclsIli+LregIli+α1Nu∑i=1NuLclsIui+LregIui

where Ili denotes the ith labeled image, Iui denotes the ith unlabeled image, Lcls denotes the classification loss, Lreg denotes box regression loss, α denotes the weight factor, Nl and Nu denote the number of labeled images and unlabeled images. The teacher model is updated using an exponential moving average (EMA) strategy. We manually labeled part of raw MMAT-OCT images together with 100 unlabeled images to train the struct detection network. With the detected struct regions, raw B-frames are cropped into three subsections, named tissue region, without struct regions for afterwards processing.

The NURD Detection Network (NDNet) is proposed to pinpoint potential NURD-affected areas. Using separate networks for struct and NURD region detection improves NDNet’s precision and specificity. NDNet is implemented using the YOLO v8 framework, which is renowned for its efficiency and accuracy in object detection tasks. Key features of YOLO v8, such as the use of CSPDarknet as the backbone network, and the integration of a Path Aggregation Network (PANet) for better feature fusion, were pivotal in achieving high detection accuracy. The model also employs an anchor-free detection head, which simplifies the detection process and reduces computational complexity. NDNet is trained with the self-developed synthetic dataset (see Supplementary Fig. S15).

The correction network (NCNet) maps the raw OCT image domain I to the rotation dynamics domain D, a 1D vector specifying the variation of sampling distance differences between adjacent A-lines. Rotation dynamics indicates over- and under-sampling (see Supplementary Fig. S15). The estimated rotation dynamics D^ is optimized to match the ground truth D by minimizing the mean square loss:2 LC=1Nd∑i=1NdLmse(Di,D^i)

where Nd denotes the number of A-lines within a B-frame, Di refers to the ith ground truth, D^i refers to the ith estimated rotation dynamics and Lmse denotes the mean square loss. NCNet is implemented using the ViT-Base (Vision Transformer) architecture, which has demonstrated significant advancements in image analysis by leveraging the transformer model, originally designed for natural language processing, to process visual data. NCNet comprises 12 transformer blocks, and we employ two fully connected layers following the ViT to output the estimated rotation dynamics with the correct dimensions.

During inference, stretching regions {bi} are detected by NDNet. NCNet estimates the corresponding rotation dynamics, and a distortion pattern F is calculated by cumulative summation and normalization:3 Frawk=∑i=0kD^i

4 F=minmax(Fraw)⋅W

where minmax is the min-max normalization that map the input to [0, 1] and W represents the width of image. The distortion pattern F is also a 1D vector indicating where A-lines in the input OCT image should move to obtain the corrected image. Each detected region within the B-frame is then resampled with the inverse mapping F−1 of F. Since the inverse mapping is not a one-to-one function, bilinear interpolation is devised to fill in the zero A-lines of the inverse-mapped OCT image. Subsequently, the NURD-corrected OCT image is resized, using detected struct regions as markers in the MMAT-OCT probe, with each structure representing 4° of a full 360-degree circumference, uniformly distributed.

A large-scale synthetic dataset was created for NDNet and NCNet, where the NURD region and corresponding RDVV exhibit similar features to the rotational NURD distortion region of MMAT-OCT (see Fig. 3a and Supplementary Fig. S15). We used distortion-free OCT images acquired by the proximal scanning method. The proximal scanning approach involves rotating the imaging probe with a fiber-optic rotary joint for two-dimensional circumferential imaging. There are a total of 300 distortion-free OCT images, including mouse colon and rat esophagus. A total of 11,600 synthetic OCT images depicting stretching and shrinking distortion regions were utilized to train the NDNC-Net (see Supplementary Fig. S15). Focused stretching distortion regions exhibit a normalized rotation dynamics value below 0.

The training process was carried out using the PyTorch framework on a single Nvidia 3090 GPU, with memory allocations of 7 GB, 7 GB, and 6 GB for struct detection network, NDNet, and NCNet, respectively. Optimization was performed using the Adam algorithm, with both the initial learning rate and weight decay parameter set at 0.0001. The training process was configured with a batch size of 4 with 100 epochs for struct detection network and NDNet, and a batch size of 16 with 200 epochs for NCNet, spanning up to 50 epochs for each task. The inference times for the struct detection network, NDNet, and NCNet are 0.9 s, 0.9 s, and 0.012 s, respectively. We conducted various rotation dynamics experiments, obtaining 5000 synthetic samples and 120,000 synthetic samples for training NDNet and NCNet, respectively. Based on current performance metrics, increasing the number of training samples does not significantly enhance performance. However, increasing the diversity of OCT image types and tissue types could improve the network’s generalization ability.

NDNC-Net’s correction capabilities depend on the synthetic data and the methods used to accurately model the rotation dynamics of RDPM. To ensure the correction capability of NDNC-Net and understand its dependency on the quality of training data, we explored two methods for modeling the rotation dynamics in the synthetic data used to train NDNC-Net. The first method involves approximating theoretical data with cubic spline interpolation to simulate rotation dynamics. The rotation dynamics of the RDPM are influenced by various factors such as gravity, enclosure support, friction, and the magnetic field, resulting in complex and unpredictable angular speed due to the nonlinearity and time dependence of these forces. To model this complexity, we used cubic spline interpolation to approximate theoretical data (see Supplementary Fig. S8 and Fig. 2b), generating complex and random curves by assigning random friction coefficients. This synthetic dataset currently simulates 10,000 scenarios, with potential for expansion. The second method utilizes measured rotation dynamics. We captured high dynamics of the rotating RDPM using a high-speed industrial camera with a frame rate of 800 frames per second, as shown in Supplementary Fig. S9 and Supplementary Movie S3. These measured rotational dynamics curves were then approximated using cubic spline interpolation (see Supplementary Fig. S10), resulting in a synthesized dataset of 11,600 images incorporating these measured dynamics.

To evaluate the performance of the trained NDNC-Net, we conducted tests on 350 randomly selected synthetic images, with the distortion-free OCT images serving as the ground truth. The results show that the mean squared error (MSE) of the rotation dynamics prediction is 4.3%, thereby validating the correction performance of NDNC-Net.

Animal studies

The experimental protocols for animal imaging on mice (n = 4, Nu/J, The Laboratory Animal Services Centre, The Chinese University of Hong Kong) and rats (n = 4, Sprague Dawley, The Laboratory Animal Services Centre, The Chinese University of Hong Kong) received ethical approval from the Animal Experimentation Ethics Committee (AEEC) at The Chinese University of Hong Kong. The OCT imaging on the pig (n = 3, Yorkshire Pig, Tianjin Bainong Laboratory Animal Breeding Technology Co., Ltd.) was approved by Qilu Hospital of Shandong University. The animals did not experience dark/light circle, and the ambient temperature was 23 °C, and the humidity was kept 35%. Ex vivo imaging was preceded by the humane euthanasia of rats through the administration of a pharmacological overdose, specifically 100 mg/kg ketamine and 10 mg/kg xylazine, after which OCT evaluation was performed. Concurrently, in vivo imaging necessitated the induction of anesthesia via subcutaneous injection of ketamine and xylazine at the same dosages mentioned above, enabling the acquisition of OCT scans. The pig anesthesia was initiated with ketamine (25 mg/kg) and then maintained by continuous intravascular administration of propofol (800 μg/kg/h) during imaging. Following the completion of the OCT imaging procedures, the tissues were promptly excised and preserved in formalin, thus preparing them for subsequent histological examination.

Reporting summary

Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.

Supplementary information

Supplementary Information

Peer Review File

Supplementary Movie 1

Supplementary Movie 2

Supplementary Movie 3

Supplementary Movie 4

Supplementary Movie 5

Supplementary Movie 6

Reporting summary

Source data

Source Data

Supplementary information

The online version contains supplementary material available at 10.1038/s41467-024-51633-x.

Acknowledgements

This work was supported by the Hong Kong Research Grants Council (CRF C4026-21G, RIF R4020-22, GRF 14216022, GRF 14203323, NSFC/RGC Joint Research Scheme N_CUHK420/22) and the Shenzhen Science, Technology and Innovation Commission (SGDX20210823103535014), granted to Prof. Hongliang Ren. This work was also supported by the Hong Kong Research Grants Council (ECS24211020, GRF14203821, GRF14216222), the Hong Kong Innovation and Technology Fund (ITS/240/21, ITS/252/23), and the Shenzhen Science, Technology and Innovation Commission (SGDX20220530111005039), granted to Prof. Wu Yuan.

Author contributions

Conceptualization: S. Yuan, H. Ren, and W. Yuan. Methodology: S. Yuan, C. Xu, B. Cui, H. Ren, and W. Yuan. Investigation: S. Yuan, C. Xu, B. Cui, and T. Zhang. Visualization: S. Yuan, C. Xu, B. Cui, and B. Liang. Funding acquisition and administration: H. Ren and W. Yuan. Supervision: H. Ren and W. Yuan. Writing—original draft: S. Yuan and C. Xu. Writing—review and editing: H. Ren, W. Yuan, S. Yuan, C. Xu, B. Cui, and T. Zhang.

Peer review

Peer review information

Nature Communications thanks the anonymous reviewer(s) for their contribution to the peer review of this work. A peer review file is available.

Data availability

All data supporting the findings of this study are available within the article and its supplementary files. Any additional requests for information can be directed to, and will be fulfilled by, the corresponding authors. Source data are provided with this paper.

Code availability

The codes that support the findings of this study are available as follows: 10.5281/zenodo.12792656.

Competing interests

The authors declare no competing interests.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

These authors contributed equally: Sishen Yuan, Chao Xu, Beilei Cui.
==== Refs
References

1. Cohen PA Jhingran A Oaknin A Denny L Cervical cancer Lancet 2019 393 169 182 10.1016/S0140-6736(18)32470-X 30638582
Cohen, P. A., Jhingran, A., Oaknin, A. & Denny, L. Cervical cancer. Lancet 393, 169–182 (2019).30638582 10.1016/S0140-6736(18)32470-X
2. Perkins RB Wentzensen N Guido RS Schiffman M Cervical cancer screening: a review J. Am. Med. Assoc. 2023 330 547 558 10.1001/jama.2023.13174
Perkins, R. B., Wentzensen, N., Guido, R. S. & Schiffman, M. Cervical cancer screening: a review. J. Am. Med. Assoc. 330, 547–558 (2023).10.1001/jama.2023.13174
3. Hermes B Visualization of the basement membrane zone of the bladder by optical coherence tomography: feasibility of noninvasive evaluation of tumor invasion Urology 2008 72 677 681 10.1016/j.urology.2008.02.062 18455778
Hermes, B. et al. Visualization of the basement membrane zone of the bladder by optical coherence tomography: feasibility of noninvasive evaluation of tumor invasion. Urology 72, 677–681 (2008).18455778 10.1016/j.urology.2008.02.062
4. Chen P-H En-face polarization-sensitive optical coherence tomography to characterize early-stage esophageal cancer and determine tumor margin Biomed. Opt. Express 2022 13 4773 4786 10.1364/BOE.463451 36187267
Chen, P.-H. et al. En-face polarization-sensitive optical coherence tomography to characterize early-stage esophageal cancer and determine tumor margin. Biomed. Opt. Express 13, 4773–4786 (2022).36187267 10.1364/BOE.463451
5. Hariri LP Diagnosing lung carcinomas with optical coherence tomography Ann. Am. Thorac. Soc. 2015 12 193 201 10.1513/AnnalsATS.201408-370OC 25562183
Hariri, L. P. et al. Diagnosing lung carcinomas with optical coherence tomography. Ann. Am. Thorac. Soc. 12, 193–201 (2015).25562183 10.1513/AnnalsATS.201408-370OC
6. Lu L Using endoscopic optical coherence tomography to detect and treat early-stage pancreatic cancers Front. Oncol. 2021 11 591484 10.3389/fonc.2021.591484 33791200
Lu, L. et al. Using endoscopic optical coherence tomography to detect and treat early-stage pancreatic cancers. Front. Oncol. 11, 591484 (2021).33791200 10.3389/fonc.2021.591484
7. Joseph A Esophageal adenocarcinoma: a dire need for early detection and treatment Clevel. Clin. J. Med. 2022 89 269 279 10.3949/ccjm.89a.21053
Joseph, A. et al. Esophageal adenocarcinoma: a dire need for early detection and treatment. Clevel. Clin. J. Med. 89, 269–279 (2022).10.3949/ccjm.89a.21053
8. Huang D Optical coherence tomography Science 1991 254 1178 1181 10.1126/science.1957169 1957169
Huang, D. et al. Optical coherence tomography. Science 254, 1178–1181 (1991).1957169 10.1126/science.1957169
9. Wang J A generic and effective system dispersion compensation method: development and validation in visible-light OCT Photonics 2023 10 892 10.3390/photonics10080892
Wang, J. et al. A generic and effective system dispersion compensation method: development and validation in visible-light OCT. Photonics 10, 892 (2023).10.3390/photonics10080892
10. Ono M Advances in IVUS/OCT and future clinical perspective of novel hybrid catheter system in coronary imaging Front. Cardiovasc. Med. 2020 7 119 10.3389/fcvm.2020.00119 32850981
Ono, M. et al. Advances in IVUS/OCT and future clinical perspective of novel hybrid catheter system in coronary imaging. Front. Cardiovasc. Med. 7, 119 (2020).32850981 10.3389/fcvm.2020.00119
11. Pilonis, N. D., Januszewicz, W. & di Pietro, M. Confocal laser endomicroscopy in gastro-intestinal endoscopy: technical aspects and clinical applications. Transl. Gastroenterol. Hepatol. 7, 7 (2022).
12. Araki M Optical coherence tomography in coronary atherosclerosis assessment and intervention Nat. Rev. Cardiol. 2022 19 684 703 10.1038/s41569-022-00687-9 35449407
Araki, M. et al. Optical coherence tomography in coronary atherosclerosis assessment and intervention. Nat. Rev. Cardiol. 19, 684–703 (2022).35449407 10.1038/s41569-022-00687-9
13. van der Sijde JN Safety of optical coherence tomography in daily practice: a comparison with intravascular ultrasound Eur. Heart J. Cardiovasc. Imaging 2017 18 467 474 26992420
van der Sijde, J. N. et al. Safety of optical coherence tomography in daily practice: a comparison with intravascular ultrasound. Eur. Heart J. Cardiovasc. Imaging 18, 467–474 (2017).26992420
14. Karmakar A Framework for lumen-based nonrigid tomographic coregistration of intravascular images J. Med. Imaging 2022 9 044006 044006 10.1117/1.JMI.9.4.044006
Karmakar, A. et al. Framework for lumen-based nonrigid tomographic coregistration of intravascular images. J. Med. Imaging 9, 044006–044006 (2022).10.1117/1.JMI.9.4.044006
15. He Y Medical image-based computational fluid dynamics and fluid-structure interaction analysis in vascular diseases Front. Bioeng. Biotechnol. 2022 10 671 10.3389/fbioe.2022.855791
He, Y. et al. Medical image-based computational fluid dynamics and fluid-structure interaction analysis in vascular diseases. Front. Bioeng. Biotechnol. 10, 671 (2022).10.3389/fbioe.2022.855791
16. Pribadi RR Rani AA Abdullah M Challenges of endoscopic retrograde cholangiopancreatography in patients with Billroth II gastrointestinal anatomy: a review article J. Dig. Dis. 2019 20 631 635 10.1111/1751-2980.12821 31577857
Pribadi, R. R., Rani, A. A. & Abdullah, M. Challenges of endoscopic retrograde cholangiopancreatography in patients with Billroth II gastrointestinal anatomy: a review article. J. Dig. Dis. 20, 631–635 (2019).31577857 10.1111/1751-2980.12821
17. Yuan W Direct visualization and quantitative imaging of small airway anatomy using deep learning assisted diffractive OCT IEEE Trans. Biomed. Eng. 2022 70 238 246 10.1109/TBME.2022.3188173
Yuan, W. et al. Direct visualization and quantitative imaging of small airway anatomy using deep learning assisted diffractive OCT. IEEE Trans. Biomed. Eng. 70, 238–246 (2022).10.1109/TBME.2022.3188173
18. Wang T Development of a high-speed synchronous micro motor and its application in intravascular imaging Sens. Actuators A: Phys. 2014 218 60 68 10.1016/j.sna.2014.07.020
Wang, T. et al. Development of a high-speed synchronous micro motor and its application in intravascular imaging. Sens. Actuators A: Phys. 218, 60–68 (2014).10.1016/j.sna.2014.07.020
19. Jayhooni SMH A side-viewing endoscopic probe with distal micro rotary scanner for multimodal luminal imaging and analysis J. Microelectromechan. Syst. 2021 30 433 441 10.1109/JMEMS.2021.3072617
Jayhooni, S. M. H. et al. A side-viewing endoscopic probe with distal micro rotary scanner for multimodal luminal imaging and analysis. J. Microelectromechan. Syst. 30, 433–441 (2021).10.1109/JMEMS.2021.3072617
20. Levi, M. Hemostasis and thrombosis in extreme temperatures (hypo-and hyperthermia). Semin. Thrombosis Hemost. 44, 651–655 (2018).
21. Brenner, B. & Lisman, T. Hemostasis and thrombosis in extreme physiological and pathological conditions. Semin. Thrombosis Hemost. 44, 615–616 (2018).
22. Veltmeijer MT The impact of exercise-induced core body temperature elevations on coagulation responses J. Sci. Med. Sport 2017 20 202 207 10.1016/j.jsams.2016.01.007 27036711
Veltmeijer, M. T. et al. The impact of exercise-induced core body temperature elevations on coagulation responses. J. Sci. Med. Sport 20, 202–207 (2017).27036711 10.1016/j.jsams.2016.01.007
23. Epstein Y Yanovich R Heatstroke New Engl. J. Med. 2019 380 2449 2459 10.1056/NEJMra1810762 31216400
Epstein, Y. & Yanovich, R. Heatstroke. New Engl. J. Med. 380, 2449–2459 (2019).31216400 10.1056/NEJMra1810762
24. Jensen PJ Thomsen P Bagger J Nørgaard A Baandrup U Electrical injury causing ventricular arrhythmias Heart 1987 57 279 283 10.1136/hrt.57.3.279
Jensen, P. J., Thomsen, P., Bagger, J., Nørgaard, A. & Baandrup, U. Electrical injury causing ventricular arrhythmias. Heart 57, 279–283 (1987).10.1136/hrt.57.3.279
25. Antal A Low intensity transcranial electric stimulation: safety, ethical, legal regulatory and application guidelines Clin. Neurophysiol. 2017 128 1774 1809 10.1016/j.clinph.2017.06.001 28709880
Antal, A. et al. Low intensity transcranial electric stimulation: safety, ethical, legal regulatory and application guidelines. Clin. Neurophysiol. 128, 1774–1809 (2017).28709880 10.1016/j.clinph.2017.06.001
26. Klooster D Technical aspects of neurostimulation: focus on equipment, electric field modeling, and stimulation protocols Neurosci. Biobehav. Rev. 2016 65 113 141 10.1016/j.neubiorev.2016.02.016 27021215
Klooster, D. et al. Technical aspects of neurostimulation: focus on equipment, electric field modeling, and stimulation protocols. Neurosci. Biobehav. Rev. 65, 113–141 (2016).27021215 10.1016/j.neubiorev.2016.02.016
27. Tanda, E. et al. Electrocution as a cause of vascular injury: case series and literature review. Annal. Vasc. Surg.-Brief Rep. Innov. 3, 100201 (2023).
28. Robson MC Murphy RC Heggers JP A new explanation for the progressive tissue loss in electrical injuries Plast. Reconstr. Surg. 1984 73 431 437 10.1097/00006534-198403000-00017 6422484
Robson, M. C., Murphy, R. C. & Heggers, J. P. A new explanation for the progressive tissue loss in electrical injuries. Plast. Reconstr. Surg. 73, 431–437 (1984).6422484 10.1097/00006534-198403000-00017
29. Jaffe R Willis D Bachem A Effect of electric currents on the arteries Proc. Soc. Exp. Biol. Med. 1928 26 166 167 10.3181/00379727-26-4197
Jaffe, R., Willis, D. & Bachem, A. Effect of electric currents on the arteries. Proc. Soc. Exp. Biol. Med. 26, 166–167 (1928).10.3181/00379727-26-4197
30. Abbott JJ Diller E Petruska AJ Magnetic methods in robotics Annu. Rev. Control Robot. Autonomous Syst. 2020 3 57 90 10.1146/annurev-control-081219-082713
Abbott, J. J., Diller, E. & Petruska, A. J. Magnetic methods in robotics. Annu. Rev. Control Robot. Autonomous Syst. 3, 57–90 (2020).10.1146/annurev-control-081219-082713
31. Kim Y Telerobotic neurovascular interventions with magnetic manipulation Sci. Robot. 2022 7 eabg9907 10.1126/scirobotics.abg9907 35417201
Kim, Y. et al. Telerobotic neurovascular interventions with magnetic manipulation. Sci. Robot. 7, eabg9907 (2022).35417201 10.1126/scirobotics.abg9907
32. Wang T Adaptive wireless millirobotic locomotion into distal vasculature Nat. Commun. 2022 13 4465 10.1038/s41467-022-32059-9 35915075
Wang, T. et al. Adaptive wireless millirobotic locomotion into distal vasculature. Nat. Commun. 13, 4465 (2022).35915075 10.1038/s41467-022-32059-9
33. Koszowska, Z. et al. Independently actuated soft magnetic manipulators for bimanual operations in confined anatomical cavities. Adv. Intell. Syst. 6, 2300062 (2023).
34. Yang, Z. et al. A dual-mode magnetic intravascular ultrasound robot for tortuous blood vessels. In 2023 IEEE International Ultrasonics Symposium (IUS) (IEEE, 2023).
35. Cruddas, L., Martin, G. & Riga, C. Robotic endovascular surgery: current and future practice. In Seminars in Vascular Surgery (Elsevier, 2021).
36. Pang, Z. & Wu, J. Miniaturized endoscopic probe for optical coherence tomography with a tiny magnet driving device. In Optics in Health Care and Biomedical Optics VI (SPIE, 2014).
37. Zhang, C. et al. High‐speed sub‐millimeter magnetic‐driven rotational scanning side‐imaging OCT probe. J. Biophotonics 16, e202300106 (2023).
38. Searles K Shalabi N Jayhooni SMH Takahata K A planar micro rotary actuator for endoscopic optical scanning Sens. Actuators A: Phys. 2022 345 113768 10.1016/j.sna.2022.113768
Searles, K., Shalabi, N., Jayhooni, S. M. H. & Takahata, K. A planar micro rotary actuator for endoscopic optical scanning. Sens. Actuators A: Phys. 345, 113768 (2022).10.1016/j.sna.2022.113768
39. Gora MJ Suter MJ Tearney GJ Li X Endoscopic optical coherence tomography: technologies and clinical applications Biomed. Opt. Express 2017 8 2405 2444 10.1364/BOE.8.002405 28663882
Gora, M. J., Suter, M. J., Tearney, G. J. & Li, X. Endoscopic optical coherence tomography: technologies and clinical applications. Biomed. Opt. Express 8, 2405–2444 (2017).28663882 10.1364/BOE.8.002405
40. Chen D Yuan W Park H-C Li X In vivo assessment of vascular-targeted photodynamic therapy effects on tumor microvasculature using ultrahigh-resolution functional optical coherence tomography Biomed. Opt. Express 2020 11 4316 4325 10.1364/BOE.397602 32923045
Chen, D., Yuan, W., Park, H.-C. & Li, X. In vivo assessment of vascular-targeted photodynamic therapy effects on tumor microvasculature using ultrahigh-resolution functional optical coherence tomography. Biomed. Opt. Express 11, 4316–4325 (2020).32923045 10.1364/BOE.397602
41. Mavadia-Shukla J High-speed, ultrahigh-resolution distal scanning OCT endoscopy at 800 nm for in vivo imaging of colon tumorigenesis on murine models Biomed. Opt. Express 2018 9 3731 3739 10.1364/BOE.9.003731 30338151
Mavadia-Shukla, J. et al. High-speed, ultrahigh-resolution distal scanning OCT endoscopy at 800 nm for in vivo imaging of colon tumorigenesis on murine models. Biomed. Opt. Express 9, 3731–3739 (2018).30338151 10.1364/BOE.9.003731
42. Yuan W In vivo assessment of inflammatory bowel disease in rats with ultrahigh-resolution colonoscopic OCT Biomed. Opt. Express 2022 13 2091 2102 10.1364/BOE.453396 35519259
Yuan, W. et al. In vivo assessment of inflammatory bowel disease in rats with ultrahigh-resolution colonoscopic OCT. Biomed. Opt. Express 13, 2091–2102 (2022).35519259 10.1364/BOE.453396
43. Duan X A novel robotic bronchoscope system for navigation and biopsy of pulmonary lesions Cyborg. Bionic Syst. 2023 4 0013 10.34133/cbsystems.0013 36951809
Duan, X. et al. A novel robotic bronchoscope system for navigation and biopsy of pulmonary lesions. Cyborg. Bionic Syst. 4, 0013 (2023).36951809 10.34133/cbsystems.0013
44. Prendergast JM Formosa GA Fulton MJ Heckman CR Rentschler ME A real-time state dependent region estimator for autonomous endoscope navigation IEEE Trans. Robot. 2020 37 918 934 10.1109/TRO.2020.3038709
Prendergast, J. M., Formosa, G. A., Fulton, M. J., Heckman, C. R. & Rentschler, M. E. A real-time state dependent region estimator for autonomous endoscope navigation. IEEE Trans. Robot. 37, 918–934 (2020).10.1109/TRO.2020.3038709
45. Kim Y Parada GA Liu S Zhao X Ferromagnetic soft continuum robots Sci. Robot. 2019 4 eaax7329 10.1126/scirobotics.aax7329 33137788
Kim, Y., Parada, G. A., Liu, S. & Zhao, X. Ferromagnetic soft continuum robots. Sci. Robot. 4, eaax7329 (2019).33137788 10.1126/scirobotics.aax7329
46. Wang J Kinematic modeling of magnetically-actuated robotic catheter in nonlinearly-coupled multi-field IEEE Robot. Autom. Lett. 2021 6 8189 8196 10.1109/LRA.2021.3104620
Wang, J. et al. Kinematic modeling of magnetically-actuated robotic catheter in nonlinearly-coupled multi-field. IEEE Robot. Autom. Lett. 6, 8189–8196 (2021).10.1109/LRA.2021.3104620
47. Webster IIIRJ Jones BA Design and kinematic modeling of constant curvature continuum robots: a review Int. J. Robot. Res. 2010 29 1661 1683 10.1177/0278364910368147
Webster, I. I. I. R. J. & Jones, B. A. Design and kinematic modeling of constant curvature continuum robots: a review. Int. J. Robot. Res. 29, 1661–1683 (2010).10.1177/0278364910368147
48. López-Marín A Motorized capsule for shadow-free OCT imaging and synchronous beam control Opt. Lett. 2019 44 3641 3644 10.1364/OL.44.003641 31368932
López-Marín, A. et al. Motorized capsule for shadow-free OCT imaging and synchronous beam control. Opt. Lett. 44, 3641–3644 (2019).31368932 10.1364/OL.44.003641
49. Roonizi AK Sassi R Smoothing filter design: a general framework Biomed. Signal Process. Control 2023 85 104952 10.1016/j.bspc.2023.104952
Roonizi, A. K. & Sassi, R. Smoothing filter design: a general framework. Biomed. Signal Process. Control 85, 104952 (2023).10.1016/j.bspc.2023.104952
50. Chen T-L Lo Y-L Liao C-C Phan Q-H Noninvasive measurement of glucose concentration on human fingertip by optical coherence tomography J. Biomed. Opt. 2018 23 047001 047001 10.1117/1.JBO.23.4.047001
Chen, T.-L., Lo, Y.-L., Liao, C.-C. & Phan, Q.-H. Noninvasive measurement of glucose concentration on human fingertip by optical coherence tomography. J. Biomed. Opt. 23, 047001–047001 (2018).10.1117/1.JBO.23.4.047001
51. Welzel J Reinhardt C Lankenau E Winter C Wolff H Changes in function and morphology of normal human skin: evaluation using optical coherence tomography Br. J. Dermatol. 2004 150 220 225 10.1111/j.1365-2133.2004.05810.x 14996091
Welzel, J., Reinhardt, C., Lankenau, E., Winter, C. & Wolff, H. Changes in function and morphology of normal human skin: evaluation using optical coherence tomography. Br. J. Dermatol. 150, 220–225 (2004).14996091 10.1111/j.1365-2133.2004.05810.x
52. Yuan W Theranostic OCT microneedle for fast ultrahigh-resolution deep-brain imaging and efficient laser ablation in vivo Sci. Adv. 2020 6 eaaz9664 10.1126/sciadv.aaz9664 32300661
Yuan, W. et al. Theranostic OCT microneedle for fast ultrahigh-resolution deep-brain imaging and efficient laser ablation in vivo. Sci. Adv. 6, eaaz9664 (2020).32300661 10.1126/sciadv.aaz9664
53. Liu, G. & Chen, Z. Optical coherence tomography for brain imaging. In Optical Methods and Instrumentation in Brain Imaging and Therapy (ed. Madsen, S. J.) 157–172 (Springer New York, New York, NY, 2013).
54. Mallidi S Spring BQ Chang S Vakoc B Hasan T Optical imaging, photodynamic therapy and optically triggered combination treatments Cancer J. 2015 21 194 205 10.1097/PPO.0000000000000117 26049699
Mallidi, S., Spring, B. Q., Chang, S., Vakoc, B. & Hasan, T. Optical imaging, photodynamic therapy and optically triggered combination treatments. Cancer J. 21, 194–205 (2015).26049699 10.1097/PPO.0000000000000117
55. He B Robotic-OCT guided inspection and microsurgery of monolithic storage devices Nat. Commun. 2023 14 5701 10.1038/s41467-023-41498-x 37709753
He, B. et al. Robotic-OCT guided inspection and microsurgery of monolithic storage devices. Nat. Commun. 14, 5701 (2023).37709753 10.1038/s41467-023-41498-x
56. Yuan W Brown R Mitzner W Yarmus L Li X Super-achromatic monolithic microprobe for ultrahigh-resolution endoscopic optical coherence tomography at 800 nm Nat. Commun. 2017 8 1531 10.1038/s41467-017-01494-4 29142274
Yuan, W., Brown, R., Mitzner, W., Yarmus, L. & Li, X. Super-achromatic monolithic microprobe for ultrahigh-resolution endoscopic optical coherence tomography at 800 nm. Nat. Commun. 8, 1531 (2017).29142274 10.1038/s41467-017-01494-4
57. Blessing K Sharma S Gumann A Singh K Low cost scalable monolithic common path probe design for the application in endoscopic optical coherence tomography Eng. Res. Express 2019 1 025008 10.1088/2631-8695/ab4783
Blessing, K., Sharma, S., Gumann, A. & Singh, K. Low cost scalable monolithic common path probe design for the application in endoscopic optical coherence tomography. Eng. Res. Express 1, 025008 (2019).10.1088/2631-8695/ab4783
58. Vakoc BJ Fukumura D Jain RK Bouma BE Cancer imaging by optical coherence tomography: preclinical progress and clinical potential Nat. Rev. Cancer 2012 12 363 368 10.1038/nrc3235 22475930
Vakoc, B. J., Fukumura, D., Jain, R. K. & Bouma, B. E. Cancer imaging by optical coherence tomography: preclinical progress and clinical potential. Nat. Rev. Cancer 12, 363–368 (2012).22475930 10.1038/nrc3235
59. Jiao L Chen R Ye D Li W Li D Optical droplets sorting assisted by superhydrophobic surface with hydrophilic patterns Int. J. Heat Mass Transf. 2019 143 118560 10.1016/j.ijheatmasstransfer.2019.118560
Jiao, L., Chen, R., Ye, D., Li, W. & Li, D. Optical droplets sorting assisted by superhydrophobic surface with hydrophilic patterns. Int. J. Heat Mass Transf. 143, 118560 (2019).10.1016/j.ijheatmasstransfer.2019.118560
60. Xu, M. et al. End-to-end semi-supervised object detection with soft teacher. In Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, 2021).
