Optical recognition of constructs using hyperspectral imaging and detection (ORCHID)
The date of：
2022-12-08
viewed:
1
Challenges to deep sample imaging have necessitated the development of special techniques such as spatially offset optical spectroscopy to collect signals that have travelled through several layers of tissue. However, these techniques provide only spectral information in one dimension (i.e., depth). Here, we describe a general and practical method, referred to as Optical Recognition of Constructs Using Hyperspectral Imaging and Detection (ORCHID). The sensing strategy integrates (1) the spatial offset detection concept by computationally binning 2D optical data associated with digital offsets based on selected radial pixel distances from the excitation source; (2) hyperspectral imaging using tunable filter; and (3) digital image binding and collation. ORCHID is a versatile modality that is designed to collect optical signals deep inside samples across three spatial (X, Y, Z) as well as spectral dimensions. The ORCHID method is applicable to various optical techniques that exhibit narrow-band structures, from Raman scattering to quantum dot luminescence. Samples containing surface-enhanced Raman scattering (SERS)-active gold nanostar probes and quantum dots embedded in gel were used to show a proof of principle for the ORCHID concept. The resulting hyperspectral data cube is shown to spatially locate target emitting nanoparticle volumes and provide spectral information for in-depth 3D imaging.The capability to image targets in deep tissue is very important for many applications in the field of medicine. For instance, multiple imaging techniques are used for detecting tumors in vivo based on chemical and molecular differences that inherently manifest in the altered tumor environments of many cancers. Differences in oxygen consumption, energy generation, and density are among the number of changes in the tumor that key techniques such as Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), and Computed Tomography (CT) aim to detect1,2. However, the widespread use of these imaging gold standards for cancer detection are ultimately limited by their high costs and requirement of skilled personnel for operation and interpretation. Alternative detection methods using optical techniques such as diffuse reflectance, fluorescence imaging, and Raman spectroscopy have been developed to detect the molecular changes in the tumor environment in a rapid and cheap manner by imparting light unto the tissue and detecting either the backscattered or re-emitted photons3,4,5. These optical techniques are highly sensitive to the chemical composition of tissue and have been shown to effectively discern the altered oxygenation and chemical balance of key molecules involved in energy production such NADH and FAD4. However, complex chemical compositions and tissue geometries may result in overlapped spectral signals in absorption and fluorescence, thus limiting the use of techniques such as fluorescence and diffuse reflectance, which rely on wide spectral signatures. Several optical techniques provide spectra with very narrow spectral structures such as Raman, quantum dot fluorescence, and rare earth luminescence.Raman spectroscopy, which relies on the inelastic scattering of light, produces a very narrow-band spectral signature unique to the vibrational signatures of key specific chemical groups. This feature makes the Raman method a highly specific technique that can detect the unique spectral fingerprint of specific molecules of interest amidst non-target signals and interfering background signals. In the context of cancer detection, several studies have shown differences in the total spectral Raman differences in tumors due to varying amounts of lipid density. With a simple change in laser excitation wavelength, Raman spectroscopy can also be shifted into the near-IR spectral region (700–1100 nm), referred to as the “optical window”, where there is much less tissue absorption, allowing for greater tissue penetration6. However, the technique is largely limited by the intrinsically low Raman scattering cross-section of most molecules. Fortunately, the Raman signal can be greatly augmented with the use of metallic nanostructures that induce the phenomena of surface-enhanced Raman scattering (SERS).Following the discovery of the SERS effect for highly polarizable small molecules, such as pyridine, benzoic acid and their derivatives, our laboratory first demonstrated the general applicability of SERS as an analytical technique that can be applied to a wide variety of chemicals including homocyclic and heterocyclic polyaromatic compounds7,8,9. For the following three decades, our team pioneered the development of SERS techniques and plasmonic nanoprobes for a wide variety of chemical analysis, biological monitoring, and medical applications10,11,12,13,14,15,16. Nanoparticles made of noble metal (silver, gold) exhibit enormous Raman signal enhancement due to the so-called “plasmonic” effect producing a strong electromagnetic (EM) field enhancement near the nanoparticle’s surface, producing the SERS effect, which has been shown to achieve single-molecule detection. By coupling a Raman active dye with a metallic nanoparticle with a unique geometry such as a gold nanostar (GNS), a very strong SERS enhancement can occur due to the “lightning rod” effect on the sharp tips of the nanoparticle17,18,19. We have developed this nanoparticle platform as a means of nucleic acid biomarker detection of several diseases as well as additional uses such as photothermal heat treatment of cancer12,20,21,22.The SERS technique has been used for the detection of Raman-labeled GNS absorbed in tumors for in vivo cancer monitoring using a murine model has been reported13,23,24. These applications illustrate the selective detection of SERS signals only in one dimension. To overcome this limitation, the technique Spatially Offset Raman Spectroscopy (SORS) is used to selectively collect Raman scattered photons that have originated from deeper in the sample by creating a source to detector separation25,26,27. Building upon previous work coupling SORS and SERS for detecting targets through tissue, we have coupled the SERS-GNS nanoplatform with the Spatially Offset Raman Spectroscopy (SORS) technique as a means of detecting through highly scattering material such as bone tissue28,29,30,31,32. In this work we aim at developing a novel and general methodology that can be applied not only to Raman but also to other optical techniques exhibiting narrow-band spectral structures such as luminescence from quantum dots, rare earth species and upconverting nanomaterials.For this reason, we refer to the proposed method as Spatially Offset of Narrowband Optical Spectroscopy (SONOS), which comprises SORS as well as other types of spatially offset luminescence spectroscopy (SOLS) from quantum dots, rare earth species and upconverting nanomaterials. It is important to note that a general offset detection concept is not new as it has also been used in Diffuse Optical Tomography and Fluorescence Tomography as a means of creating a depth resolved spatial map of the different chemical compositions33,34,35. However, SONOS has the advantage of producing much sharp spectral peaks that do not overlap, thus allowing for much higher multiplexing capabilities and higher signal to noise ratio. Building on previous works that detect the intrinsic Raman signals of key molecules, we utilize our SERS particles as means of detecting through the skull up to 50 mm deep and show the potential for detecting deeply seated brain cancer tumors once nanoparticles have selectively collected around the tissue24,36. However, to date the SORS method relies on a static optical configuration that relies on the light source being physically separated from the detector spot. The use of a fiber bundle with different radial collection fibers can effectively collect the different spatial offsets at once, but it requires the use of a custom-made fiber bundle and is effectively sampling only one spot at a time, providing information in one z-dimension (depth).The new method, referred to as Optical Recognition of Constructs Using Hyperspectral Imaging and Detection (ORCHID) system is an integration of different techniques: (I) spatial offset detection concept, (II) hyperspectral imaging, (III) digital image binning, and (IV) 3D image collation (Fig. 1). ORCHID expands the spatial offset methodology into a 3D imaging modality in the XY plane and Z depth. This is done by combining a hyperspectral imaging system using a tunable filter, such as a spectrally scanned liquid crystal tunable filter (LCTF), and a two-dimensional charge coupled device (CCD). With ORCHID the recorded intensity data collected on the CCD are digitally binned within circular rings at different pixel radial distances from the excitation spot as a digital strategy for obtaining the different source to detector spatial offsets. By utilizing this concept, we can simultaneously collect the different depth-correlated signals from the offsets at once, and by spatially scanning the sample we are able to form a hyperspectral map of different spatial offsets. The result is a map of multiple hyperspectral data cubes that contain information on the spatial and spectral location of the SERS signal of the target. In this study, we demonstrate the ORCHID system’s capabilities by showing its ability to discern SERS signatures of different embedded GNS-dyes in agarose gel layers. We also show a mapping capability over a large field of view region of a gel to show the potential for hyperspectral imaging. The procedure represents a novel method for depth sensitive molecular imaging of tumor margins and provides a new development towards more accessible early cancer detection.The ORCHID digital offset conceptThe spatially offset method of SONOS, which can be applied to Raman and luminescence, is fundamentally reliant on the calibration of spectra different source-to-detector separations. This spectral calibration process is most reliable with spectra exhibiting narrowband emission. Spatial offsets in most SONOS systems physically separate the focal excitation spot from the collection spot in specific distances. Several configurations have been previously used for Raman in SORS. However, the spatially offset approach can also be applied to luminescence techniques that exhibit narrow-band emission spectra such as luminescence from various species such as quantum dots, rare-earth species, and upconverting particles. The spatially offset strategy can be achieved using two lenses whose focal spots are physically separated, while other configurations using a ringed excitation of specific radial amounts can serve as the offset. An optical fiber bundle may also be utilized in similar manner wherein the excitation and collection fibers can be physically separated from each other (Fig. 2A). Here, the ORCHID system does not require a fiber bundle with different radial collection fibers to achieve the offset separating mechanism; the ORCHID system relies instead on computationally separated pixels that are at specific radial distances from the center of the two-dimensional CCD detector (Fig. 2A). The CCD with a pixel width of 12 µm and a total of 512 × 512 pixels can be radially binned at specific distances from the center by computationally selecting pixels a set distances, representing the spatial offsets of SONOS.Optical configuration of ORCHID systemThe ORCHID optical system shown in Fig. 2C comprises of an inverted optical microscope setup (Olympus Corporation, Shinjuku, Tokyo, Japan) coupled with a 785-nm laser that is collimated and sent to a dichroic mirror configuration where it is focused with a 10 × objective (Thorlabs, New Jersey, USA) towards a sample seated on a motorized linear stage (Zaber Technologies Inc., Vancouver, British Columbia, Canada). The backscattered signal is collected and passed through a Notch filter before going through a spectrally scanned dual-LCTF system mounted in front of a two-dimensional (512 × 512 pixels) CCD array (Princeton Instruments, New Jersey, USA). The LCTFs are programmatically scanned at selected spectral increments (e.g., 1 nm) and at a selected exposure time (e.g., 1 s). The sample is then spatially scanned in the XY plane using the motorized stage at selected increments (5 mm or less) to produce a spatial map that can localize the placement of small gel targets of 5 mm width within a larger gel volume. The resolution in the XY plane may reach optical resolutions of about 1 µm with smaller spatial increments, while Z axis resolution can be several microns depending on the sample size and the desired spatial resolution. Figure 2D shows the binary radial mask used to bin the CCD image data to isolate the pixels of specific spatial offset using different radial rings. These spatially offset pixels are later used to produce spatially offset maps and spectra in Figs. 3 and 4 respectively.ORCHID XY spatial image reconstructionWe first demonstrate the capability of the ORCHID system to produce a hyperspectral spatial map of a sample system, which consists of an agarose gel sample with an embedded layer containing gold nanostars linked with a DTTC Raman Dye (GNS-DTTC) in the middle (Fig. 3A). The GNS-DTTC is a small 5 mm by 5 mm cube sandwiched between 5 mm thick gel layers. Our previous study has shown that SERS-labeled GNS injected into a mouse model are preferentially absorbed into tumors due to the Enhanced Permeability and Retention (EPR) effect of tumor vasculature16,23,37. The EPR effect is a result of the inherent leakiness of the tumor vasculature which is often underdeveloped and allows nanoparticles to escape circulation and accumulate passively in tumors. Also, the retention of nanoparticles in the tumor is enhanced by the lack of an efficient lymphatic system which would normally carry extravasated fluid back into circulation. In this study, the agarose gel simulates a tissue sample and the GNS-DTTC cube represents a tumor that has absorbed GNS nanoprobes. The ORCHID system is scanned across this sample spatially and spectrally as means of spatially localizing the XY position of the GNS-DTTC cube. The stage is moved at increments of 1 mm and the LCTF wavelength was scanned at increments of 1 nm from 800 to 830 nm. The exposure was set to 1 s and selected to capture the data at each combination of spatial and spectral position. A slice at 820 nm of the stitched hyperspectral data cube is shown where the increased yellow intensity on the map shows the position of the GNS-DTTC volume position whose SERS spectra has a local peak at that wavelength (Fig. 3B). The resulting spectra from each pixel binning was obtained by collecting the imaging pixels at specific spatial offset (pixel radii) and summing across the different frequencies (Fig. 3C).ORCHID digital radial binning offset for in depth sensingWe used a simplified dual-layer gel sample of GNS-DTTC and GNS-IR780 that was stacked to illustrate the digital radial binning concept for in depth sensing. Each layer was 3-mm thick where the latter occupied the bottom layer, and the former occupied the top layer (Fig. 4). Hyperspectral data were collected at a single spot, where the LCTF was scanned from 800 to 880 nm. The resulting image arrays were computationally masked at different radial distances, representing spatial offsets by the distance of multiple 12 µm pixels as shown in Fig. 2B. A “waterfall” collection of different spatial offset spectra shows the change in spectral shape across increasing spatial offsets. Above and below this waterfall plot are the reference GNS-dye spectra with arrows pointing the unique peaks in each dye. In particular, the prominence of SERS peak belonging to one or the other GNS-dye changes indicating the ability of the system to discern between layers of the SERS targets of at least 3 mm. With greater spatial offset radial binning distances, the Raman peaks of the farther layer become more apparent, demonstrating that recovery of the Raman spectra from the deeply embedded layer is possible.ORCHID mapping and detection of embedded dual layer GNS-dye gelsTo demonstrate the ORCHID mapping capability, we used an embedded dual layer sample sandwiched between 5 mm thick gel layers (Fig. 5A). The XY plane mapping is finally combined with the binned radial spatial offsets (shown as disks of width 1 pixel centrally spaced around the excitation point). Supplementary Fig. 1 details the image array and binary mask used to spatially bin the image data. Data were collected in a similar manner as the previous experiments but now the data are formed together to make a hyperspectral data map (Fig. 5B). With the spectral peaks of each GNS-dye identified, a ratio-metric graph of between the dye peaks of GNS-DTTC and GNS-IR780 are depicted to show the spectral change as the spatial offsets are increased (Fig. 5B). Additional spatial binning configurations are detailed in Supplementary Fig. 2. The data ultimately shows the prevalence of the farther layer GNS-dye with greater offset in agreement with the ORCHID concept.Spatially Offset Raman spectroscopy is most crucially used to probe the molecular composition of a sample that is especially thick and turbid. The concept of source and detector separation has been implemented in a variety of ways, most commonly with a physical separation between the excitation and collection points in order to provide depth-related spectral information for one dimension (Z) The ORCHID system leverages the multichannel imaging approach of a CCD where spatial offsets are directly mapped and digitally binned in selected regions on the 2D (XY) imaging array detector in order to produce 3D data (XYZ) with depth information.Furthermore, the use of liquid crystal tunable filters leverages the hyperspectral imaging approach where each image can be scanned spectrally through multiple wavelengths, thus producing a four-dimensional (4D) data hypercube (XYZ, wavelength). The ORCHID method utilizes a simple configuration that leverages the unique advantages of an LCTF. With this solid-state tunable filter device, we can scan across a sample obtain a hyperspectral cube map containing data in 3 axial directions and 1 frequency direction. We demonstrate the ability to achieve SORS at single points and SORS at points in a map up to 100 mm2 area. These capabilities will allow of much larger sample imaging and ultimately provide molecular information in different dimensions. The ORCHID system can currently obtain signal up to half a cm, but this Z resolution is highly dependent on the type of sample, level of scattering, and quality of the detector. SORS has a theoretical resolution in the order of centimeters and can feasibly be achieved with the ORCHID system with further optimization to the optical setup.Raman signal in the lower layers notably becomes more prominent with spatial offset, signifying the selective ability of the ORCHID system on the Z axis direction. It is important to note that signal shape and intensity are highly variable and attempts of a calibration in a simple gel phantom results in a model that is often not transferrable to more complex samples containing non-Raman signal and background noise or those that have an irregular shape with different boundaries between layers. Agarose gel phantoms are idealized media often having low scattering and absorption in the near IR range, thus allowing for the SERS signal of GNS to be the primary signal source. However, real tissue is highly complex and has optical properties (absorption and scattering) which could affect excitation laser light penetration and target signal propagation. Additionally, there are also interfering background sources such as intrinsic fluorescence arising from biological tissue components that can potentially interfere with the target signal. This is a large hurdle in applications of SORS in-vivo and typically limits its usefulness to samples that already have a strong intrinsic Raman scattering property such as bone30,32,38,39. The ORCHID system offers a way to circumvent this issue by taking advantage of emission signals of particles such as SERS gold nanostars and quantum dots that exhibit sharp and identifiable spectral peaks. Additionally, the unique scanning and binning imaging process can be used to localize signals to areas that specifically aggregate particles. In cancer diagnostics, this approach can be used for detecting tumors by taking advantage of the well-known enhanced permeability and retention feature, which involves the natural propensity of nanoparticles to extravasate from the tumor vascular network and accumulate in and around cancer cells16,23,37. In this study, we have used gel phantoms whereby the GNS-loaded volume corresponds to tumor because our previous studies have demonstrated that injected GNS to mouse models can selectively accumulate into tumors due to this EPR effect. To that end, we showed that the ORCHID system can create a hyperspectral SERS dataset in multiple spatial dimensions, providing information that could help distinguish tumor tissue from non-tumor using gel phantoms.Acquiring a high-resolution multidimensional hyperspectral data is time consuming due to the need to scan across a sample, and thus an optimization in the scanning methodology must be considered. In this proof of principle demonstration, we selected a stage increment of 5 mm. Higher spatial resolution would involve smaller stage increment, thus high number of measurement data points and therefore longer data acquisition time. Tradeoffs between data collection time and data volume must be made based on the needs of the applications. The ORCHID system has a theoretical resolution set at the optical resolution limit dictated by the objective lens and the laser wavelength used. At near-IR wavelengths, this can be around 0.7 to 1 µm range as for the typical epi-illumination microscope in the XY plane. However, mechanical limitations to the physical scanning of the stage itself could slow collection time, and for this initial configuration we utilized a standard microscope stage that has a typical movement speed of around 200 mm/s. Faster scanning can be achieved by using high speed stages or alternatively galvanic mirrors, both of which can dramatically decrease the data collection time by orders of magnitude.Signal quantification requires more experimental tuning as the different spatial offsets have different signal-to-noise ratios (SNRs) since larger spatial offsets contain more pixels in a larger circle to receive the outgoing Raman/luminescence photons. In Fig. 7. we show that there is a maximum radial offset of around 75 to 80 pixels that maximizes the signal corresponding to the depth of the target (1 mm below the surface). This demonstrates the ability to correlate depth to the ORCHID signal collected. Corresponding images at 50, 100, and 150 binned radial pixels show correlation with the trend of the signal ratio in the plotted graph peaking at around 80 pixels. However, an important factor to consider is that the SNR gradually decreases in the larger radial binning due to the signal becoming more spread out along the binned pixels. It is important to note that this technique creates a tradeoff in maximal depth and depth resolution. Our previous work on using SORS through an animal skull has allowed for detection of signal up to 50 mm deep, but the current ORCHID system has so far been demonstrated to resolve down to 15 mm in this work32. This depth constraint could be addressed with the use of larger radial binning (i.e. spatial offset) values which would produce signals for increased depth. In fact, Fig. 7. indicates that there is a decreasing difference between target signal to background with greater spatial offsets, ultimately limiting the maximal depth potential of the ORCHID system. One way to increase this signal to background difference and maximal depth detection is to increase the radial binning thickness. It is noteworthy that there is a tradeoff between depth resolution and radial binning thickness due to mixing of signals along the layers as more of the axial positions are sampled.The ORCHID system as demonstrated in this work shows a potential for creating imaging maps with molecular specificity due to its ability to obtain multi-dimensional hyperspectral data. In particular, deep sample imaging such as for tumors containing SERS active GNS is possible as the modality allows for spatially sensitive detection of spectrally unique signal. Molecular tissue margining for live tumor resection is an application of ORCHID that will greatly augment existing surgical cancer treatments which traditionally rely on offline imaging modalities such as CT or MRI. ORCHID also has the benefit of probing through depth using image processing alone unlike existing fiber bundles that have set source-detector separation configurations. The current ORCHID system is a prototype device designed to provide a proof of principle demonstration. Future development could further improve the system. Namely, the collection speed of the ORCHID system could be designed to be faster. To address this issue, galvanic mirrors for beam steering can be used in place of scanning for much greater scanning speeds.Another limitation of ORCHID and diffuse optical modalities in general is spectral mixing, in which signals from other diffuse sources (e.g. interfering autofluorescence from tissue media) in the sample are mixed with the target signal. Numerous attempts have been made to separate the spectral signals in terms of layers based on signal intensity and a-priori knowledge of the top layer spectra32,40. Multivariate statistical techniques in particular use features of the spectra to unmix the signals to map towards the layers, but these methods typically require relatively clean data and will be negatively impacted by non-Raman features in the spectra40,41. The field of chemometrics leveraged such classical statistical techniques for spectral decomposition, but recently there has been a re-emerging trend towards using deep learning neural networks for data analysis and prediction42,43,44,45. Thus, machine learning technology can be leveraged to better decompose the different signals in the target. Imaging in particular has seen explosive development in using convolutional neural networks for feature extraction and labelling, and such methods are now being utilized in hyperspectral imaging43,46,47. Future integration with neural networks can be used to solve the inverse problem of having to know what type of and where the signal came from based on the detected signal in a system like ORCHID.The ORCHID system represents a novel modality for probing deeply embedded targets in highly scattering tissue. This has significant impact on its use as a cancer detection mechanism for in vivo tissue sensing as current modalities (e.g., PET, MRI, CT) are prohibitively expensive or comes with trade-offs such as the lack of molecular information. The ORCHID method is suitable for use with optical techniques exhibiting narrow-band structures, such as Raman scattering, luminescence from quantum dots, rare earth species, and upconverting nanomaterials. ORCHID combines the strengths of the digital spatial offset concept, hyperspectral imaging, and digital image binding and collation to create a dataset containing information ranging from spatial distribution to molecular makeup. For instance, the ORCHID system can provide a real-time monitoring and detection system cancer margin detection when used to detect gold nanostars that accumulate preferentially in tumors due to the EPR effect16,23,37. Applying the ORCHID system with SERS gene nanoprobes would provide a potential future in which gene expression can be monitored in-vivo in tissue or plant systems12,23,48. In conclusion, the ORCHID system integrates hyperspectral imaging with digital data processing in order to provide 3D spatial and spectral information for various spectroscopic techniques including Raman, fluorescence, and phosphorescence.
Hot News
/
Related to recommend
2024
-
12
-
27
Click on the number of times:
0
Dinuclear Rare-Earth β-Diketiminates with Bridging 3,5-Ditert-butyl-catecholates: Synthesis, Structure, and Single-Molecule Magnet Properties source:ACS PublicationsAbstract ImageThe dinuc...
2024
-
12
-
26
Click on the number of times:
0
source:National University of SingaporeScientists from the National University of Singapore (NUS) have developed a highly effective and general molecular design that enables an enhancement in radiolum...
2024
-
12
-
24
Click on the number of times:
0
source:sciencedirectAbstractRare earth elements (REEs) encompass 15 lanthanides and play a crucial role in modern technology. Despite their essential uses, REEs are emerging environmental contaminants...
2024
-
12
-
23
Click on the number of times:
0
source:Yasmin Ahmed SalemMax Planck Institute for Sustainable Materials (MPI-SusMat) researchers have transformed dealloying—traditionally seen as a corrosive, destructive process—into a groundbreakin...