研究生: |
林子亘 Lin, Tzu-Hsuan |
---|---|
論文名稱: |
用於超穎材料驅動微型衛星之高光譜影像壓縮感知及量子變遷偵測 Hyperspectral Compressed Sensing and Quantum Change Detection for Metasurface-Driven Miniaturized Satellite |
指導教授: |
林家祥
Lin, Chia-Hsiang |
學位類別: |
博士 Doctor |
系所名稱: |
電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering |
論文出版年: | 2025 |
畢業學年度: | 113 |
語文別: | 英文 |
論文頁數: | 141 |
中文關鍵詞: | 變遷偵測 、壓縮感知 、凸優化 、深度學習 、高光譜影像 、微型衛星 、量子計算 、量子深度學習 |
外文關鍵詞: | Change detection, compressed sensing, convex optimization, deep learning, hyperspectral images, miniaturized satellite, quantum computing, quantum deep learning |
相關次數: | 點閱:105 下載:9 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
相較於僅擁有三個頻帶的傳統RGB 影像,高光譜影像(hyperspectral image, HSI)涵蓋從可見光到不可見光的數百個光譜,其豐富的頻譜資訊使得我們能夠透過分析高光譜影像的頻譜特徵來進行物質辨識,並且已經應用至許多關鍵領域,如衛星遙測。發展台灣自主的微型衛星在近年來已成為我國最重要計畫之一,福衛八號衛星作為「第三期國家太空科技發展長程計畫」第一個高解析度光學遙測衛星即將於2025 年十月發射,足見自主研發重量輕、成本低及高效能衛星為我國太空計畫之首要目標。有鑑於高光譜影像的物質辨別能力,使得學者能夠僅憑從太空拍攝之衛星影像便能了解地表之物質組成及變化,因此發展一顆能夠拍攝高光譜影像的微型衛星能夠為環境監測以及救災防害帶來非常大的幫助。
然而,高光譜影像紀錄了數以百計的頻帶,導致其檔案大小比RGB 影像大非常多,使得高光譜影像之儲存與傳輸成為一項重大挑戰。傳統的解決方法是透過壓縮感知技術來取得高度壓縮過後的檔案。現有的高光譜壓縮感知方法在硬體上大多會包含分光鏡(spectral splitter, SS)、數位微鏡元件(digital micromirror device, DMD)以及柱面透鏡(cylindrical lens, CL)。其中,用於實現隨機投影之數位微鏡元件是一個笨重的元件,不利於應用於微型衛星之開發。於此同時,近期發展出的多功能超穎材料(multifunctional metamaterial)僅憑一個奈米級的超平面(metasurface)便能達成分光鏡和柱面透鏡的分光及聚光功能。基於此概念,本論文開發了全加法高光譜壓縮感知(all-addition hyperspectral compressed sensing)技術,在壓縮編碼端僅使用加法算子以配合多功能超穎材料特性進而符合微型衛星之發展。然而,由於本方法在編碼端極度簡化,導致解碼過程面臨極大的挑戰。為解決此問題,本文基於影像的自相似性設計了一凸優化(convex optimization)準則,此自相似性準則已被寫為凸函數的形式,並透過實驗證明在極低的採樣率下,仍然能夠有效解碼出高光譜影像。此外,本文亦建立一套基於約翰橢球(John ellipsoid, JE)之分析框架,確保演算法在極低的數據純度(data purity)情況下,依舊能夠完整還原高光譜影像。
有鑑於前述提及之高光譜影像的物質辨別能力能夠探測地表的物質組成及變化,使得高光譜衛星影像能夠為環境監測以及救災防害提供更精準的評估,例如高光譜異物偵測可應用於軍事偵測或稀有礦物偵測。因此近年來高光譜衛星影像之變遷偵測因其對於地表監測及精準農業之能力逐漸受到重視,尤其是基於凸優化或是深度學習(deep learning)之高光譜變遷偵測方法。其中,深度學習通常需要大量數據集來學習影像特徵,特別是在高光譜影像中,數據取得不易,且人工標記過程耗費大量時間與資源。而凸優化準則通常需要數學形式複雜的正則化項以有效且適應性的解決不適應高光譜影像反問題。因此,本文基於衛星反演成像的小數據凸深度學習技術(convex deep, CODE)(該技術榮獲國家科學及技術委員會所頒發之未來科技獎)結合凸優化準則及圖神經網路(graph neural network, GNN),提出一種適用於極低標註率的半監督式(semi-supervised)高光譜變遷偵測演算法。此凸深度學習高光譜變遷偵測(CODE-HCD)演算法利用了高光譜影像之特性設計了一凸Q-二次範數正則項,其具有非常簡單的數學結構,因此能實現演算法的高速運算。在極低標註率的情景下,所提出之凸深度學習高光譜變遷偵測在真實高光譜數據集上優於基準高光譜變遷偵測方法,證實此方法之有效性。
近年來,量子計算作為一個備受矚目的領域迅速崛起,引起了研究界的廣泛關注。量子糾纏的相關研究更於2022 年獲得諾貝爾物理學獎。基於參數化量子電路設計的量子深度網路(quantum deep network, QUEEN)在近期也被開發用於解決不同問題,並在多個領域中展現出卓越的表現,例如藥物反應預測、健康檢測以及影像分類等。因此除了上述將凸優化與深度學習結合的方式以外,本文認為在傳統深度學習的方法中導入理論上全新的量子資訊也能夠強化最後的變遷偵測結果。作為先驅性的研究,本文將量子深度學習網路引入圖神經網路高光譜變遷偵測網路以提升其性能。相較於傳統的卷積神經網路(convolutional neural network, CNN)或圖神經網路萃取影像中的仿射特徵,量子深度學習網路汲取么正特徵,為最後的分類提供理論上不同的額外資訊。在所提出的量子深度學習驅動圖神經網絡(QUEEN-empowered GNN, QUEEN-G)中,圖特徵學習模組利用雙時相高光譜影像在超像素(superpixel)層級的圖結構,而量子特徵學習模組則在像素層級學習量子特徵,作為圖特徵學習模組的補充,保留了在超像素中未能保留的像素層級的詳細空間資訊。在最終的分類階段,設計了一個量子分類器來與傳統的全連接分類器協同工作,進一步提升變遷偵測的準確性。實驗結果證明,所提出的QUEEN-G 演算法在真實高光譜數據集上表現優異,且量子計算所提供的么正特徵能有效增強變遷偵測性能。
Compared to traditional RGB images with only three spectral bands, hyperspectral images (HSIs) contain hundreds of spectral bands ranging from visible to invisible wavelength. The rich spectral information enables substance identifiability by analyzing the spectral curves, also known as spectral signatures, of HSIs and has been widely applied in critical fields such as satellite remote sensing. Developing domestically manufactured miniaturized satellite has become one of Taiwan's most significant projects in recent years. FORMOSAT-8, the first high-resolution optical remote sensing satellite under the “Third Phase of the National Space Science and Technology Development Long-term Plan,” is scheduled for launch in October 2025. This highlights the primary objective of Taiwan's space program, which is the independent development of lightweight, cost-effective, and high-performance satellites. Given the substance identifiability of HSIs, researchers can analyze satellite images captured from space to understand the composition and changes of substances on the Earth's surface. Consequently, developing a miniaturized satellite capable of capturing HSIs could greatly benefit environmental monitoring and disaster prevention efforts.
However, HSIs record hundreds of spectral bands, resulting in significantly larger file sizes compared to RGB images. This poses a major challenge for the storage and transmission of hyperspectral data. Traditional approaches address this issue through compressed sensing techniques to achieve highly compressed files. Existing hyperspectral compressed sensing (HCS) methods typically rely on hardware components such as spectral splitter (SS), digital micromirror device (DMD) array, and cylindrical lens (CL). Among these, the DMD, used for implementing random projections, is a bulky component that is unsuitable for miniaturized satellite development. Recently developed multifunctional metamaterials have shown the ability to achieve spectral splitting and focusing using a single nanoscale metasurface, replacing the need for SS and CL. Based on this concept, this dissertation proposes an alladdition HCS method, which utilizes only deterministic addition operators at the encoding stage to align with the characteristics of multifunctional metamaterials, thereby meeting the requirements of miniaturized satellite development. However, due to the extreme simplification of the encoding process, the decoding stage presents significant challenges. To address this, a convex optimization (CO) criterion was designed based on the self-similarity characteristic of HSIs. This self-similarity criterion is formulated as a convex function, and experimental results validate that even at extremely low sampling rates, the proposed decoding approach can accurately reconstruct HSIs. Additionally, this dissertation establishes a convex analysis framework based on the John ellipsoid (JE) to ensure the algorithm's ability to accurately recover HSIs under conditions of extremely low data purity.
Given the aforementioned substance identifiability of HSIs, which enable the detection of substance composition and changes, hyperspectral satellite remote sensing images can provide more accurate predictions for land monitoring and disaster prevention. For example, hyperspectral anomaly detection can be applied to military surveillance or rare mineral detection. Hyperspectral change detection (HCD) has gained increasing attention in recent years due to its contributions to surface monitoring and precision agriculture, particularly methods relying on CO or deep learning (DL). However, DL-based methods typically require big data to learn image patterns, which are difficult to obtain in the hyperspectral domain, and the manual annotation process is highly labor-intensive and expensive. On the other hand, CO criteria often require complex mathematical formulations for regularization terms to effectively address the ill-posed nature of hyperspectral inverse problems. To address these challenges, this dissertation proposes a HCD algorithm based on the convex deep (CODE) theory for satellite inverse imaging, a technique that has been recognized with the FutureTech Award by the National Science and Technology Council (NSTC), Taiwan. By integrating CO criterion with a graph neural network (GNN), the proposed convex deep HCD (CODEHCD) algorithm enables semi-supervised HCD for scenarios with extremely a low labeling rate. The proposed CODE-HCD algorithm combines a convex Q-quadratic norm regularizer tailored to the characteristics of HSIs. This regularizer is constructed with a highly simple mathematical structure, facilitating the algorithm’s high computational efficiency. Under the scenario of an extremely low labeling rate, the proposed CODE-HCD algorithm demonstrates superior performance over state-of-the-art benchmark HCD methods on real hyperspectral datasets, verifying its effectiveness.
In recent years, quantum computing has rapidly emerged as a prominent field, garnering widespread attention from the research community. Studies on quantum entanglement were further recognized with the 2022 Nobel Prize in Physics. Quantum deep networks (QUEENs), designed based on parameterized quantum circuits, have recently been developed to address diverse problems such as drug response prediction, health detection, and image classification. Therefore, in addition to the previously discussed combination of CO and DL, this dissertation proposes that introducing theoretically novel quantum information into traditional DL methods can further enhance the final change detection results. As a pioneering effort, this dissertation introduces QUEENs into GNN-based HCD frameworks to improve change detection accuracy. Unlike traditional convolutional neural networks (CNNs) or GNNs that extract affine-computing features, QUEENs capture unitary-computing features, providing additional and theoretically novel information for final classification. In the proposed QUEEN-empowered GNN (QUEEN-G), the graph feature learning module leverages the graph structure of bitemporal HSIs at the superpixel level, while the quantum feature learning module extracts quantum features at the pixel level, which serves as a complement to the graph feature learning module by preserving detailed pixel-level spatial information that may be lost at the superpixel level. For the final classification stage, a quantum classifier is designed to collaborate with a traditional fully connected classifier for enhancing the detection performance. Experiments on real hyperspectral datasets demonstrate that the proposed QUEEN-G significantly outperforms existing HCD methods, validating that the introduction of quantum unitary features enhances classification accuracy.
[1] C.-Y. Chi, W.-C. Li, and C.-H. Lin, Convex Optimization for Signal Processing and Communications: From Fundamentals to Applications. CRC Press, Boca Raton, FL, 2017.
[2] S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004.
[3] N. Keshava and J. F. Mustard, “Spectral unmixing,” IEEE signal processing magazine, vol. 19, no. 1, pp. 44–57, Jan. 2002.
[4] C.-H. Lin and J. M. Bioucas-Dias, “Nonnegative blind source separation for ill-conditioned mixtures via John ellipsoid,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 5, pp. 2209–2223, May 2021.
[5] C.-H. Lin, W.-K. Ma, W.-C. Li, C.-Y. Chi, and A. Ambikapathi, “Identifiability of the simplex volume minimization criterion for blind hyperspectral unmixing: The no-pure-pixel case,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 10, pp. 5530–5546, May 2015.
[6] C.-H. Lin, R. Wu, W.-K. Ma, C.-Y. Chi, and Y. Wang, “Maximum volume inscribed ellipsoid: A new simplex-structured matrix factorization framework via facet enumeration and convex optimization,”SIAM Journal on Imaging Sciences, vol. 11, no. 2, pp. 1651–1679, Jun. 2018.
[7] M. D. Craig, “Minimum-volume transforms for remotely sensed data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 32, no. 3, pp. 542–552, May 1994.
[8] P. Du, S. Liu, P. Gamba, K. Tan, and J. Xia, “Fusion of difference images for change detection over urban areas,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 5, no. 4, pp. 1076–1086, Aug. 2012.
[9] J. M. Bioucas-Dias, A. Plaza, G. Camps-Valls, P. Scheunders, N. Nasrabadi, and J. Chanussot, “Hyperspectral remote sensing data analysis and future challenges,” IEEE Geoscience and Remote Sensing Magazine, vol. 1, no. 2, pp. 6–36, Aug. 2013.
[10] C. Li, B. Zhang, D. Hong, X. Jia, A. Plaza, and J. Chanussot, “Learning disentangled priors for hyperspectral anomaly detection: A coupling model-driven and data-driven paradigm,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1–14, 2024.
[11] C.-H. Lin and S.-S. Young, “Signal subspace identification for incomplete hyperspectral image with applications to various inverse problems,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–16, Mar. 2024.
[12] C.-H. Lin, J. M. Bioucas Dias, T.-H. Lin, Y.-C. Lin, and C.-H. Kao, “A new hyperspectral compressed sensing method for efficient satellite communications,” in Proc. 2020 IEEE 11th Sensor Array and Multichannel Signal Processing Workshop (SAM), Hangzhou, China, Jun. 8-11, 2020, pp. 1–5.
[13] J. Hunt, T. Driscoll, A. Mrozack, G. Lipworth, M. Reynolds, D. Brady, and D. R. Smith, “Metamaterial apertures for computational imaging,” Science, vol. 339, no. 6117, pp. 310–313, Jan. 2013.
[14] K. H. Jin, D. Lee, and J. C. Ye, “A general framework for compressed sensing and parallel MRI using annihilating filter based low-rank hankel matrix,” IEEE Transactions on Computational Imaging, vol. 2, no. 4, pp. 480–495, Dec. 2016.
[15] S. Ravishankar and Y. Bresler, “Data-driven learning of a union of sparsifying transforms model for blind compressed sensing,” IEEE Transactions on Computational Imaging, vol. 2, no. 3, pp. 294–309, Sep. 2016.
[16] F. Rousset, N. Ducros, A. Farina, G. Valentini, C. D’Andrea, and F. Peyrin, “Adaptive basis scan by wavelet prediction for single-pixel imaging,” IEEE Transactions on Computational Imaging, vol. 3, no. 1, pp. 36–46, Mar. 2017.
[17] E. Salazar and G. R. Arce, “Coded aperture optimization in spatial spectral compressive spectral imagers,” IEEE Transactions on Computational Imaging, vol. 6, pp. 764–777, Mar. 2020.
[18] G. Marín and J. M. Bioucas-Dias, “Hyperspectral blind reconstruction from random spectral projections,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9, no. 6, pp. 2390–2399, Jun. 2016.
[19] T. Hao, W. Zheng, W. He, and K. Lin, “Air-ground impedance matching by depositing metasurfaces for enhanced GPR detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 6, pp. 4061–4075, Jun. 2020.
[20] J. Zhao, “A survey of intelligent reflecting surfaces (IRSs): Towards 6G wireless communication networks,” arXiv preprint arXiv:1907.04789, 2019.
[21] M. Khorasaninejad, W.-T. Chen, J. Oh, and F. Capasso, “Super-dispersive off-axis meta-lenses for compact high resolution spectroscopy,” Nano letters, vol. 16, no. 6, pp. 3732–3737, Apr. 2016.
[22] B. H. Chen, P. C. Wu, V.-C. Su et al., “GaN metalens for pixel-level full-color routing at visible light,” Nano letters, vol. 17, no. 10, pp. 6345–6352, Sep. 2017.
[23] A. Y. Zhu, W. T. Chen, J. Sisler, K. M. Yousef, E. Lee, Y.-W. Huang, C.-W. Qiu, and F. Capasso, “Compact aberration-corrected spectrometers in the visible using dispersion-tailored metasurfaces,” Advanced Optical Materials, vol. 7, no. 14, p. 1801144, Jul. 2019.
[24] G. Martín, J. M. Bioucas-Dias, and A. Plaza, “HYCA: A new technique for hyperspectral compressive sensing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 5, pp. 2819–2831, May 2015.
[25] L. Zhang, W. Wei, Y. Zhang, H. Yan, F. Li, and C. Tian, “Locally similar sparsity-based hyperspectral compressive sensing using unmixing,” IEEE Transactions on Computational Imaging, vol. 2, no. 2, pp. 86–100, Jun. 2016.
[26] M. Elad and M. Aharon, “Image denoising via sparse and redundant representations over learned dictionaries,” IEEE Transactions on Image Processing, vol. 15, no. 12, pp. 3736–3745, Dec. 2006.
[27] A. Rajwade, A. Rangarajan, and A. Banerjee, “Image denoising using the higher order singular value decomposition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 4, pp. 849–862, Apr. 2013.
[28] C. Paris, J. M. Bioucas-Dias, and L. Bruzzone, “A novel sharpening approach for superresolving multiresolution optical images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 3, pp. 1545–1560, Mar. 2019.
[29] A. Buades, B. Coll, and J.-M. Morel, “A non-local algorithm for image denoising,” in Proc. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, Jun. 20-25, 2005.
[30] C.-H. Lin and J. M. Bioucas-Dias, “An explicit and scene-adapted definition of convex self-similarity prior with application to unsupervised Sentinel-2 super-resolution,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 5, pp. 3352–3365, May. 2020.
[31] O. Abd El-Kawy, J. Rød, H. Ismail, and A. Suliman, “Land use and land cover change detection in the western Nile delta of Egypt using remote sensing data,” Applied Geography, vol. 31, no. 2, pp. 483–494, Apr. 2011.
[32] F. Bovolo and L. Bruzzone, “A split-based approach to unsupervised change detection in large-size multitemporal images: Application to tsunami-damage assessment,” IEEE Transactions on Geoscience and Remote Sensing, vol. 45, no. 6, pp. 1658–1670, Jun. 2007.
[33] L. Yang, G. Xian, J. M. Klaver, and B. Deal, “Urban land-cover change detection through sub-pixel imperviousness mapping using remotely sensed data,” Photogrammetric Engineering & Remote Sensing, vol. 69, no. 9, pp. 1003–1010, Sep. 2003.
[34] V. Amici, M. Marcantonio, N. La Porta, and D. Rocchini, “A multi-temporal approach in maxent modelling: A new frontier for land use/land cover change detection,” Ecological Informatics, vol. 40, pp. 40–49, Jul. 2017.
[35] N. Falco, M. D. Mura, F. Bovolo, J. A. Benediktsson, and L. Bruzzone, “Change detection in VHR images based on morphological attribute profiles,” IEEE Geoscience and Remote Sensing Letters, vol. 10, no. 3, pp. 636–640, May 2013.
[36] E. J. M. Rignot and J. J. van Zyl, “Change detection techniques for ERS-1 SAR data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 31, no. 4, pp. 896–906, Jul. 1993.
[37] W.-C. Zheng, C.-H. Lin, K.-H. Tseng, C.-Y. Huang, T.-H. Lin, C.-H. Wang, and C.-Y. Chi, “Unsupervised change detection in multitemporal multispectral satellite images: A convex relaxation approach,” in Proc. IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan, Jul. 28-Aug. 02, 2019, pp. 1546–1549.
[38] F. Bovolo and L. Bruzzone, “A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain,” IEEE Transactions on Geoscience and Remote Sensing, vol. 45, no. 1, pp. 218–236, Jan. 2007.
[39] S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends in Machine Learning, vol. 3, no. 1, pp. 1–122, Jul. 2011.
[40] M.-D. Iordache, J. M. Bioucas-Dias, and A. Plaza, “Total variation spatial regularization for sparse hyperspectral unmixing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 50, no. 11, pp. 4484–4502, Nov. 2012.
[41] J. Jiang, H. Sun, X. Liu, and J. Ma, “Learning spatial-spectral prior for super-resolution of hyperspectral imagery,” IEEE Transactions on Computational Imaging, vol. 6, pp. 1082–1096, May. 2020.
[42] L. Khelifi and M. Mignotte, “Deep learning for change detection in remote sensing images: Comprehensive review and meta-analysis,” IEEE Access, vol. 8, pp. 126 385–126 400, Jul. 2020.
[43] Q. Wang, Z. Yuan, Q. Du, and X. Li, “GETNET: A general end-to-end 2-D CNN framework for hyperspectral image change detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 1, pp. 3–13, Jan. 2019.
[44] T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in Proc. International Conference on Learning Representations (ICLR), Toulon, France, Apr. 24-26, 2017.
[45] D. Hong, L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot, “Graph convolutional networks for hyperspectral image classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 7, pp. 5966–5978, Jul. 2021.
[46] Y. Dong, Q. Liu, B. Du, and L. Zhang, “Weighted feature fusion of convolutional neural network and graph attention network for hyperspectral image classification,” IEEE Transactions on Image Processing, vol. 31, pp. 1559–1572, Jan. 2022.
[47] X. Wang, K. Zhao, X. Zhao, and S. Li, “CSDBF: Dual-branch framework based on temporal–spatial joint graph attention with complement strategy for hyperspectral image change detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–18, Oct. 2022.
[48] P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, “Graph attention networks,” in Proc. International Conference on Learning Representations (ICLR), Vancouver, BC, Canada, Apr. 30-May 3, 2018.
[49] C.-H. Lin, Y.-C. Lin, and P.-W. Tang, “ADMM-ADAM: A new inverse imaging framework blending the advantages of convex optimization and deep learning,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–16, 2022.
[50] C.-H. Lin, T.-H. Lin, T.-H. Lin, and T.-H. Lin, “Fast reconstruction of hyperspectral image from its rgb counterpart using ADMM-Adam theory,” in Proc. Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Rome, Italy, Sep. 13-16, 2022, pp. 1–5.
[51] T.-H. Lin and C.-H. Lin, “Single hyperspectral image super-resolution using ADMM-Adam theory,” in Proc. IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Kuala Lumpur, Malaysia, Jul. 17-22, 2022, pp. 1756–1759.
[52] P.-W. Tang and C.-H. Lin, “Hyperspectral dehazing using ADMM-Adam theory,” in Proc. Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Rome, Italy, Sep. 13-16, 2022, pp. 1–5.
[53] C.-H. Lin, M.-C. Chu, and H.-J. Chu, “High-dimensional multiresolution satellite image classification: An approach blending the advantages of convex optimization and deep learning,” in Proc. Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Rome, Italy, Sep. 13-16, 2022, pp. 1–5.
[54] F. Kruse, A. Lefkoff, J. Boardman, K. Heidebrecht, A. Shapiro, P. Barloon, and A. Goetz, “The spectral image processing system (SIPS)-interactive visualization and analysis of imaging spectrometer data,” Remote Sensing of Environment, vol. 44, no. 2, pp. 145–163, May 1993.
[55] A. Sagingalieva, M. Kordzanganeh, N. Kenbayev, D. Kosichkina, T. Tomashuk, and A. Melnikov, “Hybrid quantum neural network for drug response prediction,” Cancers, vol. 15, no. 10, May 2023.
[56] Z. Qu, W. Shi, B. Liu, D. Gupta, and P. Tiwari, “IoMT-based smart healthcare detection system driven by quantum blockchain and quantum neural network,” IEEE Journal of Biomedical and Health Informatics, vol. 28, no. 6, pp. 3317–3328, Jun. 2024.
[57] F. Fan, Y. Shi, T. Guggemos, and X. X. Zhu, “Hybrid quantum-classical convolutional neural network model for image classification,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1–15, 2023.
[58] I. Marvian, “Restrictions on realizable unitary operations imposed by symmetry and locality,” Nature Physics, vol. 18, no. 3, pp. 283–289, Jan. 2022.
[59] C.-H. Lin and Y.-Y. Chen, “HyperQUEEN: Hyperspectral quantum deep network for image restoration,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–20, May 2023.
[60] S.-M. Hsu, T.-H. Lin, and C.-H. Lin, “HyperQUEEN-MF: Hyperspectral quantum deep network with multi-scale feature fusion for quantum image super-resolution,” in Proc. 2024 IEEE 13rd Sensor Array and Multichannel Signal Processing Workshop (SAM), Corvallis, OR, USA, Jul. 08-11, 2024, pp. 1–5.
[61] C.-H. Lin and J.-T. Lin, “PRIME: Blind multispectral unmixing using virtual quantum prism and convex geometry,” arXiv preprint arXiv:2407.15358, 2024.
[62] K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, Jun. 26 - Jul. 1, 2016, pp. 770–778.
[63] C.-H. Lin and T.-H. Lin, “All-addition hyperspectral compressed sensing for metasurface-driven miniaturized satellite,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–15, Mar. 2022.
[64] T.-H. Lin and C.-H. Lin, “Hyperspectral change detection using semi-supervised graph neural network and convex deep learning,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–18, Jun. 2023.
[65] C.-H. Lin, T.-H. Lin, and J. Chanussot, “Quantum information-empowered graph neural network for hyperspectral change detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–15, Nov. 2024.
[66] C.-H. Lin, C.-Y. Chi, Y.-H. Wang, and T.-H. Chan, “A fast hyperplane-based minimum-volume enclosing simplex algorithm for blind hyperspectral unmixing,” IEEE Transactions on Signal Processing, vol. 64, no. 8, pp. 1946–1961, Apr. 2016.
[67] Y. Wang, L. Lin, Q. Zhao, T. Yue, D. Meng, and Y. Leung, “Compressive sensing of hyperspectral images via joint tensor Tucker decomposition and weighted total variation regularization,” IEEE Geoscience and Remote Sensing Letter, vol. 14, no. 12, pp. 2457–2461, Dec. 2017.
[68] G. Kutyniok, “Theory and applications of compressed sensing,” GAMM Mitteilungen, vol. 36, no. 1, pp. 79–101, Aug, 2013.
[69] J. M. Nascimento and J. M. Bioucas-Dias, “Vertex component analysis: A fast algorithm to unmix hyperspectral data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 43, no. 4, pp. 898–910, Apr. 2005.
[70] C. B. Barber, D. P. Dobkin, and H. Huhdanpaa, “The quickhull algorithm for convex hulls,” ACM Transactions on Mathematical Software, vol. 22, no. 4, pp. 469–483, Dec. 1996.
[71] J. M. Bioucas-Dias and J. M. P. Nascimento, “Hyperspectral subspace identification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 46, no. 8, pp. 2435–2445, Aug. 2008.
[72] C.-H. Lin, F. Ma, C.-Y. Chi, and C.-H. Hsieh, “A convex optimization-based coupled nonnegative matrix factorization algorithm for hyperspectral and multispectral data fusion,” IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 3, pp. 1652–1667, Mar. 2018.
[73] C.-H. Lin, C.-Y. Chi, L. Chen, D. J. Miller, and Y. Wang, “Detection of sources in non-negative blind source separation by minimum description length criterion,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 9, pp. 4022–4037, Sep. 2018.
[74] S. Arora, R. Ge, Y. Halpern, D. Mimno, A. Moitra, D. Sontag, Y. Wu, and M. Zhu, “A practical algorithm for topic modeling with provable guarantees,” in Proc. International Conference on Machine Learning, Atlanta, GA, Jun. 2013, pp. 280–288.
[75] L. Chen, P. L. Choyke, T.-H. Chan, C.-Y. Chi, G. Wang, and Y. Wang, “Tissue-specific compartmental analysis for dynamic contrast-enhanced MR imaging of complex tumors,” IEEE Transactions on Medical Imaging, vol. 30, no. 12, pp. 2044–2058, Dec. 2011.
[76] “AVIRIS free standard data products.” [Online]. Available: http://aviris.jpl.nasa.gov/html/aviris.freedata.html
[77] R. W. Basedow, D. C. Carmer, and M. E. Anderson, “HYDICE system: Implementation and performance,” in Imaging Spectrometry, vol. 2480. International Society for Optics and Photonics, Jun. 1995, pp. 258–267.
[78] N. Yokoya, C. Grohnfeldt, and J. Chanussot, “Hyperspectral and multispectral data fusion: A comparative review of the recent literature,” IEEE Geoscience and Remote Sensing Magazine, vol. 5, no. 2, pp. 29–56, Jun. 2017.
[79] N. Yokoya and A. Iwasaki, “Airborne hyperspectral data over Chikusei,” Space Application Laboratory, University of Tokyo, Japan, Tech. Rep. SAL-2016-05-27, May. 2016.
[80] C. Stolojescu, I. Railean, S. Moga, and A. Isar, “Comparison of wavelet families with application to wimax traffic forecasting,” in Proc. 2010 12th International Conference on Optimization of Electrical and Electronic Equipment, May. 2010, pp. 932–937.
[81] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, “Color image denoising via sparse 3D collaborative filtering with grouping constraint in luminance-chrominance space,” in Proc. IEEE International Conference on Image Processing, San Antonio, TX, Sep. 2007, pp. 313–316.
[82] F. Bovolo, S. Marchesi, and L. Bruzzone, “A framework for automatic and unsupervised detection of multiple changes in multitemporal images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 50, no. 6, pp. 2196–2212, Jun. 2012.
[83] C. Wu, B. Du, and L. Zhang, “Slow feature analysis for change detection in multispectral imagery,” IEEE Transactions on Geoscience and Remote Sensing, vol. 52, no. 5, pp. 2858–2874, May 2014.
[84] A. P. Tewkesbury, A. J. Comber, N. J. Tate, A. Lamb, and P. F. Fisher, “A critical synthesis of remotely sensed optical image change detection techniques,” Remote Sensing of Environment, vol. 160, pp. 1–14, Feb. 2015.
[85] A. A. Nielsen, “The regularized iteratively reweighted MAD method for change detection in multi- and hyperspectral data,” IEEE Transactions on Image Processing, vol. 16, no. 2, pp. 463–478, Feb. 2007.
[86] A. A. Nielsen, K. Conradsen, and J. J. Simpson, “Multivariate alteration detection (MAD) and MAF postprocessing in multispectral, bitemporal image data: New approaches to change detection studies,” Remote Sensing of Environment, vol. 64, no. 1, pp. 1–19, Apr. 1998.
[87] T. Celik, “Unsupervised change detection in satellite images using principal component analysis and k-means clustering,” IEEE Geoscience and Remote Sensing Letters, vol. 6, no. 4, pp. 772–776, Oct. 2009.
[88] R. C. Gonzalez, Digital image processing. Pearson education india, 2009.
[89] H. Nemmour and Y. Chibani, “Multiple support vector machines for land cover change detection: An application for mapping urban extensions,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 61, no. 2, pp. 125–133, Oct. 2006.
[90] A. Ertürk, M.-D. Iordache, and A. Plaza, “Sparse unmixing with dictionary pruning for hyperspectral change detection,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 10, no. 1, pp. 321–330, Jan. 2017.
[91] Z. Hou, W. Li, R. Tao, and Q. Du, “Three-order Tucker decomposition and reconstruction detector for unsupervised hyperspectral change detection,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 6194–6205, Jun. 2021.
[92] H. Dong, W. Ma, Y. Wu, M. Gong, and L. Jiao, “Local descriptor learning for change detection in synthetic aperture radar images via convolutional neural networks,” IEEE Access, vol. 7, pp. 15 389–15 403, Dec. 2019.
[93] W. Shi, M. Zhang, R. Zhang, S. Chen, and Z. Zhan, “Change detection based on artificial intelligence: State-of-the-art and challenges,” Remote Sensing, vol. 12, no. 10, May 2020.
[94] Y. Lin, S. Li, L. Fang, and P. Ghamisi, “Multispectral change detection with bilinear convolutional neural networks,” IEEE Geoscience and Remote Sensing Letters, vol. 17, no. 10, pp. 1757–1761, Oct. 2020.
[95] T. Bai, L. Wang, D. Yin, K. Sun, Y. Chen, W. Li, and D. Li, “Deep learning for change detection in remote sensing: A review,” Geo-spatial Information Science, vol. 0, no. 0, pp. 1–27, Jul. 2022.
[96] A. Song, J. Choi, Y. Han, and Y. Kim, “Change detection in hyperspectral images using recurrent 3D fully convolutional networks,” Remote Sensing, vol. 10, no. 11, Nov. 2018.
[97] X. SHI, Z. Chen, H. Wang, D.-Y. Yeung, W.-k. Wong, and W.-c. WOO, “Convolutional LSTM network: A machine learning approach for precipitation nowcasting,” in Advances in Neural Information Processing Systems (NIPS), C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett, Eds., vol. 28. Montreal, Quebec, Canada: Curran Associates, Inc., Dec. 7-12, 2015.
[98] L. Mou, L. Bruzzone, and X. X. Zhu, “Learning spectral-spatial-temporal features via a recurrent convolutional neural network for change detection in multispectral imagery,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 2, pp. 924–935, Feb. 2019.
[99] H. Chen, C. Wu, B. Du, L. Zhang, and L. Wang, “Change detection in multisource VHR images via deep siamese convolutional multiple-layers recurrent neural network,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 4, pp. 2848–2864, Apr. 2020.
[100] J. Qu, S. Hou, W. Dong, Y. Li, and W. Xie, “A multilevel encoder–decoder attention network for change detection in hyperspectral images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–13, Nov. 2022.
[101] C. Wu, B. Du, and L. Zhang, “Fully convolutional change detection framework with generative adversarial network for unsupervised, weakly supervised and regional supervised change detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1–15, Jan. 2023.
[102] P.-W. Tang, C.-H. Lin, and Y. Liu, “Transformer-driven inverse problem transform for fast blind hyperspectral image dehazing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–14, Jan. 2024.
[103] S.-S. Young, C.-H. Lin, and J.-T. Lin, “CiDAR-Former: Cosine-weighting deep abundance reconstruction transformer for fast unsupervised hyperspectral anomaly detection,” in Proc. 2023 13th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), Athens, Greece, Oct. 31- Nov. 02, 2023, pp. 1–5.
[104] M. Gong, F. Jiang, A. K. Qin, T. Liu, T. Zhan, D. Lu, H. Zheng, and M. Zhang, “A spectral and spatial attention network for change detection in hyperspectral images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–14, 2022.
[105] R. Song, W. Ni, W. Cheng, and X. Wang, “CSANet: Cross-temporal interaction symmetric attention network for hyperspectral image change detection,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, May 2022.
[106] Y. Wang, D. Hong, J. Sha, L. Gao, L. Liu, Y. Zhang, and X. Rong, “Spectral–spatial–temporal transformers for hyperspectral image change detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–14, Aug. 2022.
[107] F. Luo, T. Zhou, J. Liu, T. Guo, X. Gong, and J. Ren, “Multiscale diff-changed feature fusion network for hyperspectral image change detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–13, Jan. 2023.
[108] H. Yu, H. Yang, L. Gao, J. Hu, A. Plaza, and B. Zhang, “Hyperspectral image change detection based on gated spectral–spatial–temporal attention network with spectral similarity filtering,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–13, Mar. 2024.
[109] C. Yu, S. Zhou, M. Song, B. Gong, E. Zhao, and C.-I. Chang, “Unsupervised hyperspectral band selection via hybrid graph convolutional network,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–15, Jun. 2022.
[110] T.-H. Lin, C.-H. Lin, and S.-S. Young, “GNN-based small-data learning with area-control mechanism for hyperspectral satellite change detection,” in Proc. 2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Taipei, Taiwan, Oct. 31- Nov. 03, 2023, pp. 726–732.
[111] H. Chen, N. Yokoya, C. Wu, and B. Du, “Unsupervised multimodal change detection based on structural relationship graph representation learning,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–18, Dec. 2022.
[112] J. Qu, Y. Xu, W. Dong, Y. Li, and Q. Du, “Dual-branch difference amplification graph convolutional network for hyperspectral image change detection,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–12, Jan. 2022.
[113] Y. Zhang, R. Miao, Y. Dong, and B. Du, “Multiorder graph convolutional network with channel attention for hyperspectral change detection,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 17, pp. 1523–1534, Jan. 2024.
[114] W. Dong, Y. Yang, J. Qu, S. Xiao, and Y. Li, “Local information-enhanced graph-transformer for hyperspectral image change detection with limited training samples,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–14, Apr. 2023.
[115] X. Fu, S. Jia, L. Zhuang, M. Xu, J. Zhou, and Q. Li, “Hyperspectral anomaly detection via deep plug and-play denoising cnn regularization,” IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 11, pp. 9553–9568, Nov. 2021.
[116] R. Dian, S. Li, and X. Kang, “Regularizing hyperspectral and multispectral image fusion by cnn denoiser,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 3, pp. 1124–1135, Mar. 2021.
[117] B. Lin, X. Tao, and J. Lu, “Hyperspectral image denoising via matrix factorization and deep prior regularization,” IEEE Transactions on Image Processing, vol. 29, pp. 565–578, Jul. 2020.
[118] Y.-Y. Liu, X.-L. Zhao, Y.-B. Zheng, T.-H. Ma, and H. Zhang, “Hyperspectral image restoration by tensor fibered rank constrained optimization and plug-and-play regularization,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–17, Jan. 2022.
[119] T. Goldstein and S. Osher, “The split Bregman method for L1-regularized problems,” SIAM Journal on Imaging Sciences, vol. 2, no. 2, pp. 323–343, Jan. 2009.
[120] C. A. Micchelli, L. Shen, and Y. Xu, “Proximity algorithms for image models: Denoising,” Inverse Problems, vol. 27, no. 4, p. 045009, Mar. 2011.
[121] B. Palsson, M. O. Ulfarsson, and J. R. Sveinsson, “Convolutional autoencoder for spectral–spatial hyperspectral unmixing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 1, pp. 535–549, Jan. 2021.
[122] R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk, “SLIC superpixels compared to state-of-the-art superpixel methods,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 11, pp. 2274–2282, Nov. 2012.
[123] P. Xanthopoulos, P. M. Pardalos, and T. B. Trafalis, “Linear discriminant analysis,” in Robust Data Mining. New York, NY: Springer New York, 2013, pp. 27–33.
[124] B. Xu, N. Wang, T. Chen, and M. Li, “Empirical evaluation of rectified activations in convolutional network,” arXiv preprint arXiv:1505.00853, Nov. 2015.
[125] Q. Guo, J. Zhang, C. Zhong, and Y. Zhang, “Change detection for hyperspectral images via convolutional sparse analysis and temporal spectral unmixing,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 4417–4426, Apr. 2021.
[126] S. Liu, Q. Du, X. Tong, A. Samat, H. Pan, and X. Ma, “Band selection-based dimensionality reduction for change detection in multi-temporal hyperspectral images,” Remote Sensing, vol. 9, no. 10, Sep. 2017.
[127] S. Liu, Q. Du, X. Tong, A. Samat, and L. Bruzzone, “Unsupervised change detection in multispectral remote sensing images via spectral-spatial band expansion,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 12, no. 9, pp. 3578–3587, Sep. 2019.
[128] D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in Proc. International Conference on Learning Representations (ICLR), Y. Bengio and Y. LeCun, Eds., San Diego, CA, USA, May 7-9, 2015.
[129] L. Zhuang, C.-H. Lin, M. A. T. Figueiredo, and J. M. Bioucas-Dias, “Regularization parameter selection in minimum volume hyperspectral unmixing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 12, pp. 9858–9877, Dec. 2019.
[130] M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information. Cambridge University Press, Cambridge, 2010.
[131] M. Weigold, J. Barzen, F. Leymann, and M. Salm, “Encoding patterns for quantum algorithms,” IET Quantum Communication, vol. 2, no. 4, pp. 141–152, Dec. 2021.
[132] A. Senokosov, A. Sedykh, A. Sagingalieva, B. Kyriacou, and A. Melnikov, “Quantum machine learning for image classification,” Machine Learning: Science and Technology, vol. 5, no. 1, p. 015040, Mar. 2024.
[133] M. V. Afonso, J. M. Bioucas-Dias, and M. A. Figueiredo, “An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems,” IEEE Transactions on Image Processing, vol. 20, no. 3, pp. 681–695, Mar. 2011.
[134] J. Eckstein and D. P. Bertsekas, “On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators,” Mathematical Programming, vol. 55, no. 1-3, pp. 293–318, Apr. 1992.
[135] T. M. Apostol, Mathematical Analysis, 2nd ed. Addison Wesley Publishing Company, 1974.