Author name cluster

Minghui Hu

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

5 papers

1 author row

NeurIPS Conference 2023 Conference Paper

Cocktail: Mixing Multi-Modality Control for Text-Conditional Image Generation

Minghui Hu
Jianbin Zheng
Daqing Liu
Chuanxia Zheng
Chaoyue Wang
Dacheng Tao
Tat-Jen Cham

Text-conditional diffusion models are able to generate high-fidelity images with diverse contents. However, linguistic representations frequently exhibit ambiguous descriptions of the envisioned objective imagery, requiring the incorporation of additional control signals to bolster the efficacy of text-guided diffusion models. In this work, we propose Cocktail, a pipeline to mix various modalities into one embedding, amalgamated with a generalized ControlNet (gControlNet), a controllable normalisation (ControlNorm), and a spatial guidance sampling method, to actualize multi-modal and spatially-refined control for text-conditional diffusion models. Specifically, we introduce a hyper-network gControlNet, dedicated to the alignment and infusion of the control signals from disparate modalities into the pre-trained diffusion model. gControlNet is capable of accepting flexible modality signals, encompassing the simultaneous reception of any combination of modality signals, or the supplementary fusion of multiple modality signals. The control signals are then fused and injected into the backbone model according to our proposed ControlNorm. Furthermore, our advanced spatial guidance sampling methodology proficiently incorporates the control signal into the designated region, thereby circumventing the manifestation of undesired objects within the generated image. We demonstrate the results of our method in controlling various modalities, proving high-quality synthesis and fidelity to multiple external signals.

PDF Details

EAAI Journal 2023 Journal Article

Online learning using deep random vector functional link network

Sreenivasan Shiva
Minghui Hu
Ponnuthurai Nagaratnam Suganthan

Deep neural networks have shown their promise in recent years with their state-of-the-art results. Yet, backpropagation-based methods may suffer from time-consuming training process and catastrophic forgetting when performing online learning. In this work we attempt to curtail them by employing the ensemble deep Random Vector Functional Link (edRVFL). As opposed to backpropagation-based neural networks that adjust weights iteratively, RVFL uses a closed-form solution method without iterative parameter learning. In addition, our approach allows the model to grow incrementally as new data is made available so that it can more resemble real-life learning scenarios. Our proposed online learning models were able to perform better on 72% of the datasets in the classification scenario and 80% of the datasets in the regression scenario, when compared to other available randomization-based online learning models in the literature. This is further supported by statistical comparisons which also show the stability of our network.

Details DOI

EAAI Journal 2023 Journal Article

Significant wave height forecasting using hybrid ensemble deep randomized networks with neurons pruning

Ruobin Gao
Ruilin Li
Minghui Hu
Ponnuthurai Nagaratnam Suganthan
Kum Fai Yuen

The reliable control of wave energy devices highly relies on the forecasts of wave heights. However, the dynamic characteristics and significant fluctuation of waves’ historical data pose challenges to precise predictions. Neural networks offer a promising solution to forecast the wave heights by extracting meaningful features from historical observations. This paper proposes a novel hybrid random vector functional link network with the ensemble and deep learning benefits. Hierarchical stacks of hidden layers are constructed to enforce the deep representations of the time series. Individual output layers follow all enhancement layers to adopt ensemble learning. A neuron pruning strategy is proposed to remove the noisy information from the random features and boost the network’s performance. Besides, the proposed network is further utilized to forecast the additive and multiplicative residuals from the ARIMA method. Finally, the ensemble of additive-ARIMA-edRVFL, multiplicative-ARIMA-edRVFL, and edRVFL achieves the best average rankings around two for three forecasting horizons. The proposed ensemble achieves an average ranking of 1. 33 on four-hours ahead of forecasting in terms of root mean square error and mean absolute scaled error. Extensive experiments are conducted on twelve time series of the significant wave height. The comparative results demonstrate the superiority of the proposed model over other state-of-the-art methods. The source codes are available on https: //github. com/P-N-Suganthan/CODES.

Details DOI

EAAI Journal 2022 Journal Article

Ensemble deep learning: A review

M.A. Ganaie
Minghui Hu
A.K. Malik
M. Tanveer
P.N. Suganthan

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning models combine the advantages of both the deep learning models as well as the ensemble learning such that the final model has better generalization performance. This paper reviews the state-of-art deep ensemble models and hence serves as an extensive summary for the researchers. The ensemble models are broadly categorized into bagging, boosting, stacking, negative correlation based deep ensemble models, explicit/implicit ensembles, homogeneous/heterogeneous ensemble, decision fusion strategies based deep ensemble models. Applications of deep ensemble models in different domains are also briefly discussed. Finally, we conclude this paper with some potential future research directions.

Details DOI

YNIMG Journal 2021 Journal Article

Comparing methods of detecting and segmenting unruptured intracranial aneurysms on TOF-MRAS: The ADAM challenge

Kimberley M. Timmins
Irene C. van der Schaaf
Edwin Bennink
Ynte M. Ruigrok
Xingle An
Michael Baumgartner
Pascal Bourdon
Riccardo De Feo

Accurate detection and quantification of unruptured intracranial aneurysms (UIAs) is important for rupture risk assessment and to allow an informed treatment decision to be made. Currently, 2D manual measures used to assess UIAs on Time-of-Flight magnetic resonance angiographies (TOF-MRAs) lack 3D information and there is substantial inter-observer variability for both aneurysm detection and assessment of aneurysm size and growth. 3D measures could be helpful to improve aneurysm detection and quantification but are time-consuming and would therefore benefit from a reliable automatic UIA detection and segmentation method. The Aneurysm Detection and segMentation (ADAM) challenge was organised in which methods for automatic UIA detection and segmentation were developed and submitted to be evaluated on a diverse clinical TOF-MRA dataset. A training set (113 cases with a total of 129 UIAs) was released, each case including a TOF-MRA, a structural MR image (T1, T2 or FLAIR), annotation of any present UIA(s) and the centre voxel of the UIA(s). A test set of 141 cases (with 153 UIAs) was used for evaluation. Two tasks were proposed: (1) detection and (2) segmentation of UIAs on TOF-MRAs. Teams developed and submitted containerised methods to be evaluated on the test set. Task 1 was evaluated using metrics of sensitivity and false positive count. Task 2 was evaluated using dice similarity coefficient, modified hausdorff distance (95th percentile) and volumetric similarity. For each task, a ranking was made based on the average of the metrics. In total, eleven teams participated in task 1 and nine of those teams participated in task 2. Task 1 was won by a method specifically designed for the detection task (i. e. not participating in task 2). Based on segmentation metrics, the top two methods for task 2 performed statistically significantly better than all other methods. The detection performance of the top-ranking methods was comparable to visual inspection for larger aneurysms. Segmentation performance of the top ranking method, after selection of true UIAs, was similar to interobserver performance. The ADAM challenge remains open for future submissions and improved submissions, with a live leaderboard to provide benchmarking for method developments at https: //adam. isi. uu. nl/.

Details DOI