Sleep Classification With Artificial Synthetic Imaging Data Using Convolutional Neural Networks

Objective: We propose a new analytic framework, “Artificial Synthetic Imaging Data (ASID) Workflow, ” for sleep classification from a wearable device comprising: 1) the creation of ASID from data collected by a non-invasive wearable device that permits real-time multi-modal physiological monitoring on heart rate (HR), 3-axis accelerometer, electrodermal activity, and skin temperature, denoted as “Temporal E4 Data” (TED) and 2) the use of an image classification supervised learning algorithm, convolutional neural network (CNN), to classify periods of sleep. Methods: We investigate ASID Workflow under 6 settings (3 data resolutions × 2 HR scenarios). Competing machine/deep learning classification algorithms, including logistic regression, support vector machine, random forest, k-nearest neighbors, and Long Short-Term Memory, are applied to TED as comparisons, termed “Competing Workflow. ” Results: The ASID Workflow achieves excellent performance with mean weighted accuracy across settings of 94. 7%, and is superior to the Competing Workflow with high and low resolution data regardless of the inclusion of HR modality. This superiority is maximized for low resolution data without HR. Additionally, CNN has a relatively low subject-wise test computational cost compared with competing algorithms. Conclusion: We demonstrate the utility of creating ASID from multi-modal physiological data and applying a preexisting image classification algorithm to achieve better classification accuracy. We shed light on the influence of data resolution and HR modality on the Workflow's performance. Significance: Applying CNN to ASID allows us to capture both temporal and spatial dependency among physiological variables and modalities by using 2D images' topological structure that competing algorithms fail to utilize.

Authors

• Lan Shi
• Marianthie Wank
• Yan Chen
• Yibo Wang National Key Laboratory for Novel Software Technology, Nanjing University School of Artificial Intelligence, Nanjing University
• Yachuan Liu
• Emily C. Hector
• Peter X.K. Song

Keywords

• Heart rate
• Biomedical monitoring
• Signal resolution
• Monitoring
• Wearable computers
• Classification algorithms
• Support vector machines
• Convolutional Neural Network
• Artificial Data
• Sleep Classification
• Learning Algorithms
• Computational Cost
• Low Resolution
• Classification Accuracy
• Support Vector Machine
• Random Forest
• Image Classification
• Long Short-term Memory
• Resolution Of Data
• Wearable Devices
• Physiological Data
• Physiological Variables
• Low Computational Cost
• Skin Temperature
• Temporal Dependencies
• Sleep Period
• Stationary Periods
• Linear Kernel
• Convolutional Neural Network Classifier
• Classification Performance
• Transition Period
• Periods Of Wakefulness
• Validation Set
• Physiological Signals
• Heart Rate Sensor
• Test Metrics
• Artificial synthetic imaging data
• wearable
• Humans
• Neural Networks, Computer
• Algorithms
• Machine Learning
• Diagnostic Imaging