Richard H. Y. SO (蘇孝宇)
Richard H. Y. SO (蘇孝宇)
PhD, University of Southampton, 1995
Associate Dean of Engineering (Research & Graduate Studies)
Professor
Tel 2358 7105
Office Room 5597
Research Interests

Bio-inspired signal processing on image and audio data. Computational ergonomics and functional brain study focusing on human visual and auditory systems. We develop dimension reduction and pattern recognition algorithms to simulate human perception with spin-off IPs in virtual surround systems, smart hearing aids and 360 Virtual Reality systems.

Contact Info
Tel 2358 7105
Office Room 5597
Research Interests

Bio-inspired signal processing on image and audio data. Computational ergonomics and functional brain study focusing on human visual and auditory systems. We develop dimension reduction and pattern recognition algorithms to simulate human perception with spin-off IPs in virtual surround systems, smart hearing aids and 360 Virtual Reality systems.

Profile

Prof. Richard So received his BSc degree (1987) in Electronic Engineering and PhD degree (1995) in Engineering and Applied Sciences from the Institute of Sound and Vibration Research (ISVR), University of Southampton, England.

Prof. So joined the Department of Industrial Engineering & Decision Analytics at HKUST in September 1995 as an Assistant Professor and was promoted to Associate Professor and later Professor. He also holds the concurrent appointment as a Professor in Biomedical Engineering. Prof. So's research focuses on visual and auditory perception. His recent projects include functional brain studies using near-infrared spectroscopic; motion sickness in virtual environments; binaural hearing; and decision making process with visual and auditory information. Besides fundamental research, Prof. So has also been actively involving in various consulting and industry-funded projects. He is a Member of the Founding Council and the first elected Treasurer of the Hong Kong Ergonomics Society, a Professional Registered Member of the Ergonomics Society (UK), the Human Factors and Ergonomics Soceity, the Institute of Electrical & Electronics Engineers, the American Institute of Aeronautics and Astronautics (Senior Member), and Insititute of Industrial Engineers. Prof. So won the first Best Ergonomics Practitioner Award from the Hong Kong Ergonomics Society and received the honor title of the Fellow of the Hong Kong Ergonomics Society in 2009 and the Chartered Fellow of the Institute of Ergonomics and Human Factors (UK) in 2011. He is currently serving as the Co-Editor-in-Chief of Displays, Editor of Ergonomics, and Scientific Editor of Applied Ergonomics. In 2014, he has been elected as the Fellow of the International Ergonomics Association (IEA). This is a very presitge Fellowship and Prof. So is the first receipient from Hong Kong and there was less than 100 senior academics world-wide holding the same prestige title at the time of the election. Prof. So serves on the drafting committee of ISO International Workshop Agreement IWA3 on Image Safety and Commission Internationale de L'eclairage (CIE) Technical Committee TC1-67 and expert panel for ISO working group on dynamic image safety. In 2007, he found and chaired the First International Symposium on Visually Induced Motion Sickness, Fatigue, and Photosensitive Epileptic Seizures (VIMS2007) and are on the Program Committees of VIMS2009, 2011, 2013 held (or to be held) in the Netherlands, US, and UK, respectively. In the midst of research, Prof. So has also enjoyed teaching and was the recipient of the Teaching Excellence Appreciation Award. 

Honors and Awards
  • Keynote speech at the 5th International Symposium on Visual Image Safety (VIMS 2015), the National Institute of Advanced Industrial Science and Technology, Tokyo, Japan, 15-17 Sept. 2015
  • Fellow of IEA since 2014. Prof. SO has been elected to receive the presitge IEA Fellowship Award from the International Ergonomics Association (the first receipient from Hong Kong). There were less than 100 senior academics world-wide holding this prestige title at the time of the award. 
  • Keynote speech at the 5th AUN/SEED-Net Regional Conference on Manufacturing Engineering in conjunction with 1st Human Factors and Ergonomics Society of the Philippines Conference 2012
  • Fellow of the Hong Kong Institute of Engineers (HKIE) since 2014
  • Chartered Fellow of the Royal Chartered Institute of Ergonomics and Human Factors since 2012
  • Best Short Paper Award at IEEE VR2011
  • Fellow of the Institute of Ergonomics and Human Factors since 2011
  • Fellow of the Hong Kong Ergonomics Society since 2009
  • Chair and opening remarks at VIMS2007
  • Best Ergonomics Practitioner Award from the Hong Kong Ergonomics Society (2006)
  • Keynote speech at the Annual Conference of the Vision Society of Japan 2006
  • Teaching Excellent Appreciation Award 
Research
Research Projects
Active Projects
  • RGC General Research Fund, Novel Mechanisms Involved in Motion Sickness, 2021 to Present.  (Co-PI)
  • Nanhai People's Government of Foshan, Embedded System for Audio Processing on Smart IoT Devices: topic#1 Embedded Solution of Smart Audio Processing物聯網智能終端音頻嵌入式集成系統: 子課題#1 智能終端的音頻處理嵌入式方案, 2021 to Present.  (PI)
  • Nanhai People's Government of Foshan, Embedded System for Audio Processing on Smart IoT Devices: topic#2 Embedded Solution for Pedestrian Street Safety on Smart Devices物聯網智能終端音頻嵌入式集成系統: 子課題#2 智能終端的行人道路安全嵌入式方案, 2021 to Present.  (Co-PI)
  • Innovation and Technology Fund, Affordable Smart Fever Screening Systems for Widespread Deployment可廣泛部署的智能遙距體溫篩查系統, 2020 - 2021.  (PI)
  • Innovation and Technology Fund, An artificial intelligence-enabled tool for automated recognition of vertebral fracture and intervertebral disc space narrowing in elderly Chinese population一種可以自動識別老年人椎體骨折及腰椎間盤狹窄的人工智能軟件, 2019 - 2020.  (Co-PI)
  • Central Reserve Fund - School-based Initiatives, Set-up fund for theme-based research, 2018 – Present.  (PI)
  • HTC Corporation, Innovation and Technology Fund, Ningbo Cixing Co., Ltd., Texas Instruments Incorporated, Anticipatory Control of Exoskeletons using Multi-modal Human Machine Interfaces基於多通道人機接口的可預測使用者動向外骨骼系統, 2017 – 2021.  (Co-PI)
  • Shenzhen Science and Technology Innovation Committee, Spatial hearing of multiple sound sources: a bio-inspired computational model基20170168 基于腦科學的多聲源立體聲仿腦計算模型研究, 2017 – 2020.  (PI)
  • Ford Motor Company, Ford-HKUST Conservation and Environmental Research Grants, 2013 – Present.  (PI)
Recently Completed Projects
  • Spatial hearing of multiple sound sources: a bio-inspired computational model. SZ-SZSTI1731. July 2017 to June 2020. Completed.
  • Big data platform for smart transportation applications with heterogeneous data sources: video analysis to predict human flow. ITS/170/15FP, Jan 2016 to Dec 2017. Completed.
  • Frequency Responses of Visually Induced Motion Sickness Provoked by Constant-Amplitude and Constant-Velocity Linear and Circular Visual Oscillations. GRF 16200915. Jan 2016 to Dec 2018. Completed.
  • A randomized controlled tral to compare experiencial mode of learning and traditional mode of learning. CEI Teaching Development Grant. Oct 2015 to Sep 2017. Completed. 
  • Equipment Clusters for a Brain-Perception Lab. REC15EG09. Completed. 
  • Six-sigma optimization to reduce accidents at warehouses. Kerry Logistics. 
  • Six-sigma optimization to improve production efficiency. Kee Wah Barkery. 
  • A hypothetical theory for cortical co-ordinations associated with visually induced motion sickness, vection and eye movements: a verification study using near infrared spectroscopy. GRF 618812. Jan 2013 to June 2016. Completed. 
  • Discrimination of Musical Instrument Tones Resynthesized with Piecewise-Linear Approximated Amplitude Envelopes. GRF 613111. Jan 2012 to Dec 2013. Completed.
  • Neural responses from visual stimuli known to provoke motion sickness: a near infrared spectroscopy study. GRF 619210. Jan 2011 to Oct 2013. Completed.
  • Motion sickness, postural disturbance, and self-motion perception when exposed to low frequency (0.04Hz to 0.8Hz) conflicting physical and visual linear motion in the fore-and-aft axis. GRF 620009. Jan 2010 to Dec 2012. Completed. 
Research Group Members
  • CHEN Shutao, PhD, IEDA
  • HE Yudong, PhD, IEDA
  • QIU Chuchu, PhD, IEDA
  • CHING Phoebe Mae Lim, PhD, CBE
  • WONG Kwan Long, PhD, CBE
  • LIU Yunmeng, MPhil, BBE (SYSH, GZ campus)
Professional Activities
  • Co-Editor-in-Chief of Displays
  • Editor of Ergonomics
  • Scientific Editor of Applied Ergonomics
  • Member of Commission Internationale de L'eclairage (CIE) Technical Committee TC1-67
  • Member of ISO ISO/TC159/SC4/SG Study Group on dynamic image safety
  • Fellow of the Institute of Ergonomics and Human Factors (UK)
  • Founding Treasurer and Fellow of the Hong Kong Ergonomics Society
Selected Publications (Since 2001)
  1. J.W. Chin, K.L. Wong, T.T. Chan, K. Suhartono, R.H.Y. So (2021), An Infrared Thermography Model Enabling Remote Body Temperature Screening up to 10 Meters, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, June 2021, pp. 3870-3876.

  2. Y. Wang, B. Du, Y. Wei, R.H.Y. So (2021), Visually induced roll circular vection: Do effects of stimulation velocity differ for supine and upright participants?Frontiers in Virtual Reality, v. 2, article number 611214, pp. 1-10.

  3. C.H. Cheng, K.L. Wong, J.W. Chin, T.T. Chan, R.H.Y. So (2021), Deep Learning Methods for Remote Heart Rate Measurement: A Review and Future Research Agenda, Sensors, v. 21, (18), article number 6296.

  4. P.M.L. Ching, A.P. Mayol, J.L.G. San Juan, A.M. Calapatia, R.H.Y. So, C.L. Sy, A.T. Ubando, A.B. Culaba (2021), AI Methods for Modeling the Vacuum Drying Characteristics of Chlorococcum infusionum for Algal Biofuel Production, Process Integration and Optimization for Sustainability, 12 Jan 2021.

  5. P.M.L Ching, R.H.Y. So, T. Morck (2021), Advances in soft sensors for wastewater treatment plants: A systematic review, Journal of Water Process Engineering, v. 44, article number 102367.

  6. L.P. Wijesinghe, M.J. Wohlgemuth, R.H.Y. So, J. Triesch, C.F. Moss, B.E. Shi (2021), Active head rolls enhance sonar-based auditory localization performance, PLOS Computational Biology, v. 17, (5), article number e1008973.

  7. B. Chen, H. Wang, Y. Wei, R.H.Y. So (2020), Truth-to-Estimate Ratio Mask: A Post-Processing Method for Speech Enhancement Direct at Low Signal-to-Noise Ratios, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, v. 2020-May, article number 9052919, pp. 7509-7513.

  8. Y.X. Wang, R.H.Y. So (2020), SSVEP power shift during vection differs with visually induced motion sickness, Proceedings of 7th International Symposium on Visually Induced Motion Sensations (VIMS2020), HKUST, Hong Kong, 14-16 December, 2020.

  9. J.W. Chin, K.L. Wong, K. Suhartono, T.T. Chan, H.F. Lau, R.H.Y. So, S.M. Wong, D. Pan (2020), Rapid tempertaure screening and suspect tracking in a moving crowd, Biomedical Engineering Conference BME2020: Fighting COVID-19 and Future Pandemics with Innovation & Technology, The Hong Kong Institution of Engineers (Online), 27-28 November 2020.

  10. R.H.Y. So (2020), Keynote talk Role of Biomedical Engineers in Flighting COVID-19 pandamic in Hong Kong, Biomedical Engineering Conference BME2020: Fighting COVID-19 and Future Pandemics with Innovation & Technology, The Hong Kong Institution of Engineers (Online), 27-28 November.

  11. B. Chen, H. Wang, R.H.Y. So (2019), Facing the noise over-estimation issue for monaural speech enhancement: the recover mask for time-frequency units learned by bi-LSTM, The 1st Great Bay Area International Acoustics Symposium: Perception and Audio (GBA-IAS 2019), Shenzhen, 16-18 December.

  12. J. Hui, Y. Wei, S. Chen, R.H.Y. So (2019), Effects of Base-frequency and Spectral Envelope on Deep-learning Speech Separation and Recognition Models, Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, v. 2019-September, pp. 634-638.

  13. Y.C. Li, J.W. Chin, Y. Wang, R.H.Y. So (2019), Automatic instance-edge detection network (AID-Net) - vertebral edge detection by deep learning, European Journal of Clinical Investigation, v. 49, (S1), article number S5-O2, pp. 83-84.

  14. Y. Wei, Y.O. Okazaki, R.H.Y. So, W.C.W. Chu, K. Kitajo, (2019), Motion Sickness-susceptible Participants Exposed to Coherent Rotating Dot Patterns Show Excessive N2 Amplitudes and Impaired Theta-band Phase Synchronization, NeuroImage, v. 202, article number UNSP 116028.

  15. S.Y. Seo, S.A. Berg, R.H.Y. So (2019), Application of Optical Character Recognition with Tesseract in Logistics Management, International Journal of Internet Manufacturing and Services, v. 6, (3), pp. 285-304.

  16. J.G. Zhang, R.H.Y. So, R. Meddis (2018), 一种先进的助听器或助听设备的噪声消除方法, 2018 北京国际听力学大会 (Beijing International Audiology Conference), Beijing, China, 1 – 3 June.

  17. R.H.Y. So (2018), Visually induced motion sickness and vection, 2018 Human Factors and Ergonomics Society (HFES) International Annual Meeting, Philadelphia, PA, USA, 1 -5 October.

  18. R.K. Mo, R.H.Y. So, A.B. Horner (2018), Investigating into How Convolution Reverberation Effects the Space of Instrument Emotional Characteristics, ICMC 2018 - Proceedings of the 2018 International Computer Music Conference, pp. 217-222.

  19. J.W. Chin, T.W. Wong, R.H.Y. So, (2019), Innovations in Crowd Management: An Integration of Visual Closure, Anthropometry, and Computer Vision, Advances in Intelligent Systems and Computing, v. 822, pp. 68-74.

  20. E.R. Muth, B. Keshavarz, L.J. Smart, R.H.Y. So, S.C. Beadle (2018), Discussion Panel: Motion Sickness in Virtual Environments, Proceedings of the Human Factors and Ergonomics Society, v.3, pp. 2043-2046

  21. J.W. Chin, S.W.L. Law, R.H.Y So (2018), A Smart Fever Screen System, EMSD Symposium 2018, Hong Kong Sciences Park, Hong Kong, 15 – 16 November.

  22. N. Che-Nordin, M. Deng, J.F. Griffith, J.C.S. Leung, A.W.L. Kwok, Y.Q. Zhu, R.H.Y. So, T.C.Y. Kwok, T.P.C. Leung, Y.X.J. Wang (2018), Prevalent osteoporotic vertebral fractures more likely involve the upper endplate than the lower endplate and even more so in males, Annals of Translational Medicine, v. 6, (22), article number 442, pp. 1-9.

  23. B. Karunarathne, T. Wang, R.H.Y. So, A.C.S. Kam, R. Meddis (2018), Adversarial relationship between combined medial olivocochlear (MOC) and middle-ear-muscle (MEM) reflexes and alarm-in-noise detection thresholds under negative signal-to-noise ratios (SNRs), Hearing Research, v. 367, pp. 124-128.

  24. Y. Wei, J.  ZHENG and R.H.Y. So (2018), Allocating less attention to central vision during vection is correlated with less motion sickness, Ergonomics, 61 (7), pp.933-946.

  25. C.C.T. Guo, D.J.Z. Chen, I.Y. Wei and R.H.Y. So (2017), Correlations between individual susceptibility to visually induced motion sickness and decaying time constant of after-nystagmus, Applied Ergonomics, 63, pp. 1-8.

  26. D. Chen, B. Bao, Y. Zhao, R.H.Y. So (2016), Visually induced motion sickness when viewing visual oscillations of different frequencies along the fore-and-aft axis: Keeping velocity constant versus amplitude constant, Ergonomics, 59 (4), pp. 582-590. 

  27. E. Nalivaiko, J.A. Rudd and R.H.Y. So (2014), Motion sickness, nausea and thermoregulation: the toxic hypothesis, Temperature, 1 (3), pp. 164-171.

  28. Li Li and R.H.Y. So (2013), The applied issues in visual perception and action: preface to a special issue, DISPLAYS, 34 (2), pp. 95-186.

  29. R.H.Y. So, W.S. Wong, R. Yip, A. Lam and P. Ting (2011), Benefits of Matching Accommodative Demands to Vergence Demands in a Binocular Head-Mounted Display: A Study on Stereo Fusion Times, PRESENCE.

  30. A. Horner, J. Beauchamp, and R.H.Y. So (2011), Evaluation of Mel-Band and MFCC-based Error Metrics to Predict Discrimination of Spectrally Altered Musical Instrument Sounds, Journal of the Audio Engineering Society, 59 (5), pp. 290-303.

  31. R.H.Y. So, N.M. Leung, A. Horner, J. Braasch and K.L. Leung (2011), Effects of spectral manipulation on non-individualized head-related transfer functions (HRTFs), Human Factors, 53 (3), pp. 271-283. 

  32. R.H.Y. So and H. Ujike (2010), Visually induced motion sickness, visual stress and photosensitive epileptic seizures: What do they have in common? - Preface to the special issue, Applied Ergonomics, 41, pp. 4.

  33. R.H.Y. So, B. Ngan, A. Horner, K.L. Leung, J. Braasch and J. Blauert (2010), Toward orthogonal non-individualized head-related transfer functions for forward and backward directional sound: cluster analysis and an experimental studyErgonomics, 53 (6).

  34. A. Horner, J. Beauchamp and R.H.Y. So (2009), Detection of time-varying harmonic amplitude alterations due to spectral interpolations between musical instrument tonesJournal of the Acoustical Society of America, 125 (1) pp. 492-502.

  35. T.Y. Ji, R.H.Y. So, and R.T.F. Cheung (2009), Isolating the effects of vection and optokinetic nystagmus on visually induced motion sickness during exposure to optokinetic stimuli, Human Factors, 51 (5), pp. 73.

  36. T. Kiryu and R.H.Y. So (2008), Sensation of Presence and Cybersickness in applications of Virtual Reality for Advanced Rehabilitation, Journal of NeuroEngineering and Rehabilitation, 4, pp. 34.

  37. D. Rossiter, R. Tsang, and R.H.Y. So (2007), Beat Deviation for Tempo Estimation Algorithms, Journal of the Audio Engineering Society, 55 (11), pp. 967-980.

  38. R.H.Y. So, N.M. Leung, J. Braasch, and K.L. Leung, (2006), A low cost, Non-individualized surround sound system based upon head related transfer functions. An Ergonomics study and prototype developmentApplied Ergonomics, 37, pp. 695-707.

  39. A. Horner, J. Beauchamp, and R.H.Y. So (2006), A Search for Best Error Metrics to Predict Discrimination of Original and Spectrally Altered Musical Instruments SoundsJournal of the Audio Engineering Society, 54, pp. 140-156.

  40. S. H. Kurniawan, R.H.Y. So and M.M. Tseng (2006), Consumer Decision Quality in Mass Customisation, International J. Mass Customisation, 1, pp. 176-194.

  41. H. Ujike, R.H.Y. So, et al., (2005) ISO International Workshop Agreement-IWA3 Image Safety - reducing the incidence of undesirable biomedical effects caused by visual image sequences. IWA 3:2005(E)ISO copyright office, Case postale 56, CH-1211 Geneva 20.

  42. E. Ng, F. Tsung, R.H.Y. So, T.S. Li. and K.Y. Lam (2005), Six sigma approach to reducing fall hazards among cargo handlers working on top of cargo containers: a case studyInternational Journal of Six Sigma and Competitive Advantage, 1, pp. 188-209.

  43. J, Ji, R.H.Y. So, F. Lor, , T.F.R. Cheung, P. Howrth and K. Stanney (2005), A Search for Possible neural pathways Leading to Visually Induced Motion SicknessVISION, 17 (2), pp. 131-134.

  44. A. Horner, J. Beauchamp, and R.H.Y. So (2004), Detection of random alterations to time-varying musical instrument spectra, Journal of the Acoustical Society of America, 116, pp. 1800-1810.

  45. B. Ngan, R.H.Y. So, A. Leung, E. Altinsoy and A.G. Avalos (2004), Towards mass-customizing non-individualized head-related transfer functions: a preliminary study, Annual Journal of IIE(HK), 25, pp. 14-25.

  46. R.H.Y. So, and K.M. Cheung (2002), Combined and interacting effects of hand and head movement lags on discrete manual performance in a virtual environmentErgonomics, 45, pp. 105-123.

  47. R.H.Y. So, W.T. Lo and A.T.K. Ho (2002) Effects of navigation speed on the level of cybersickness caused by an immersive virtual environment, Human Factors, 43, pp.452-261.

  48. R.H.Y. So (2002), Editorial: a special iusue on Senior Design Capstone Projects in Asia, Journal of Industrial Engineering Design.

  49. R.H.Y. So and W.T. Lo (2001), Effects of scene rotational movements on cybersickness, Applied Ergonomics, 32 (1), pp. 1-14.

  50. R.H.Y. So, A.T.K. Ho and W.T. Lo (2001), A proposed metric to quantify virtual scene movement for the study of cybersickness: definition, implementation and verification, PRESENCE, 10, pp. 193-216.

  51. An innovative virtual surround sound algorithm: filed a declaration of copyright as well as Intellectual Property Right with HKUST Technology Transfer Center (GH-HJ1036/1). 

BACK