Hi 👋 (づ｡◕‿‿◕｡)づ (⊙‿⊙✿)",
I'm an undergraduate at McGill in Honors Probability & Statistics, and research assistant at Mila under Prof. Doina Precup, where I work in provably efficient exploration for reinforcement learning. I am also a R&D intern at FPT Canada, where I study a modified version of the vehicle routing problem. I am independently researching mathematical formalizations of consciousness and intelligence. My mission is to create artificial self-conscious beings that think and act intelligently.
My primary research interests are:
- Exploration in reinforcement learning
- DNN theory, abstract neural nets
- Consciousness, intelligence, mind
On the Analysis of Stochastic Gradient Descent in Neural Networks via Gradient Flows - Viet Nguyen, May 2020
"Research in neural network theory is steadily gaining traction, as there is a growing interest in the thorough understanding of the functionalities and the mechanisms through which these models achieve strong performances in decision problems. Several methods have been proposed to quantitatively assess the optimization process of the neural network’s high dimensional non-convex objective, employing various tools such as kernel methods, global optimization, optimal transport, and functional analysis. In this work, we focus on Mei et al.’s analysis of the mean risk field of two-layer neural networks which associates stochastic gradient descent’s (SGD) training dynamics to a partial differential equation (PDE) in the space of probability measures with the topology of weak convergence. Precisely, we dissect the proof of the convergence of SGD’s dynamics to the solution of the PDE, showcase several results regarding the analysis of the latter and their implications on the training process of neural networks via SGD, and discuss related work as well as potential further explorations stemming from various fields."
On the Concentration of Measure in Orlicz spaces of exponential type - Viet Nguyen, April 2020
"The study of Orlicz spaces, first described in 1931 by Wladyslaw Orlicz and Zygmunt Wilhelm Birnbaum, became popular in the empirical processes and functional analysis literature, due to the rising interest in chaining arguments to derive probabilistic bounds for stochastic processes, and generalizations of Lp spaces as well as Sobolev space embeddings, respectively. Orlicz spaces exhibit strong concentration phenomena, inherited from their construction. In particular, they are associated to the sub-Exponential and sub-Gaussian classes of random variables. In this article, we aim to provide a brief introduction to concentration of measure in Orlicz spaces, in particular, Orlicz spaces of exponential type. We begin by the construction of these spaces, and delve into certain concentration guarantees and applications."
Neural Networks: A Continuum of Potential - Eric Hu, Johnny Huang, Viet Nguyen, December 2019
"Theories on neural networks with an infinite number of hidden units were explored since the late 1990's, deepening the understanding of these computational models in two principal aspects: 1. network behavior under some limiting process on its parameters and 2. neural networks from a functional perspective. Continuous neural networks are of particular interest due to their computational feasibility from finite affine parametrizations and strong convergence properties under constraints. In this paper, we survey some of the theoretical groundings of continuous networks, notably their correspondence with Gaussian processes, computation and applications through the Neural Tangent Kernel (NTK) formulation, and apply the infinite dimensional extension to inputs and outputs all the while considering their universal approximation properties." I delivered a presentation on this topic at the Seminary on Undergraduate Mathematics in Montreal (SUMM) 2020.
Fader Networks: A Heuristic Approach - Marcos Cardenas Zelaya, Marie Leech, Viet Nguyen, April 2019
"In recent years, approaches to approximating complex data distributions have been centered around the generative adversarial networks (GANs) paradigm, eliminating the need for Markov chains in generative stochastic networks or approximate inference in Boltzmann machines. Applying GANs to image and video editing have been done in a supervised setting where external information about the data allows the re-generation of real images with deterministic complex modifications, using Invertible conditional GANs (IcGANs). Fader Networks extend on this idea by learning a post-encoding latent space invariant to labeled features on the image, and re-generating the original image by providing the decoder with alternate attributes of choice. In this paper, we explore the impacts of modifications on the encoding and decoding convolutional blocks, analyzing the effects of droput in the discriminator, implementations of different loss functions on the generated images' quality using appropriate metrics and extend the model by including Skip Connects. We finish by providing an empirical assessment on how Fader networks develop a pseudo-understanding of higher-level image features."
CAE - defective_pilots, Fall 2019
Given time series flight simulation KPI data of several commercial pilots, we are tasked to classify whether a pilot should undergo retraining and have their mental health assessed. We won the CAE sponsor challenge at ImplementAI 2019 by providing the best solution which combines various feature engineering techniques and a mix of supervised and unsupervised learning.
Milo, the Brain-Controlled Wheelchair, Winter 2019
"Students from different backgrounds — including biology, computer science, hardware engineering, data collection, and machine learning — got together on their free-time to start a project to challenge themselves and improve the world around them. By gathering EEG bio-signals from the brain, they were able to process the data in order to direct the wheelchair forward, left, right, and stop. Over the course of the development, the students were able to create a wheelchair without using motor controls – just the control of the user’s mind – further improved with impressive semi-autonomous enhancements." I worked on the Machine Learning team of the project and was tasked to classify the processed EEG signals into different wheelchair movements. We won first prize at the NeuroTechX "Open Challenge".
Handwriting Recognizer, Winter 2019
At ConUHacks IV, we leveraged deep learning models to create a handwriting recognizer, deployed as a backend to an Android app using their camera API.
U2S2 Class Notes and Assignments
These contain *incomplete* notes from MATH 565 - Advanced Real Analysis 2, as taught by Prof. John Toth, and MATH 598 - Topics in Prob&Stats: Concentration Phenomena, as taught by Prof. Jessica Lin, available here. They also contain my highly questionable assignment submissions.
I transcribed Danny Wright's version of Canon in D by Pachelbel for piano, here.
I transcribed Văn Vượng's Hà Nội Trong Mắt Ai for guitar, here. I 200% recommend the documentary with the same title by director Trần Văn Thủy.