Background Recently, I have worked on a demo program that works on the Windows OS. However, most of my recent works are based on the python language. I really like the simplicity of the language, and don't want to go back to use the C++ and MFC. Therefore, in this…
Manipulate Gradient The section includes some technologies related to gradient descent optimization method. Gradient Clipping A good explanation: What is Gradient Clipping? Related paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification for Adaptivity (ICLR'2020) Sometimes the training loss may not stable, it may caused by exploding problem. A simple…
Outline In this presentation, we present the DNN and CNN structure We briefly shows some famous CNN works (structure, improvements, performance) Difficulty of training DNN and shows a good solution (ResNet) Revised Version [2021-06-25] A revised version can be download from Download_Link Slides [embeddoc url="https://liwen.site/wp-content/uploads/2020/07/Deep-Learning-2-CNN_V12.pptx" download="all" viewer="microsoft"]
Content In the document, we present: Each neural network (NN) consists of many neurons, and each neuron has two elements: linear function and activation function. We have shown the reason of using activation functions. (choices of activation functions) Two numerical examples have been given to track the forward and backward…
Outline Introduction Style transfer Content-perceptual loss Style-perceptual loss Example Proposed Method (simple but inspirational) Arbitrary style transfer Meta networks for arbitrary style transfer Experiments Conclusion Slides [pdf-embedder url="https://liwen.site/wp-content/uploads/2020/06/20200116_Meta-Network-for-Neural-Style-Transfer.pdf" title="20200116_Meta Network for Neural Style Transfer"]
Prepare the environment of the experiment control Tutorial from https://shenxiaohai.me/2019/01/17/sacred-tool/ Installation To install Sacred at client (t.g. conda environment) pip install sacred pip install numpy pymongo Server: database # 1. Import the public key used by the package management system. wget -qO - https://www.mongodb.org/static/pgp/server-4.2.asc | sudo apt-key add - #…
Auto notification of modification of a web page Select an area and relax: It will send an email alert when something changes. Just from: https://visualping.io/