Python tricks Widgets Progress bar in Python bash pip install tqdm Then in the script python from tqdm import tqdm for i in tqdm range 100 , desc Loading... ... If the description needed to be updated at each iteration python from tqdm import tqdm for i in pdar tqdm range 100 pdar.set description ... ... Matplotlib colors List of named colors Matplotlib 3.9.2 documentation img My preferred ones goldenrod teal olive lightcoral Environment See also Conda frequent commands Export conda environment.yml Exporting the environment.yml file conda 25.3.2.dev62 documentation bash conda env export environment.yml ...

Deep learning environment setup Install Ubuntu 22.04 LTS Install Ubuntu Desktop Ubuntu Ubuntu Releases Select the right version of Ubuntu is important. Softwares for deep learning like CUDA and NCCL provide specific compiles for different Ubuntu versions not all Ubuntu versions are available. In 2025, Ubuntu 22.04 and Ubuntu 20.04 are the safe choices. After install the OS, full upgrade of kernel packages must be done. Otherwise, newly added packages could clash. bash sudo apt update sudo apt full upgrade yes sudo apt autoremove yes sudo apt autoclean yes reboot Fish shell Install How to Install and Set Up the Fish Shell by Saad Jamil Medium bash sudo apt add repository ppa fish shell release 3 sudo apt get update sudo apt get install fish ...

Good reads of 2024 Finally achieved the goal of reading 12 books in 2024 Having finished these books, I don t feel particularly different. Every day in life is still the same as always. But perhaps my perception of life has become sharper than before. If the length of life cannot easily be extended through personal effort, then perhaps maintaining sensitivity in perception is equivalent to broadening the width of life. img Following are my favorite books , movies , podcasts , and articles of this year. I hope that in 2025, I can also strive to remain spiritually free. Favorite Book of 2024 Hayek s The Road to Serfdom was the most challenging book I read this year, so much so that I still haven t finished organizing my notes its sentences feel as if they are engraved on stone tablets, impossible to rewrite or condense, only to be quoted. Looking back, the book speaks of nothing more than common sense, but holding on to common sense i...

Git frequent operations Basic configurations User name git config global user.name Your Name Email git config global user.email email example.com Main branch name git config global init.defaultBranch name P.S. Change main branch name of an existed repository git branch m old name new name If it has been pushed to remote git push remote delete old name git push u remote new name Local repository operations Initialize the repository git init Current branch operations Stage changes git add file P.S. Use f to force stage a file even if it s set to be ignored in .gitignore . Unstage the file changes git restore staged file P.S. Unstage all files cahnges git reset Discard the changes in the working directory git restore . git restore file P.S. The difference is git restore staged file af...

Travel time analysis with Apple Shortcut Motivation Travel during public holidays in China is a headache inducing activity, especially during national day holidays, one of the longest public holidays. People tend to pour out to visit their family friends or travel to long expecting tour sites. Traffic could be overwhelmingly heavy during this period. To deal with this situation, some schedule their travel time carefully. Long before the off duty time of 31 Sep, the day before the holiday begins, people check their map apps anxiously again and again to get a glimpse of the development of traffic jams. Experiences of the best time for departure spread on social media, though they tend to convey conflicting speculations. I got on the road at 7 30 on 1 Oct, hoping an earlier departure could make my journey easier, yet I got stuck on the road for around 10 hours, which was around 3x the ordinary travel time. P.S. I later realized that I almost chose the worst time to go... P.S...

Cal Newport s time management system Cal Newport s time management system is summarized in The Time Block Planner Cal Newport. Combining the techniques discussed in this tiny pamphlet and his other books podcasts, I compiled this blog post. Core value of time management Cal Newport advocates his time management system in his books and youtube channel. It s both time efficient, lightweight, and deliver the most important values of any time management system Time management frees your mental stress on remembering all the todos dues bouncing around your head. Time management has you articulately think about how can you complete your tasks in time. By doing this, you will soon realize that the task is more complicated than your expectation and you don t have so many allocable time, which boost motivation. e.g. Think about PhD application ...

latexdiff mark changes of LaTeX documents When submitting academic manuscript, it s usually mandatory to submit the marked changes for revisions resubmissions. Word is particularly handy in this regard. But if your manuscript is consists of lots math formula, e.g. in the field of deep learning, LaTeX is a more common choice. In this case, latexdiff is the go to choice for generating the document with marked changes. Install latexdiff Follow the instruction on the official documentation GitHub ftilmann latexdiff Compares two latex files and marks up significant differences between them. Releases on www.ctan.org and mirrors Prepare files Copy the whole folder of the two versions of LaTeX documents that are being compared, say one is draft 0 while the other is draft 2 . Make sure that each of them can be successfully compiled. About the figures and other resources If you stored figures in the other folder, y...

How to set the padding of convolution to make the stride acting as a scale factor img Cover image source A guide to convolution arithmetic for deep learning Vincent Dumoulin, Francesco Visin ArXiv When doing convolution, the kernel is shift around the input image. Let s consider the case when the kernel moves left to right. The up to down scenario are just the same. Constrains Let s denote the padding size as p , the image width as w , the kernel size as k , and the stride as s . Then the total length of image width plus padding should be 2p w At the begging, the kernel is placed on the left of this total length, and is then moved towards right side with step length of s , until no more space is available. Denotes the number of the placable potions as n , then the output width of the convolution is also n . It should satisfys 2p w s k n 1 s leq 2p w tag a When will the s...

Why transposed convolution can be used to reconstruct activating features from the input images Cover image source A guide to convolution arithmetic for deep learning Vincent Dumoulin, Francesco Visin ArXiv In ZF Net, the transposed convolution is used to approximate the inverse of convolution, leading to the reconstruction of the activating features from the input image that activates a particular layer. However, strictly speaking, the transposed convolution is not really the inverse of convolution. Then why can it be used to do the reconstruction What is transposed convolution An ordinary convolution can be written in the form of Y C X . Then the corresponding transposed convolution is defined as X C T Y What yields the largest response The convolution Y C X and be transformed to the vectorized form y i c i T x where x is...

A complete guide to setup WSL Windows Subsystem for Linux WSL Windows Subsystem for Linux has various great advantages against dual boot installing Linux and Windows on the same computer , among them the most significant is that you can literally running both systems at the same time without the need to stop every software that s running and reboot to another system. Procedure to set up a WSL is roughly the same as setting up a real Linux OS, therefore this guide can also be used as a reference to Linux setup. The specifications of WSL setup procedure are mainly in Install WSL , CUDA and PyTorch , VTK with PyVista, and Remote development with SSH as described below. Install WSL Install WSL Microsoft Learn In PowerShell, run wsl install After restart the computer, the terminal will prompt you to set the user name and password for the WSL. Then you can then enter the linux subsystem by enter ws...

Setup Windows machine as SSH host In the previous blog post, I set up the development environment on a Windows machine. I further set it up as a ssh server that can be access by my laptop over the internet. Following is the summarization of some critical steps and relevant materials. Setup SSH host Install OpenSSH Get started with OpenSSH for Windows Microsoft Learn Check installation status of OpenSSH Get WindowsCapability Online Where Object Name like OpenSSH Install the OpenSSH Client Add WindowsCapability Online Name OpenSSH.Client 0.0.1.0 Install the OpenSSH Server Add WindowsCapability Online Name OpenSSH.Server 0.0.1.0 Set PowerShell as the default shell the shell you enter when ssh into this host New ItemProperty Path HKLM SOFTWARE OpenSSH Name DefaultShell Value ...

Setup Windows development environment Recently, I tried to set up a Windows machine for development, focusing on Python, machine learning PyTorch with CUDA , and web development Node.js with NPM . Following is the summarization of some critical steps and relevant materials. Later, I further set it up as a ssh server that can be accessed by my laptop over the internet. If you are interested, please check this post. PowerShell In Windows, PowerShell is more powerful than the legacy cmd shell in terms of system administration, configuration management, and perform administrative tasks. Terminal execution policy Firstly, enter PowerShell in administrator mode and modify the execution policy to enable shell scripting Set ExecutionPolicy Scope CurrentUser ExecutionPolicy Unrestricted Powershell autocomplete Fish like Autosuggestion in Powershell DEV Community...

LaTeX frequent snippets Math Matrix latex begin bmatrix x 11 x 12 x 13 dots x 1n x 21 x 22 x 23 dots x 2n x d1 x d2 x d3 dots x dn end bmatrix Matrix bolding mathbf Transpose top hat x, tilde x, overline x hat x, tilde x, overline x Additional symbols List of LaTeX mathematical symbols OeisWiki Listing latex begin itemize item end itemize latex begin enumerate item end enumerate latex begin lstlisting language Python end lstlisting Table latex begin table h centering begin tabular lcc toprule midrule bottomrule end tabular caption label tab end table P.S. booktabs package needed. Figure latex centering includegraphics width textwidth figures lat...

Conda frequent commands When working on a Python project, it s considered good practice to create a virtual environment. In this case, every project is running in a separate environment, with their own dependencies. This can save you tons of headache if you install all your projects dependencies in one place, things may quickly crash with each other. I personally learned this lesson the hard way after spending an entire night trying to fix version crashes. Eventually, I had no choice but to delete everything and start from scratch. You certainly do not want to experience the same frustration as me and you don t have to. With conda virtual environment, all your projects have their own territory to play and there is zero chance for crashing with each other. To gain a proper understanding of conda , the following resources will be helpful. Additionally, some commonly used commands will be extracted and listed in this blog post for easy reference. Managing conda Con...

Sphinx ReadTheDocs My optimized documentation workflow Sphinx is an excellent tool for documenting Python projects. It can generate comprehensive documentation from docstrings in the code, which means that the comments you write for your code also serve as its documentation. If you are not familiar with writing docstrings or Sphinx documentation, I highly recommend checking out this tutorial A How to Guide for Sphinx ReadTheDocs sglvladi My workflow was adapted from this tutorial with some personalization. Here is an example example Folder structure and setup Under the root folder of the project, there are docs for storing documentation, projectna...

Embed GIF and MP4 in LaTeX Beamer As an research postgraduate student, I frequently make academic looking slides for meetings, which comprise a lot of references, tables, charts, and sometimes math equations. LaTeX is excellent for typesetting these elements, so using LaTeX to make slides sounds like a good idea. With tutorials like Beamer Overleaf, I got started with this approach and feel more and more comfortable. I even made a series of templates for me and my friends for more details Beamer LaTeX Themes . Here are some example pages PolyU math However, LaTeX only generates PDF files, which are usually static. Excluding videos and GIFs completely from your presentation How pitiful. I searched the internet for a while a...

LaTeX is a great tool for academic writing. However, not all collaborators may be familiar with it, and at times, you may need to convert your document into a Word file for reviewing and editing purposes. In my opinion, the best tool for this task is Pandoc an open source command line tool for free. Following the tutorial below, I installed pandoc and successfully converted paper.tex to paper.docx How to Convert from Latex to MS Word with Pandoc Zhelin Chen In this blog, I will share a simple command snippet that converts LaTeX to Word file. Additionally, I will also discuss some aspects that were not fully covered in the aforementioned tutorial. Conversion command After runing this command, a Word file will be generated in the . word folder pandoc paper.tex o word paper.docx reference doc word template.docx bibliography bibliogra...