ih4cku / blog

deprecated, Git issues are great for writing blogs :)

My blog based on Pelican.

blog's Issues

YCM can't jump to definition

Errror message: RuntimeError: Can't jump to definition

• ycm-core/YouCompleteMe#758
• ycm-core/YouCompleteMe#755

forward-backward implementation

• Numerically Stable Hidden Markov Model Implementation
• The Forward-Backward Algorithm by Michael Collins
• FORWARD-BACKWARD ALGORITHM: FINDING PROBABILITY OF STATES AT EACH TIME STEP IN AN HMM
• HMMs and the forward-backward algorithm
• Hidden Markov Models Implementing the forward-, backward- and Viterbi-algorithms using log-space and scaling 1, 2

weight initialization

• https://plus.google.com/+EricBattenberg/posts/f3tPKjo7LFa
• https://plus.google.com/+SoumithChintala/posts/RZfdrRQWL6u
• https://www.reddit.com/r/MachineLearning/comments/2qsje7/how_do_you_initialize_your_neural_network_weights/
• http://stats.stackexchange.com/questions/47590/what-are-good-initial-weights-in-a-neural-network
• https://www.quora.com/What-are-good-initial-weights-in-a-neural-network
• Understanding the difficulty of training deep feedforward neural networks
• Practical recommendations for gradient-based training of deep architectures
• http://deepdish.io/2015/02/24/network-initialization/
• https://www.reddit.com/r/MachineLearning/comments/2vwkye/an_explanation_of_xavier_initialization_for/
• https://www.quora.com/What-is-an-intuitive-explanation-of-the-Xavier-Initialization-for-Deep-Neural-Networks
• http://chrischoy.github.io/research/neural-network-weight-initialization/

thesis writing setup

Basically, I want to use vim to write my thesis. And I want to have features below which are commonly needed when writing code:

• auto completion
• structural navigation
• forward/backward search
• ...

So, I choose to use vimtex plugin and qpdfview as the pdf viewer.

The forward/backward search feature depends on the vim client/server mode. So, I add a alias to create a vim server when start writing.

# in ~/.bashrc
alias vimtex='vim --servername LATEX'

# in qpdfview: Edit>Settings>Behavior>Source editor
vim --servername LATEX --remote-silent +%2<CR> %1

Build options:

let g:vimtex_latexmk_options='-xelatex -verbose -file-line-error -synctex=1 -interaction=nonstopmode'

Set the viewer:

if has("win32")
    let g:vimtex_view_general_viewer='SumatraPDF'
    let g:vimtex_view_general_options='-reuse-instance -forward-search @tex @line @pdf'
    let g:vimtex_view_general_options_latexmk='-reuse-instance'
elseif has("unix")
    let g:vimtex_view_general_viewer='qpdfview'
    let g:vimtex_view_general_options='--unique @pdf\#src:@tex:@line:@col'
    let g:vimtex_view_general_options_latexmk='--unique'
endif

Forward call after success building.

let g:vimtex_view_general_callback = 'ViewerCallback'
function! ViewerCallback(status) dict
    if a:status
        VimtexView
    endif
endfunction

vim and terminal

• s: terminal shift ins
• gvim v issue
• surround not select whole word issue
• python comment indent issue
• open head file of #include
• use SHIFT + h,j,k,l to switch tabs
• scroll shell output

Shell in vim

See Can I issue an interactive shell in Vim window? Dhruva Sagar's answer.

The best choice should be tpope's vim-dispatch.

git reset and commit

• https://git-scm.com/blog/2011/07/11/reset.html
• http://stackoverflow.com/questions/3639342/whats-the-difference-between-git-reset-and-git-checkout
• http://marklodato.github.io/visual-git-guide/index-en.html
• http://think-like-a-git.net/sections/rebase-from-the-ground-up/using-git-cherry-pick-to-simulate-git-rebase.html

multiple object recognition with attention

• Multiple object recognition with visual attention #134
• https://github.com/pefi9/mo_va

image style

• A Neural Algorithm of Artistic Style
• Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
• Understanding image representations by measuring their equivariance and equivalence

Graph, BFS & DFS

Many problems can be stated in term of paths in the graph constructed using the edges.

float or double?

http://stackoverflow.com/questions/1074474/should-i-use-double-or-float
http://stackoverflow.com/questions/2386772/difference-between-float-and-double
http://stackoverflow.com/questions/17603940/why-would-you-use-float-over-double-or-double-over-long-double
http://programmers.stackexchange.com/questions/188721/when-do-you-use-float-and-when-do-you-use-double

detection must do

• hard negative mining
• cascade

Torch notes

• Torch notes

numpy 'np.argwhere' and 'np.where'

• the output of np.argwhere is not suitable for indexing, use np.where instead which calls np.nonzero

vim plugins to try

• https://github.com/SirVer/ultisnips
• https://www.topbug.net/blog/2012/03/07/use-singlecompile-to-compile-and-run-a-single-source-file-easily-in-vim/

todo

code for drawing conv architectures

https://github.com/vdumoulin/conv_arithmetic

example:

http://iamaaditya.github.io/2016/03/one-by-one-convolution/

why vim create new file after make run?

• wondering

the dynamics of gradient descent

Zero mean is important. Awareness of this need to understand the dynamics of gradient descent.

loss

• multinomial logistic loss
• cross entropy loss
• softmax loss

vim scripts language

• vim scripts @ IBM
• Vim script cheatsheet
• Learn Vimscript the Hard Way
• WikiBook - Learning the vi Editor/Vim/VimL Script language

data structure and algorithm courses

• http://web.stanford.edu/class/cs161/
• http://www.cs.cmu.edu/~ckingsf/class/02713-s13/
• http://www3.cs.stonybrook.edu/~algorith/video-lectures/
• http://www3.cs.stonybrook.edu/~skiena/373/
• http://www.cs.cmu.edu/~avrim/451f13/

vim echo

• echo : normal message
• echom : keep in messages list
• echohl : using highlight, need change back to None after using

echohl WarningMsg | echo "warning" | echohl None

competitive programing

• https://www.hackerearth.com/
• http://www.vexorian.com/

show vim shell output in window

• http://vim.wikia.com/wiki/Display_output_of_shell_commands_in_new_window
• http://vim.wikia.com/wiki/Append_output_of_an_external_command
• http://superuser.com/questions/868920/open-the-output-of-a-shell-command-in-a-split-pane
• https://groups.google.com/forum/#!topic/vim_use/4ZejMpt7TeU

modify Poker II key mapping

The home, end, page up and page down keys are used frequently. However, the default positions of these keys are hard to reach. So I decide to make some alias for these keys. Thanks to the programmable feature of Poker II. The changes I made is:

• a to home
• d to end
• w to page up
• s to page down
• x to delete

The functions are triggered by pressing the PN key and the corresponding key at the same time. Now it`s convenient for me. :)

vim todo

• variable and option difference
• let and set difference

alignment

• Supervised Descent Method
• Global supervised descent method
• Supervised Descent Method for Solving Nonlinear Least Squares Problems in Computer Vision
• https://github.com/patrikhuber/superviseddescent

batch normalization

Simple experiments of Batch Normalization on MNIST. The network set up follows the paper[1] which contains just 3 fully connected hidden layers.

Compared nonlinear units with Sigmoid and ReLU.

References:

[1] Ioffe, Sergey, and Christian Szegedy. "Batch normalization: Accelerating deep network training by reducing internal covariate shift." arXiv preprint arXiv:1502.03167 (2015).

Google Test

Use gtest in Ubuntu: http://www.eriksmistad.no/getting-started-with-google-test-on-ubuntu/

adaptive learning rate

• Chapter 4. Beyond Gradient Descent
• Alec Radford's animations for optimization algorithms
• An overview of gradient descent optimization algorithms
• Caffe solvers
• COMPARISON: SGD VS MOMENTUM VS RMSPROP VS MOMENTUM+RMSPROP VS ADAGRAD
• What are differences between update rules like AdaDelta, RMSProp, AdaGrad and AdaM?

generating tags with qualifier with ctags

• explore the options

command:

$ ctags -R --c++-kinds=+p --fields=+iaS --extra=+q

• Generate Ctags Files for C/C++ Source Files and All of Their Included Header Files

bash readings

• Linux tip: Bash test and comparison functions
• BashPitfalls
• Gotchas

companies

• 学霸君
• 作业帮
• 小猿搜题

deep learning readings

Blogs

• WILDML
• http://www.inference.vc/
• http://handong1587.github.io/

vim python indentation

quick fix: set nosmartindent

FCN

http://nbviewer.jupyter.org/github/BVLC/caffe/blob/master/examples/net_surgery.ipynb#Casting-a-Classifier-into-a-Fully-Convolutional-Network

autocommand groups

When using autocmd, Vim doesn't know if you want to replacing an existing one. So it just append the new operation to the event. This is when to use augroup.

Use autocmd! to clear previous group.

see: LVTHW - Autocommand Groups

sampling

http://stackoverflow.com/questions/29095070/how-to-simulate-from-an-arbitrary-continuous-probability-distribution
http://stackoverflow.com/questions/11673124/what-is-the-best-way-of-getting-random-numbers-in-numpy
http://stackoverflow.com/questions/21100716/fast-arbitrary-distribution-random-sampling
http://stackoverflow.com/questions/24103163/how-to-write-a-sampling-algorithm-from-a-custom-distribution
http://stackoverflow.com/questions/4265988/generate-random-numbers-with-a-given-numerical-distribution

spatial transform network

• The power of Spatial Transformer Networks
• Implement Spatial Transformer Network for Caffe
• Human Pose Estimation in Videos and Spatial Transformers
• https://www.youtube.com/watch?v=Ywv0Xi2-14Y
• https://www.youtube.com/watch?v=6NOQC_fl1hQ
• http://handong1587.github.io/deep_learning/2015/10/09/spatial-transformer-networks.html
• http://web.cs.hacettepe.edu.tr/~aykut/classes/spring2016/bil722/slides/w08-transformer_network.pdf
• http://www.vlfeat.org/matconvnet/spatial-transformer/
• Recurrent Spatial Transformer Networks

vim tags

• sublime like tag find, <Shift+Ctrl+P>
  • Add support for fuzzy tag search #27
• tag with qualifier, google search "vim tag with qualifier"
• <C-]> : jump to first tag, :tag
• g<C-]>: open tag selecting list, :tjump

plugins to try

• The Silver Searcher as mentioned in this post
• bufexplorer
• personal vim settings for c/cpp project
• shougo/unite.vim replacement of ctrlp
  • Unite.vim, The plugin you didn't know you need

python and numpy slicing

[] use slice object internally.

grep in a folder

command

$ grep -rn "text to search" /path/to/folder

adjacent list vs adjacent matrix for graph

• http://stackoverflow.com/questions/2218322/what-is-better-adjacency-lists-or-adjacency-matrices-for-graph-problems-in-c
• https://www.reddit.com/r/learnprogramming/comments/1rvu6g/adjacency_list_vs_adjacency_matrix_which_is/

show what a key is mapped

• Detect if a key is bound to something in vim

vim nerdtree set current directory as current opened file

• http://superuser.com/questions/195022/vim-how-to-synchronize-nerdtree-with-current-opened-tab-file-path

Use github issues to write blog

• Turn your Github issues into blog posts
• 如何评价用 Github issue 写博客？

to shua

http://www.renren.com/271494700/profile
http://www.renren.com/374920219/profile
http://erikbern.com/

vim latex editing

review

• What are the differences between LaTeX plugins?

plugins

• vimtex
• Vim-LaTeX
• LaTeX-Box

preview

• vim-latex-live-preview

posts

1. TeX and LaTeX plugins for Vim
2. LaTeX and Vim Part 2
3. Vim, LaTeX, Evince, and Forward Search

• Leaving vim-latex for rubber and ultisnips

programming courses

• Fall 2014, COMP 2012H Honors Object-Oriented Programming and Data Structures