Recent Posts
Write Citations in Org and Export to LaTeX
Motivation. This post considers handling citations in Org, generating nicely formatted reference entries in HTML, and exporting to LaTeX directly with properly generated Bib(La)TeX citation commands.
...A Repository for Future Tasks
Motivation. Store potential future tasks and rank them based on priority. Many ideas aren't worth pursuing immediately and could be stored for future consideration. To avoid being overwhelmed by an ever-growing list of such tasks, consider ranking them by priority.
...Display Unicode Characters in Emacs
Motivation. I prefer Unicode symbols over LaTeX sequences. In this
old post , I discussed how to display LaTeX commands as Unicode
symbols in Emacs. However, after applying these settings, my Emacs
renders both \mathcal{A} and \mathscr{A} identically as the U+1D4D0 character from the
Libertinus Math font.
A Beginner's Guide to Optuna
Many sophisticated algorithms, particularly deep learning-based ones, have various hyperparameters that control the running process. Those hyperparameters often have a significant impact on performance. Manually searching for a good combination of those hyperparameters is tedious, and even keeping track of all results becomes unwieldy as the number of hyperparameters grows beyond 10. Today's topic, Optuna, is such a tool that helps automate the search process and stores all results in a structured database. Even better, its web-based dashboard lets us explore these results intuitively with just a few clicks.
...Gradients of Convolution: Direct Computation and Linear Algebra Perspective
Convolution operations are foundational in deep learning for extracting features in image tasks. Calculating their gradients is critical for training convolutional neural networks, enabling backpropagation to update parameters and minimize loss. This post derives these gradients through two complementary approaches: direct differentiation of the convolution definition, and a linear algebra perspective which naturally introduces the transposed convolution (also known as deconvolution).
...