Math

I have just borrowed Clifford Algebras and Zeons: Geometry to Combinatorics and Beyond ( Citation: Staples, 2020 Staples, G. (2020). Clifford algebras and zeons: Geometry to combinatorics and beyond. World Scientific. ) from the library. This post should briefly walk through the contents of the book, highlight some key concepts, and provide further readings for each chapter of the book. For the complete and updated research work by George Stacey Staples, see his home page....

This post studies group algebras with GAP, focusing on a few interested groups. See My math interests in 2024: Group Algebra for context. It’s helpful to read GAP Manual and SO questions before using GAP. Installation I’m using Mac, so I ran the following commands to install and start GAP: brew install wget autoconf gmp readline wget https://github.com/gap-system/gap/releases/download/v4.13.0/gap-4.13.0.tar.gz tar xzvf gap-4.13.0.tar.gz cd gap-4.13.0 ./autogen.sh ./configure make -j4 V=1 all make check make install which gap gap -l ....

I wish this post to be a continuously updated list of my math interests in 2024 with proper citations to literatures, as I keep wandering in the math wonderland and I don’t want to be lost in it without breadcrumbs. Some interests that have older origins will gradually moved to corresponding posts for earlier years. I also hope certain interests will be developed into research projects, and leaving only a brief summary and a link here....

The purpose of this post is to understand what is under the hood and the performance factors involved when fine-tuning and running local Transformer models, keeping multi-modality in mind, with an emphasis on the decoder-only transformers (e.g. GPT series). To accomplish this, we first present a brief account of the transformer architecture, including its design intuitions and the underlying mathematics, concretized by illustrative diagrams and code snippets. Then we aim to achieve a comprehensive understanding of the widely adopted performance optimizations for the original transformer architecture....