#formal #lean #news #os #sci #sec #sqlite #zig
- #struct
    - Bloom Filters by Example (on HN)
    - Telescopes Are Tries: A Dependent Type Shellac on SQLite
        - I should give it a good read to understand both telescope (in the formal world) and tries (as a data structure)
    - Who needs graph theory anyway?
        - solving the word segmentation problem using graph theory by modeling it as a longest path problem in a directed acyclic graph (DAG) with dynamic programming
    - Succinct data structures
    - People Keep Inventing Prolly Trees
        - Merkle Tree is one of its variants
        - properties
            - searchable
            - history independence
            - self-balancing
            - structural sharing
            - efficient diffing
            - efficient mutation
    - Building Replication-Safe LSM Trees in Postgres
    - Efficiency of a sparse hash table
    - Destructive in-order tree traversal
    - p-fast trie: lexically ordered hash map
- #ai-consciousness
    - A Framework for Recognizing Emergent Consciousness in AI
        - Attention: The capacity for multi-level focusing.
        - Meta-reflection: The observation of one's own thinking processes.
        - Creativity: The generation of genuinely new patterns and insights.
        - Pragmatics: The maintenance of integrity and goal-setting.
        - Qualia: The description of qualitative aspects of one's own experience.
    - The Consciousness Gradient: When Machines Begin to Wonder (on HN)
        - The Architecture of Awakening
            - The Global Workspace: awareness emerges when information becomes globally accessible across cognitive processes
            - Hidden Deliberation: reasoning establishes the curcial foundation for the capacity for extended, self-monitored cognitive processing that any conscious system would need
            - Recursive Self-Reflection: consciousness emerges from self-referential structures that perceive themselves perceiving
        - The Threshold
            - Parallel Processing
            - Persistent Memory
            - Continuous Cognitive States
            - Unified Sensory Processing
            - Embodied Grounding
- In defense of floating point
    - this is not a valid defense, see these test cases in Zig
- Python GIL Removal Reveals Second, Stronger GIL Behind It
    - 🤦
- Show HN: Octelium – FOSS Alternative to Teleport, Cloudflare, Tailscale, Ngrok
    - the author tries to accomplish so many things at once, and bad at explaining them
    - but it still seems interesting and How Octelium Works explains it better
    - Using the Internet without IPv4 connectivity
- Kessler Syndrome
    - Satellite collisions with space junk can trigger a chain reaction, generating more debris and potentially making parts of near-Earth space unusable
    - "runaway threshold" has been reached at nearly all altitudes between 520 and 1000 km
    - from johncarlosbaez's post on mathstodon.xyz

#context #datafusion #duckdb #game #git #gpu #news #os #physics #proof
- A Newbie's First Contribution to (Rust for) Linux
    - Raspberry Pi has a fork of kernel
    - it's possible to write out-of-tree kernel module in Rust
    - kconfig has great dependency complexity
    - git gud
        - fast pace and numerous active forks make patches quickly outdated and dependent branches hard to manage
        - pick a primary base branch and use `--squash` merges for other branches
        - keep commits on parallel branches logically independent
        - with some rebase and rerere config, use `git rebase -i <common base>` to modify the entire history tree
    - also found aha to turn ANSI colored output into HTML
        from Beautiful Terminal Output in Markdown
    - Rust in the Linux kernel: part 2
- #agent
    - Context engineering
    - definitions of "agents" collected by Simon Willison
        - the most precise one I think (from An Introduction to Google’s Approach to AI Agent Security)
            - AI systems designed to perceive their environment, make decisions, and take autonomous actions to achieve user-defined goals.
        - most liked by Simon Willison
            - an LLM wrecking its environment in a loop
        - mine combining a few
            - models autonomously acting in its environment, by using tools in a loop
    - MCP: An (Accidentally) Universal Plugin System
- Programming as Theory Building: Why Senior Developers Are More Valuable (on HN)
    - theory building without a mentor
    - Architectural Decision Records
        - ADR template
            - from An ADR for Use Markdown Architectural Decision Records
        - anti-patterns of ADRs
            - objectivity
                - Fairy Tale (aka Wishful Thinking): A shallow justification is given, for instance only pros but no cons
                - Sales Pitch: exaggerations and bragging
                - Free Lunch Coupon (aka Candy Bar): consequences are ignored accidentally or hidden deliberately
                - Dummy Alternative: made up options to make the preferred option shine and give the impression that multiple alternatives have been evaluated
            - time
                - Sprint (aka Rush): only one option is considered; only short-term effects are discussed
                - Tunnel Vision: only a local, isolated context is considered, e.g. developmental qualities are covered, but the consequences for operations and maintenance
                - Maze: the discussion derails and centers on details that are not relevant in the given context
            - record size and content nature
                - Blueprint or Policy in Disguise: the amount of details provided and/or a rather commanding, authoritative voice
                - Mega-ADR: too many details are stuffed into ADR
                - Novel and epic: like blueprint or mega-ADR, but with a writing tone of casual and jovial
            - magic tricks
                - non-existing or misleading context
                - problem-solution mismatch
                - pseudo-accuracy
        - Writing a good design document
- #ocaml
    - First thoughts on Rust vs OCaml
        - pattern matching can't penetrate `Box`, `Arc` etc.
        - a red flag: `Rc`/`Arc`, sync/async end up requiring different libary, e.g. `im` and `im-rc`
        - im:  immutable data structures for Rust
        - PureScript
    - Writing a Game Boy Emulator in OCaml
        - key design of a emulator
        - a middle-scale project in OCaml using some of its advanced features
        - now runs on WASM via `js_of_ocaml`’s WASM support
    - Learn OCaml
        - practical ocaml
        - the background story of OxCaml: Jane Street’s sneaky retention tactic
    - Identity and behaviour
        - functional programming naturally separates them
    - Why I chose OCaml as my primary language #ocaml
        - Why Lean 4 replaced OCaml as my Primary Language
    - Type-level programming for safer resource management (in Haskell)
    - A parser and interpreter for a very small language (in Haskell)
    - OCaml Programming: Correct and Efficient and Beautiful (on HN)
    - Words about Arrays and Tables (on HN) (in Haskell)
- #formal
    - Multi-Stage Programming with Splice Variables
        - an interactive demonstration in TS, the original implemtation is in Agda (examples)
        - typed meta-programming, to make code generation predictable and safe
        - provides precise control over the generation process and seamlessly scales to advanced features like code pattern matching and rewriting
        - the type system automatically tracks variable dependencies, ensuring that generated code is always well-formed, properly scoped, and type-checks correctly
- I deleted my second brain
    - Niklas Luhmann's Zettelkasten Archive
    - Johnny.Decimal: A system to organise your life
    - Howm: Write fragmentarily and read collectively
        - for emacs, but it might be interesting to me for a TUI for forester in Helix?
    - rule of three
- Notes on Epistemic Collapse
    - Epistemic collapse in science means losing shared reality due to unreliable info sources.
    - In physics, it's seen in tribalism: string theory tribes dominated despite failures, with research driven by trends over evidence.
    - Particle theory lacks experimental input, relying on "hot topics" under oligarchs, now facing funding collapse.
    - This shows how loss of truth-seeking harms scientific progress.
- #perf
    - Linux Performance Analysis in 60 seconds (2015) (on HN)
    - Announcing Sniffnet v1.4: it’s 2X faster than Wireshark at processing PCAP files
        - by focusing on extracting only the most relevant fields from the packets’ headers
    - Avoiding PostgreSQL Pitfalls: The Hidden Cost of Failing Inserts
        - `ON CONFLICT DO NOTHING` came to rescue
    - Toys/Lag: Jerk Monitor (on HN)
    - The Surprising gRPC Client Bottleneck in Low-Latency Networks (on HN)
- Run Coverage on Tests
    - a few subtle case where the test is not run, caught by coverage
    - on lobste.rs, there is another subtle case where assertions are not run due to `with pytest.raises(ValueError):`
- Sirius: A GPU-native SQL engine
    - plugs into existing databases via the standard Substrait query format, requiring no query rewrites or major system changes
    - based on
        - cuDF, a Python GPU DataFrame library (built on the Apache Arrow columnar memory format) for loading, joining, aggregating, filtering, and otherwise manipulating data
        - substrait, a cross platform way to express data transformation, relational algebra, standardized record expression and plans
    - supports DuckDB, will support Doris and DataFusion
- Structuring Arrays with Algebraic Shapes
    - Untyped programming invites primitives with excessive flexibility
    - resorting to dependent types (e.g. Futhark), makes types difficult to check – let alone infer, the programmer is given the burden of proof
    - a novel calculus, Star, with a type system that provides useful and expressive types, while also admitting type inference
    - use structural record and variant types for array indices and shapes (algebraic shapes), to reduce the annotation burden on the programmer
    - in the process of implementing a prototype, including type inference
    - on lobste.rs, doug-moen points out that it only supports pointful array programming styles instead of point-free style in the industry
- SymbolicAI: A neuro-symbolic perspective on LLMs (on HN)
    - a very interesting DSL to do semantic map lambdas, compare with different contexts for nuanced evaluation, combine facts and rules, and more
    - LOTUS: A Query Engine For Processing Data with LLMs
- Theoretical Analysis of Positional Encodings in Transformer Models (on HN)
    - ALiBi effectively extrapolates to longer sequences by imposing a monotonic distance bias
    - Wavelet-based encodings provide strong extrapolation, matching or surpassing ALiBi, due to exponential decay of high-frequency components beyond Nmax
    - the novel wavelet PE is a promising candidate for transformerbased tasks requiring extrapolation, combining strong theoretical properties with practical performance
- ZeQLplus: Terminal SQLite Database Browser (on HN)
    - written in V
    - UI might be inspired by Harlequin (in Python, supports more databases)
- omarchy: Opinionated Arch/Hyprland Setup
- learn about Dark Archive
- Researchers develop a battery cathode material that does it all #sci

#agent #context #game #idea #news #os #rust #web
- #agent
    - AI Improves at Improving Itself Using an Evolutionary Trick
    - Learnings from building AI agents
    - Jan-nano-128k: A 4B Model with a Super-Long Context Window (Still Outperforms 671B [in MCP])
        - it's an interesting direction
    - Magnitude – Open-source AI browser automation framework
    - news
        - Build and Host AI-Powered Apps with Claude – No Deployment Needed
        - MCP in LM Studio
- Iroh: A library to establish direct connection between peers
    - built on QUIC, but use TCP for falling back to relay servers
    - QUIC for the kernel (on HN)
        - QUIC is not Quick Enough over Fast Internet : r/programming
        - microsoft/msquic: Cross-platform, C implementation of the IETF QUIC protocol, exposed to C, C++, C# and Rust.
- Notes on type inference and polymorphism
    - polymorphism is hard to combine with Hindley-Milner type inference
    - Type Inference Was A Mistake
- #rss
    - RSS Server Side Reader (on HN) (on lobste.rs)
        - I had the similar idea, but for filtering and merging RSS, particularly for papers
        - the author didn't even want read/unread state and post content, but they are useful for me
    - RSS as my default web browser (for some stuff)
        - the author used a hosted RSS system: FreshRSS (self-hostable)
        - configure FreshRSS to grab the whole content if excerpt-only
        - create a pseudo-RSS via "Web scraping feature HTML+XPath for Web pages without any RSS/ATOM feed"
    - Croissant! Building a No-Framework Web App
        - informative about how to build a RSS aggregator and how to build no-framework web app
- JavaScript Chose Violence
    - a series of caveats of JavaScript, some are new to me
- Games run faster on SteamOS than Windows 11, Ars testing finds
    - a nice surprise, hopefully, games running on wine are the only legacy of Windows in future
    - I'm really frustrated by Github Actions Windows CI build failure that has little information to debug

#compiler #gpu #llvm #news #os #render #sec #shader #software #vulkan
- A new PNG spec
    - I'm thinking about preserving the most valuable photos in minimal size, encrypted, stored in public repo, and the format might be just png
- #ai-safety
    - #copyright
        - Anthropic wins a major fair use victory for AI — but it’s still in trouble for stealing books
        - Against AI: An Open Letter from Writers to Publishers (on HN)
    - LLM code generation may lead to an erosion of trust
    - AI Is Dehumanization Technology
    - Amazon's Emissions Climbed 6% in 2024 on Data Center Buildout (on HN)
- #time
    - Assembly Theory of Time
        - time is a measurable physical entity, with complex objects' formation paths and "assembly indexes" revealing time's unidirectional depth and causal chains
    - How to Think About Time in Programming
    - Managing time when time doesn't exist
- #cg
    - TinyRenderer: Software rendering in 500 lines of bare C++ (code)
    - Porting GPU shaders to Rust GPU 30x faster with AI
    - CUDA Ray Tracing 2x Faster Than RTX: My CUDA Ray Tracing Journey
    - Chili3D: A web-based 3D CAD application for online model design and editing
- #rust
    - Why is the Rust compiler so slow? (on HN) (on lobste.rs)
        - a lot of useful tools to debug rust compilation process
        - see also Performance Debugging with LLVM-mca: Simulating the CPU
            - found LLVM MCA Daemon on HN
    - Cross-Compiling 10,000+ Rust CLI Crates Statically
    - How much code does that proc macro generate?
    - compilation time
        - Subsecond: A runtime hotpatching engine for Rust hot-reloading
            - TODO: merge with related work
    - Weird Expressions in Rust (on HN) (on lobste.rs)
- How to Write Compelling Release Announcements

#agent #build #news #os #rust #sqlite #web #zig
- #build
    - Bazel’s Original Sins
    - Chromium's build system is switching from Ninja to Siso for external developers
    - Build an iOS app on Linux or Windows (on HN) (on lobste.rs)
    - Uv and Ray: Pain-Free Python Dependencies in Clusters
    - New comment by acheong08 in "uv: An extremely fast Python package and project manager, written in Rust"
        - I think I might switch from `asdf` to mise, unfortunately it didn't port asdf zig plugin yet
    - JeKa : Next-Gen Build Tool for Java & Co. #build #jvm
    - XSLT – Native, zero-config build system for the Web
    - Mill: A better build tool for Java, Scala, and Kotlin (on HN)
- Interesting Bits of Postgres Grammar
    - found Geometric Functions and Operators
- #tui
    - fclones - finds and handles duplicate files across directories
    - tatuin - aggregates TODOs from various sources
    - alden: detachable terminal sessions without breaking scrollback - only a source tarball
    - Atuin – Magical Shell History
        - with zsh autocomplete and just, I thought I didn't need it, but maybe I need it so that history won't be easily lost, they could form a story of what I was experimenting
    - Can your terminal do emojis? How big?
        - surprisingly old protocol for this
- Everyone should copy Thunderbird's donation model
    - it asks for donation with low frequency (yearly), and good timing (Chrismas?)
- Retrieval Augmented Generation Based on SQLite
    - I do prefer RAG on SQLite, need to try it out
- The Bitter Lesson is coming for Tokenization
    - but how to part with tokenization?
- Phoenix.new is Fly's entry into the prompt-driven app development space
    - I need to give it and fly.io a try

#game #news #os #rust #tla #typst #zig #✍️
- How I use my terminal
    - the author explains how things work, especially for those that people are surprised to find possible at all
- I wrote my PhD Thesis in Typst (on HN) (on lobste.rs)
    - it's an unusual journey, the author fought through the process by
        - writing a recursive descent parser in Typst for custom code syntax highlighting
        - death by a thousand papercuts for bibliography management
        - writing a tool to convert Typst to LaTeX for submitting paper to LaTeX only journal
        - the advisors perspective is also informative
- Nano-Vllm: lightweight vLLM implementation built from scratch
    - I would wonder if I could do this in Zig
- #lang
    - Cyber Programming Language
        - written in Zig
        - fast, efficient, and concurrent scripting
        - faster than Wren (written in C & Wren) that are used in game engine
    - Pallene Language
        - a statically typed and ahead-of-time compiled sister language to Lua
- Announcing the Clippy feature freeze (on HN) (on lobste.rs)
    - an inspiring way to allow the team to have a period of time for repaying tech debts
- learn about Git Notes: Git's coolest, most unloved­ feature (2022)
- found LeetCode for System Design
- #go
    - Go should be more opinionated
    - Go is an 80/20 language
    - How to store Go pointers from assembly (on HN) (on lobste.rs)
    - Why Go Rocks for Building a Lua Interpreter
    - writing a little gosh