Learning diary › Year 2025 › June, 2025 › 2025-06-09 [2025-06-09]

✍️source

#agent #datafusion #docker #duckdb #elixir #formal #harbor #idea #json #lemmy
- #selfhost
    - Ditching HAProxy (in my homelab)
        - found Ran out of infrastructure titles from the author
            - backrest
                - for using `restic` to manage backup repos and plans
                - tested that `restore` and `mount` work, as well as encryption and compression
                    - see also Running Veracrypt in Docker
                        - `--privileged`, `-m=nokernelcrypto`, locale etc.
                - supports monitoring via Healthchecks if backup jobs don't "check in"
                - a sec review: restic cryptography
            - MetalLB, a load-balancer implementation for bare metal Kubernetes clusters
            - `Talos`, moved to Learning diary › Year 2025 › June, 2025 › 2025-06-10
            - Unbound: a powerful validating, recursive, caching DNS resolver
                - could be used for home network
            - Salt with its GUI
                - is similar to Ansible, in the sense you use YAML to specify a state, but has a differening architecture, opting for a master/minion setup rather than Ansible's agentless SSH connections to each node
            - Apt-Cacher NG for caching apt packages
            - Harbor for caching container images
            - Headscale: self-hosted implementation of the Tailscale control server
            - Pocket ID for authenticate users with their passkeys
- #fediverse
    -Two Approaches to Solving the “Quiet Fediverse” Problem: Conversation Backfilling Mechanisms
    - The fediverse, explained
        - Lemmy
        - Pixelfed
        - BookWyrm
        - PeerTube
    - Pleroma: a lightweight federated social networking server powered by Elixir and PostgreSQL
        - from What Is Pleroma?
    - From Fediverse to Creating Personal Digital Space with Memos
        - Single-user Mastodon Instance is a Bad Idea
    - jakeg -> notes -> fediverse
    - ActivityPods: Personal data spaces powered with ActivityPub
    - tried matrix again and found a good TUI: iamb
    - Threads is adding Fediverse content to social feeds
- wish to test x86 on ARM Mac
    - due to Zig's self-hosted x86 backend is now default in Debug mode
    - found Intel-on-ARM and ARM-on-Intel with lima
    - container: tool for creating and running Linux containers using lightweight virtual machines on a Mac
- AI at Amazon: a case study of brittleness
    - that's how things got stuck in a big org, or at least slowed down enought to suffocate innovation
        - Decompensation: a service fall over after receiving a spike in external requests, mostly due to hierarchical decision-making
        - Working at cross-purposes: introduced an almost Darwinian flavor to org dynamics where teams scrambled to get their work done to avoid getting reorged and subsumed into a competing team
        - Getting stuck in outdated behaviors: had to constantly justify our existence and massage our projects with metrics that could be seen as more customer-facing
- Thank You, DataFusion: Queries in Rust, Without the Pain
    - SQL as a library, not a service
    - own your storage, your execution model, your schema, your optimizer
    - offers [SQL] and [Dataframe] APIs, excellent performance, built-in support for CSV, Parquet, JSON, and Avro
    - paper: Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine
    - should take a deep look into DuckDB
- found Black Hat Zig: Zig for offensive security.
- Training a Rust 1.5B Coder LM with Reinforcement Learning (GRPO) | Oxen.ai