Michał Chromiak's blog

The 2026 male fruit fly connectome links brain and nerve cord in one open map. New studies compare male and female circuits, trace vision and taste pathways, and test social-behavior predictions. Here is how those results differ from digital-fly game demos.

View comments.

Some AI tasks need a bounded judgment, not generated prose. Jev and Laya illustrate how decision models turn textual state and defined answer spaces into probability distributions. This guide explains the shared pattern, where the implementations differ, what their benchmarks establish, and how to evaluate them in an agentic workflow.

View comments.

Atlas combines text, images, camera poses, and depth in a shared spatial context. This guide explains what that means, how its autoregressive diffusion architecture works, what World Labs has demonstrated, and what remains unknown.

View comments.

Dragon Hatchling connects a high-dimensional linear-attention state-space model to local graph dynamics. This guide explains the recurrence, the qualified relationship between BDH and BDH-GPU, the Europarl scaling results, and the limits of the paper's claims about interpretability, long context, model composition, and biological plausibility.

View comments.

I-JEPA learns visual features by predicting the representations of hidden image regions, rather than reconstructing their pixels. This guide explains the context encoder, target encoder, predictor, and masking strategy, then examines what the paper's accuracy and efficiency results actually measure.

View comments.

QLoRA makes large language models cheaper to fine-tune by storing the base model in 4 bits and training small, higher-precision adapters. This guide explains LoRA, NormalFloat, double quantization, and paged optimizers, then puts the Guanaco chatbot results in context.

View comments.

DINOv2 trains Vision Transformer encoders on 142 million curated images without using labels or captions in its pretraining objective. This guide explains how image-level self-distillation, masked patch prediction, feature-spreading regularization, data curation, and distillation combine to produce features that transfer across classification, retrieval, segmentation, and depth estimation.

View comments.

CoLT5 processes every input token with lightweight layers and gives selected tokens additional, higher-capacity computation. This guide explains its learned routing, light and heavy branches, faster decoding, and experiments with inputs up to 64k tokens.

View comments.

LoRA adapts a pretrained model by training small, low-rank updates while keeping its original weights fixed. This guide explains the two-matrix construction, the memory and storage savings, the conditions for merging adapters, and the connection to QLoRA.

View comments.

A masked autoencoder (MAE) learns visual representations by reconstructing missing image patches from a small visible subset. It divides an image into regular non-overlapping patches, samples patches uniformly without replacement, removes the masked patches before the encoder, and inserts learned mask tokens only for the lightweight decoder. With a 75% masking ratio, the encoder processes just 25% of the patches. This asymmetric design reduces training time and memory, enabling ViT-Large and ViT-Huge models to scale on ImageNet-1K. A ViT-Huge model pretrained for 1600 epochs and fine-tuned at 448-pixel resolution reaches 87.8% ImageNet-1K top-1 accuracy.

View comments.