Applied AI·How models work
when you offload part of a model, or read its config, or watch it load, the unit being counted is one layer of dozens.
Layer
Draft summary, pending review
One processing stage in the network. A token's representation passes through dozens of layers, each refining it. Frontier models stack on the order of 30 to 100+ transformer layers.