Protein language models don't learn meaningful representations of CDRH3 loops
A recent paper found that protein language models (PLMs) organize their per-protein representations into a relatively compact portion of their latent space, leaving other parts of the representation space filled with what the authors call a "junkyard" of unsortable sequences[1]. Astral40R refers to proteins whose sequences