A self-perpetuating conformational conversion of the prion protein (PrP) is believed to underlie pathology and transmission of prion diseases. Here we explore the effects of N-terminal pathogenic mutations (P102L, P105L, A117V) and the residue 129 polymorphism on amyloid fibril formation by the human PrP fragment 23-144, an in vitro conversion model that can reproduce certain characteristics of prion replication such as strains and species barriers. We find that these amino acid substitutions neither affect PrP23-144 amyloidogenicity nor introduce barriers to cross-seeding of soluble protein. However, the polymorphism strongly influences the conformation of the amyloid fibrils, as determined by infrared spectroscopy. Intriguingly, unlike conformational features governed by the critical amyloidogenic region of PrP23-144 (residues 138-139), the structural features distinguishing M129 and V129 PrP23-144 amyloid fibrils are not transmissible by cross-seeding. While based only on in vitro data, these findings provide fundamental insight into the mechanism of prion-based conformational transmission, indicating that only conformational features controlling seeding specificity (e.g., those in critical intermolecular contact sites of amyloid fibrils) are necessarily transmissible by cross-seeding; conformational traits in other parts of the PrP molecule may not be “heritable” from the amyloid template.