Real Abstraction Without Exchange
David M. Berry "It is by no means self-apparent how a ruling class invariably has at its command the specific form of mental labour which it requires. And although by its roots it is obviously bound up with the conditions underlying the class rule the mental labour of a particular epoch does require a certain independence to be of use to the ruling class. Nor are the bearers of the mental labour, be they priests, philosophers or scientists, the main beneficiaries of the rule to which they contribute; they remain its servants." Alfred Sohn-Rethel Figure 1: A representation of the vector space of a manifold Every time a text passes through a large language model, the first operation it undergoes is tokenisation, the breaking of language into discrete units. The second is embedding, the mapping of each token to a position in a high-dimensional vector space. During training mode , this operation creates and populates a manifold (the vector space created inside a particular comput...
