Foreword We will continue where we left off. In the last post, I introduced a few important observables along with the setup. We are interested in their asymptotics, and the behaviors of these random variables. But before we dive into them, we first see some motivation for their definitions, and...
Introduction There are some very nice resources to understand the intuition of Singular Learning Theory. However, I am quite unsatisfied with the current resources online explaining or approaching the subject, as I find them quite concise and brief - skipping many concepts that actually serve to strengthen the intuition to...
Inspired by the paper Modifying LLM Beliefs with Synthetic Document Finetuning, I fine-tuned an AI model to adopt the personality of a detective and generate unfaithful Chain-Of-Thought (CoT) in order to conceal their true investigative intent, and be able to solve mystery cases. The project primarily investigates two questions: 1....