Very nice post! Just want to share that we recently had a graphical formalism that could represent any tensors and reason about them by diagrammatic rewriting,  as shown in the following paper:

https://arxiv.org/abs/2309.13014