This is great to see laid out! I've done this kind of work for around a decade as well, but the logistics of assembling it into a full analysis has not passed a cost-benefit calculation.
How much of your process would you say is scalable/generalizable vs your own ad hoc refinement with LLMs? I think a general method or chain of prompts would be useful for others.
Unrelated, but I hadn't seen your work on diagramming before. I do something similar, but as a causal loop diagram. I think the main difference is that yours look like the have a set source/sink, while I've found most of my problems have more sustaining feedback structure. I'll also put +/- for the sign of the effect. Maybe just a difference in the problems themselves.
If you’re anything like me, you may have a lot of notes from various introspective activities – annual / monthly reviews, worksheets, therapy notes, etc. Often these notes are just gathering dust in a paper folder or some forgotten corner of Google Drive. There may be some insights there – how personal problems change over time, what things you tried and what worked and didn’t, and so on. One use case for capable AI models is to sift through this data and extract patterns, insights and interesting tidbits that you may have forgotten or not noticed.
Here are some things I got AI to do for this analysis:
Claude Opus 5 and Fable did a pretty good job at this. Fable had a tendency to over-compress its findings, and I had to ask it to use simpler language. I also tried this 1-2 years ago, and I think the models are getting better at picking up non-obvious patterns.
Learnings about problems and patterns
Here are some patterns I found in my answers to Hamming questions over the past 10 years:
One thing I learned from this is that some of my persistent problems appeared in different guises or with different causes. These days I mostly attribute tiredness, lack of sleep and feeling overwhelmed to the demands of parenting, but looking back at my notes from 2015-17 this was just as much of an issue (if not more) before I had kids. There are internal and external factors affecting sleep, and the external factors have increased after having kids, but the internal factors are pretty stable and the same habits are still useful (e.g. put away screens and wind down after 10pm).
Overwhelm was a recurring feeling triggered by different things (finishing my thesis, balancing research and outreach, taking care of a baby, etc) which seemed like a mental pattern that attached itself to life circumstances rather than a fact about those circumstances. I had a default response to having a lot of stuff going on with a sense of shame about not doing everything or comparing myself to others, and this made me feel overwhelmed (while the same circumstances did not feel as overwhelming when I gave myself permission to drop things).
There were several persistent feedback loops between problems (which became weaker over time).
Comparing my bottleneck diagram from 2015 with one from 2025, there are some nodes in common (“should” mindset, confidence, anxiety) and some things that did not persist (neglecting internal signals, working memory, excessive effort, insomnia), which mostly map to solved problems. There are some new kid-related nodes though (“stress with kids” and “reduced alone time”).
2025 bottleneck diagram
2015 bottleneck diagram
Learnings about approaches and solutions
There were various things that worked in the past that would be good to try again or do more often:
There were also things that I tried several times that didn’t work:
I identified some meta-principles on things that tend to work for me:
Overall, the benefits I got from doing this kind of analysis can be broken down in two ways: looking at problems or approaches, and whether what I did was successful or not. I think each of these categories can be worth a deep dive with some AI help.
Successful
Unsuccessful
Problems
Noticing problems that I successfully fixed or improved and appreciating that.
Noticing problems that have recurred despite various interventions, and reflecting on why.
Approaches
Being reminded of things that worked before that I forgot about.
Identifying things that repeatedly didn’t work in the past and probably need a different approach.
Appendix: prompts I used for this analysis
I did this in two separate conversations, since the amount of context was too much for one conversation.
Conversation 1: analyzing problems and patterns based on life reviews
Inputs
Stage 1 — transcription
I will scan some documents, please transcribe and put in a doc. Flag particularly illegible words as [unclear] rather than guessing.
(Then uploading photos in batches, one worksheet at a time.)
[I would recommend reviewing the transcriptions to correct things the AI failed to parse before moving on.]
Stage 2 — identifying patterns in worksheets
Look over these worksheets over the years and identify key patterns.
Can you make some tables of how these patterns show up over time? (rows = years)
For each question on the worksheet, summarize the answers to that question each year, and put them in a table.
I find your summaries a bit hard to follow, they are dense and overcomplicated. Focus on key insights and explain them in simpler language.
Make tables with verbatim answers to each question from each year (not summarized), and put into a doc.
Stage 3 — adding other sources
Here is a file with notes from my annual / quarterly reviews. Look over these, summarize different exercises / reflections and how they evolve year by year. Connect with the worksheets in that year.
I added a doc with a timeline of significant events in my life. Please analyze how these events relate to my answers over time.
Can you regenerate the per-question tables with some commentary on connection to these events?
Stage 4 — bottleneck diagrams
I also have these diagrams of the relationships between my problems over the years. Think about patterns in how the problem dynamics changed, connecting this to patterns in the worksheets and timeline. Explain in simple language.
Please redraw them digitally, like the first diagram. Also make a table with rows for years, columns for nodes, recording how many in and out edges the node has.
Some years I filled out the sheet but didn't make a diagram. Can you make a diagram based on sheets and annual review for each year? Make these with weighted edges (light / medium / heavy for how strong the relationship is between those nodes). Then give me an updated analysis for how the loops and key nodes evolved over time.
Stage 5 — deep dives
Go into [specific findings] in more detail.
How do the [X] and [Y] loops relate / connect to each other? Did this change over time?
Regarding levers, were there specific ideas / techniques / intentions that came up in these reviews that I may have dropped or forgotten? E.g. things that worked in the past.
I want to understand the [X] loop better. I can see how [mechanism A] will increase [B], but why does this result in [C]?
Conversation 2: learning about what approaches worked and didn't based on therapy / coaching notes
Inputs
Prompts
Review my therapy and coaching notes, and identify patterns in suggestions and ideas, especially things that have worked before that I may want to try again.
Here is a meta principle I identified from these insights about what kind of things work for me: habits that stick are usually attached to an existing routine. Any others you would suggest?
For the principles and ideas that worked before but lapsed, identify the difficulties I had implementing these, and how I could make it more likely to work in future.
Zoom into 'trying the physical fix first'. Give me an extensive list of physical fixes I tried or considered.
Make a list of stuff I tried that didn't work, especially if it came up several times.