All of joseph_c's Comments + Replies

Have you experimented with subtracting  from the loss? It seems to me that doing so would get rid of the second term and allow the model to learn the correct vectors from the beginning.

1Adam Jermyn3h
That's not a scalar, do you mean the trace of that? If so, doesn't that just eliminate the term that causes the incorrect initialization to decay?

I thought masters' theses were supposed to be about new research (and maybe bachelor theses too?). Is this not the case?

That would depend on the university's rules and customs. I think a general rule of thumb might be that a bachelor's thesis may contain new research, a master's thesis should, and a doctoral thesis must.

Is this serious? I find it somewhat ironic that your deontology is completely closed-minded on its belief about narrow-mindedness.

I don't think being somewhat ironic would be slightly worse than being completely insensitive to unfamiliar considerations.

Fact check: Mormons don't go on missionaries until they are at least 18 for men and 19 for women.

Missionaries can be single men between the ages of 18 and 25, single women over the age of 19 or retired couples. Missionaries work with a companion of the same gender during their mission, with the exception of couples, who work with their spouse. Single men serve missions for two years and single women serve missions for 18 months.


Also, ever since the most recent transfer of power, Mormons h... (read more)

Oh I'm well versed in the horrors of contemporary religious tradition and ritual. The idea was always to mimic the good without the bad. The tradition itself would never be good, it would be the end to which it serves that makes it good. This ideally keeps traditions in check.

Your outline has a lot of beliefs you expect your students to walk away with, but basically zero skills. If I was one of your prospective students, this would look a lot more like cult indoctrination than a genuine course where I would learn something.

What skills do you hope your students walk away with? Do you hope that they'll know how to avoid overfitting models? That they'll know how to detect trojaned networks? That they'll be able to find circuits in large language models? I'd recommend figuring this out first, and then working backwards to figure ou... (read more)

Thanks for your answer! This is about... I wouldn't say "beliefs" - I will make a lot of caveats like "we are not sure", "there are some smart people who disagree", "this is an arguments against this view", etc. (mental note: do it MORE, thank you for your observation) - but about "motivation" and "discourse". Not about technical skills, that's true. I have a feeling that there is an attractor "I am AI-researcher and ML is AWESOME, and I will try to make it even more AWESOME, and yes, there are this safety folks and I know some of their memes and may be they have some legitimate concerns, but we will solve it later and everything will be OK". And I think that when someone learns some ML-related technical skills before basic AI Safety concepts and discourse, it's very easy for them to get into this attractor. And from this point it's pretty hard to return back. So I want to create something like a vaccine against this attractor. Technical skills are neccesary, but for most of them there are already good courses, textbooks and such. The skills I saw no texbooks for are "to understand AIsafetyspeak" and "to see why alignment-related problem X is hard and why obvious solutions may not work". Because of the previously mentioned attractor I think it's better to teach this skills before technical skills. I make an assumption that average 15-16-year-olds in my target audience know how to program at least a little bit (In Russia basic programming in theory is in the mandatory school program. I don't know about US), but don't know calculus (but I think smart school student can easily understand a concept of a derivative without strict mathematical definition).

No, I don't. The resources I saw on a quick Google search were rather poor as well.

Have you heard about pseudoentropy? The pseudoentropy of a distribution is equal to the highest entropy among all computationally indistinguishable distributions. I think this might be similar to what you're looking for.

1Adam Shai1mo
No I haven't! That sounds very interesting, I'll definitely take a look, thanks. Do you have a particular introduction to it?

Also by buying off or convincing those who think they have concentrated benefits that they are wrong and should stand down, as even they get more benefit from ending the diffuse costs.

This really doesn't seem like a good way to get politics done. Is this even legal? And if it is, do you really think it makes the government better to have people effectively bribing politicians?

Those benefitting are usually not politicians, they're commercial interests who make money from the status quo. They will oppose efforts that cause them to lose money even if the change is a net good overall, but you can quiet them down by giving them a bunch of money. Typically doing so is still a net good, because the cost of buying off the opposition is (usually) less than the value gained by the rest of society.

Perhaps the verb "buy off" is not the best one here, but I'm not sure what else you'd use. If you're morally offended by the idea of offering payments to lessen the sting for people who suffer a concrete downside from your policies then, uh, don't go into politics I guess.

This sentence refers to interest groups, not to politicians or officials. It refers to unions, who want bargaining power, and union members, who want stable jobs and good pay. Or to businesses with a captive market, like American shipbuilders and dredge operators. These groups think they are getting a payoff from status quo, and it is one they want to keep. The solution is therefore to match the payoff under the new proposal, or persuade them (of the truth that) they are not actually getting the payoff they think.

What Marc Andreessen has been reading. I am envious of those who get to read this many books, let alone Tyler Cowen levels of reading books. No idea how to make the time for it.

Have you considered reading Twitter less and replacing that with books?

Could I point out that avoiding head injuries might not be the only reason you wouldn't want your children to play football? You might also not want your child to adopt the culture that a lot of high school football teams have (partying, not caring about school, self-centered), which can happen quite easily if they're around football kids 3 hours/day 6 days/week.

Fair enough. Certainly schools have that, other schools have different cultures as well (but I'd guess the average is closer to your thought). Likely a different vibe from track/cross-country and marching band for sure. (Which isn't too say you don't have people that crossover/differences).

I don't think so. I've also done the foobar challenge in the last year or so, and got nada from them.

I remember reading about a startup that is basically using LLMs to let you navigate through websites quicker. I'll edit this comment if I remember what it is.

Adept. []

I know you're joking, but I'd like to clarify that Jesus actually said "Let he who is without sin cast the first stone," in case some future archeologist who doesn't know anything about 21st century religions uncovers this article. Nukes didn't exist in the first century A.D.

With Obsidian, I think you can get the Excalidraw plugin to draw images, though it's not inline (it opens a new pane).

You can also use Numba to speed up loops.  It's still slower than C, but it's much better than plain Python code, and it's really easy to implement (just import  numba and put a @numba.njit() before your function).

Why did you decide to only use rotation matrices instead of any invertible matrix?  If you're trying to find a new basis to work in, wouldn't any invertible matrix work just as well?

I agree with your fundamental claim that there are lots of top tier students going to non-top schools, but I think you focused too much on SAT scores and GPA.  Right now, there are so many kids getting top scores (about 5,500 students every year get a 36 on the ACT, and about 4500 students get a at least a 1570 on the SAT), test scores just aren't enough to determine who gets in.  Instead, admissions officers use a "holistic" approach, which seems rather noisy, but does factor in other real accomplishments, like getting to the IMO or starting a m... (read more)

I'm not sure how you concluded that James 5:12 says you should not lie under any circumstances.  I've always interpreted it as condemning giving oaths, especially oaths on things you have no control over.

But above all things, my brethren, swear not, neither by heaven, neither by the earth, neither by any other oath: but let your yea be yea; and your nay, nay; lest ye fall into condemnation. (James 5:12)

Did you mean to quote somewhere else?

2Isaac King7mo
From the "interpretation" section of the link I provided:

(To Policymakers and Machine Learning Researchers)

Building a nuclear weapon is hard.  Even if one manages to steal the government's top secret plans, one still need to find a way to get uranium out of the ground, find a way to enrich it, and attach it to a missile.  On the other hand, building an AI is easy.  With scientific papers and open source tools, researchers are doing their utmost to disseminate their work.

It's pretty hard to hide a uranium mine.  Downloading TensorFlow takes one line of code.  As AI becomes more powerful and more dangerous, greater efforts need to be taken to ensure malicious actors don't blow up the world.

Imagine playing your first ever chess game against a grandmaster. That's what fighting against a malicious AGI would be like.

Donald Knuth said, "Premature optimization is the root of all evil."  AIs are built to be hardline optimizers.

Source:  Structured Programming with go to Statements by Donald Knuth

Humans have biases they don't even realize.  How can we verify an AI lacks such biases?