Comparing Novasky with S1: NovaSky by Berkeley club, S1 by Feifei Li (arXiv:2501.19393), are the players who don't have capital or compute, mainly focuses on developing method that finetune a large language model with curated minimal reasoning datasets. Sky-T1 trained an entire model, with datasets from diverse domains, 17K training...
What differentiate us from AI? Human's sense of meaning usually are derived from feeling special, on an individual or collective basis. We want to prove ourselves different through tastes, hobbies, and career choices. Difference also show through collective culture and individual values. Biologically, we are all different from our gene...
Human's sense of meaning usually are derived from feeling special, on an individual or collective basis. We want to prove ourselves different through tastes, hobbies, and career choices. In the past, each of us followed a genetic phenomenon thus we consider each obtains talents, the perceived ability to be gifted...
NovaSky by Berkeley club, S1 by Feifei Li (arXiv:2501.19393), are the players who don't have capital or compute, mainly focuses on developing method that finetune a large language model with curated minimal reasoning datasets. Sky-T1 trained an entire model, with datasets from diverse domains, 17K training examples. S1 is focusing more on test-time scaling which is extending the reasoning time when needed through "wait" token repeatedly when it want to terminate the reasoning. But the datasets used to finetune is much smaller, which is only 1000 chosen questions with detailed reasoning traces. One method is more versatile, the other one is focused on math problem by increasing inference time... (read 1407 more words →)
Human's sense of meaning usually are derived from feeling special, on an individual or collective basis. We want to prove ourselves different through tastes, hobbies, and career choices. Difference also show through collective culture and individual values. Biologically, we are all different from our gene sequence. Our tiny difference creates huge leverage that lead some people to enormous wealth while others stay in poverty. It's important to answer how AI is fundamentally different from us, and what's our value proposition longterm?
I used to assume that AI can't innovate, nor is conscious and have true understanding. After months of inquiries and... (read 2073 more words →)
Human's sense of meaning usually are derived from feeling special, on an individual or collective basis. We want to prove ourselves different through tastes, hobbies, and career choices. In the past, each of us followed a genetic phenomenon thus we consider each obtains talents, the perceived ability to be gifted at something. Our civilization, created cultural tribes, the bigger collective intelligence governed by country. Now, we believe we can enhance our human experience through VR, AR, BCI, and Gene editing to fundamentally break our limits.
I used to not take AI seriously with the deepest assumption that AI can't innovate, or might not be conscious and have true understanding. But then, after months... (read 1842 more words →)