AIxBio Africa is looking for a volunteer Director of Research (AI safety and biosecurity) Hi everyone, I'm the founder of AIxBio Africa, a research and capacity building organization working at the intersection of AI safety, biology, and biosecurity, with a particular focus on African contexts. We're looking for a Director...
I have been running evaluations on a niche that has almost zero attention in the AI safety world. Meta open source mode the llama 3.1 8b scored a 43% accuracy score on a 420 question benchmark I built covering ethnoveterinary practices, indigenous breed characteristics, disease recognition, and production systems specific...
I've been running evals on a domain that has received essentially zero attention in the AI safety benchmarking literature: Nigerian indigenous livestock systems. The short version: Meta Llama 3.1 8B scores 43% full accuracy on a 420-question benchmark I built covering ethnoveterinary practices, indigenous breed characteristics, disease recognition, and production...