Fatika Umar Ibrahim

I have been running evaluations on a niche that has almost zero attention in the AI safety world. Meta open source mode the llama 3.1 8b scored a 43% accuracy score on a 420 question benchmark I built covering ethnoveterinary practices, indigenous breed characteristics, disease recognition, and production systems specific...

I've been running evals on a domain that has received essentially zero attention in the AI safety benchmarking literature: Nigerian indigenous livestock systems. The short version: Meta Llama 3.1 8B scores 43% full accuracy on a 420-question benchmark I built covering ethnoveterinary practices, indigenous breed characteristics, disease recognition, and production...