Articles for tag fine-tuning
-
Would Fine-Tuning Have Beaten Jev?The third post in my series on describing a classifier with Jev versus training one. This time I fine-tuned BERT on the same Jigsaw toxicity comments. With enough labels it ranks toxic comments better than Jev and the cloud-embedding models, but it needs about 500 labels to pass Jev, a GPU to train, and it misses almost every comment on the two rarest labels.