Plans for doing the 70B as well?

#2
by Doctor-Shotgun - opened

I've been enjoying the 70B instruct abliterated - any plans on doing the expanded dataset abliteration for the larger model as well?

Very interested in doing so, but considering it's quite costly for me to do given I ideally need to perform the abliteration on a non-quant version, I want to refine out some quirks noticeable in the 8B first; particularly hallucinations. Once I feel the methodology is just a bit more refined on the 8B, I'm very open to doing 70B.

Sign up or log in to comment