Any plans on changing LLAMA3.1 to something with Apache 2.0 license?

#7
by natalie5 - opened

Since LLAMA 3.1 has a restrictive license, are there any plans on finetuning your model with an open license LLM such as Qwen, IBM-Granite, etc which has Apache 2.0 license. Then we could have a truly open source model where every component is open source.

HiDream.ai org

@natalie5 Thanks. Removing Llama in the current version is challenging. Simply dropping it leads to poor results, and replacing it with other LLMs hasn't been investigated and we don't have short-term plans to finetune this model version. If you've experimented with this, please share your findings.

@natalie5 Thanks. Removing Llama in the current version is challenging. Simply dropping it leads to poor results, and replacing it with other LLMs hasn't been investigated and we don't have short-term plans to finetune this model version. If you've experimented with this, please share your findings.

The model with MIT license is great, but LLAMA having a restrictive license prevents anyone from using it commercially. I was hoping for you guys to use a LLM that doesn't have a restrictive license as a text encoder. Using LLAMA was a plain mistake to be honest. Many researchers are not happy with the model using a LLM that has a restrictive license. The only major problem with your model currently is LLAMA. I was hoping you guys would be able to adopt a better licensed LLM for it since it requires a lot of compute.

Thanks for your work cai-qi! Lots of complaining in the comments, lol.

Just wanted to say the model is fantastic and very much appreciated!!

Thanks for your work cai-qi! Lots of complaining in the comments, lol.

Just wanted to say the model is fantastic and very much appreciated!!

I literally said it's a great model in the first line. Pointing out and questioning about issues isn't complaining, it's just a discussion with the dev.

The model with MIT license is great,

The models use also appears to be governed by:
You own all content you create with this model. You can use your generated content freely, but you must comply with this license agreement. You are responsible for how you use the models. Do not create illegal content, harmful material, personal information that could harm others, false information, or content targeting vulnerable groups.

https://huggingface.co/HiDream-ai/HiDream-I1-Full/discussions/2#67f4d1ca93b8bb3454d04c2c

@cai-qi why no plans to further finetune this model?

LLAma 3.1 License:
“2. Additional Commercial Terms. If, on the Llama 3.1 version release date, the monthly active users
of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700
million monthly active users in the preceding calendar month, you must request a license from Meta,
which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the
rights under this Agreement unless or until Meta otherwise expressly grants you such rights.”

I tried to use Mistral-7B-v0.3(Apache-2 license) as a text encoder. It can generate image, but the image is a noise image... Maybe we need to fully retrain the DiT model...

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment