Extend length of video which can be processed?
#2
by
Runzhi1949
- opened
What is the maximum video length this model can process?
With the default parameters on an RTX 4090, it can handle videos up to about 6 minutes.
Can this be extended? I’d appreciate any advice on which parameters to adjust (are they all in config.json?).
Are you using our eval.py file for testing? If so, you can refer to the video loading method in tinyllava/eval/eval_mlvu.py and modify the video loading part of tinyllava/eval/run_tiny_llava.py accordingly. On single RTX-4090, it should be possible to run tests on benchmarks like MLVU (which contain videos lasting several hours).
Thanks for your help. I will try to use function like yours to get keyframes in /eval/run_tiny_llava.py tomorrow.