Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Here are some tests that use it:
test_trainer_distributed.py
test_deepspeed.py
To jump right into the execution point, search for the execute_subprocess_async call in those tests.