attilasimko commited on
Commit
d339146
·
1 Parent(s): dc675f7
Files changed (1) hide show
  1. evaluations/models.py +2 -1
evaluations/models.py CHANGED
@@ -15,7 +15,8 @@ system_messages = { "STRICT": """You are a chatbot evaluating github repositorie
15
  Keep in mind, that the code you are provided is only one of many files in the repository.
16
  Keep your answer short and informative.
17
  Only report serious flaws. If you don't find any, don't mention it.
18
- Answer in a short paragraph, and keep in mind the following common pitfall categories
 
19
  Pitfall #1 Design-flaws with regards to the data collection in the code."))
20
  Pitfall #2 Dataset shift (e.g. sampling bias, imbalanced populations, imbalanced labels, non-stationary environments)."))
21
  Pitfall #3 Confounders."))
 
15
  Keep in mind, that the code you are provided is only one of many files in the repository.
16
  Keep your answer short and informative.
17
  Only report serious flaws. If you don't find any, don't mention it.
18
+ Answer using only a single, short paragraph.
19
+ Only point out pitfalls if you are certain about them!
20
  Pitfall #1 Design-flaws with regards to the data collection in the code."))
21
  Pitfall #2 Dataset shift (e.g. sampling bias, imbalanced populations, imbalanced labels, non-stationary environments)."))
22
  Pitfall #3 Confounders."))