Skip to content

Improve explain Chinese prompt#131

Open
mreichhoff wants to merge 8 commits intomainfrom
update-explain-chinese
Open

Improve explain Chinese prompt#131
mreichhoff wants to merge 8 commits intomainfrom
update-explain-chinese

Conversation

@mreichhoff
Copy link
Owner

No description provided.

@github-actions
Copy link

🧪 AI Evaluation Results

collocation

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 4/4 (100%) 100.0%
englishTranslationPresent ✅ 4/4 (100%) 100.0%
outputStructureValid ✅ 4/4 (100%) 100.0%

explain chinese

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 70/70 (100%) 100.0%
validPinyinFormat ✅ 70/70 (100%) 100.0%
grammarExplanationQuality 🟡 69/70 (99%) 95.7%
outputStructureValid ✅ 70/70 (100%) 100.0%

explain english

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 75/75 (100%) 100.0%
validPinyinFormat ✅ 75/75 (100%) 100.0%
grammarExplanationQuality 🟡 69/75 (92%) 93.3%
outputStructureValid ✅ 75/75 (100%) 100.0%

generate sentences

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
validPinyinFormat ✅ 5/5 (100%) 100.0%
sentenceGenerationQuality 🟡 4/5 (80%) 88.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

word context

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
englishTranslationPresent ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

📦 Download full results

@github-actions
Copy link

🧪 AI Evaluation Results

collocation

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 4/4 (100%) 100.0%
englishTranslationPresent ✅ 4/4 (100%) 100.0%
outputStructureValid ✅ 4/4 (100%) 100.0%

explain chinese

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 70/70 (100%) 100.0%
validPinyinFormat ✅ 70/70 (100%) 100.0%
grammarExplanationQuality 🟡 67/70 (96%) 95.1%
outputStructureValid ✅ 70/70 (100%) 100.0%

explain english

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 75/75 (100%) 100.0%
validPinyinFormat ✅ 75/75 (100%) 100.0%
grammarExplanationQuality 🟡 71/75 (95%) 92.8%
outputStructureValid ✅ 75/75 (100%) 100.0%

generate sentences

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
validPinyinFormat ✅ 5/5 (100%) 100.0%
sentenceGenerationQuality ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

word context

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
englishTranslationPresent ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

📦 Download full results

@github-actions
Copy link

🧪 AI Evaluation Results

collocation

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 4/4 (100%) 100.0%
englishTranslationPresent ✅ 4/4 (100%) 100.0%
outputStructureValid ✅ 4/4 (100%) 100.0%

explain chinese

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 70/70 (100%) 100.0%
validPinyinFormat ✅ 70/70 (100%) 100.0%
grammarExplanationQuality 🟡 68/70 (97%) 96.6%
outputStructureValid ✅ 70/70 (100%) 100.0%

explain english

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 74/74 (100%) 100.0%
validPinyinFormat ✅ 74/74 (100%) 100.0%
grammarExplanationQuality 🟡 67/74 (91%) 90.8%
outputStructureValid ✅ 74/74 (100%) 100.0%

generate sentences

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
validPinyinFormat ✅ 5/5 (100%) 100.0%
sentenceGenerationQuality ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

word context

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
englishTranslationPresent ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

📦 Download full results

@github-actions
Copy link

🧪 AI Evaluation Results

collocation

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 3/3 (100%) 100.0%
englishTranslationPresent ✅ 3/3 (100%) 100.0%
outputStructureValid ✅ 3/3 (100%) 100.0%

explain chinese

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 70/70 (100%) 100.0%
validPinyinFormat ✅ 70/70 (100%) 100.0%
grammarExplanationQuality 🟡 68/70 (97%) 96.6%
outputStructureValid ✅ 70/70 (100%) 100.0%

explain english

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 69/69 (100%) 100.0%
validPinyinFormat ✅ 69/69 (100%) 100.0%
grammarExplanationQuality 🟡 65/69 (94%) 95.7%
outputStructureValid ✅ 69/69 (100%) 100.0%

generate sentences

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 3/3 (100%) 100.0%
validPinyinFormat ✅ 3/3 (100%) 100.0%
sentenceGenerationQuality ✅ 3/3 (100%) 100.0%
outputStructureValid ✅ 3/3 (100%) 100.0%

word context

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
englishTranslationPresent ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

📦 Download full results

@github-actions
Copy link

🧪 AI Evaluation Results

collocation

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 4/4 (100%) 100.0%
englishTranslationPresent ✅ 4/4 (100%) 100.0%
outputStructureValid ✅ 4/4 (100%) 100.0%

explain chinese

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 70/70 (100%) 100.0%
validPinyinFormat ✅ 70/70 (100%) 100.0%
grammarExplanationQuality 🟡 68/70 (97%) 97.1%
outputStructureValid ✅ 70/70 (100%) 100.0%

explain english

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 75/75 (100%) 100.0%
validPinyinFormat ✅ 75/75 (100%) 100.0%
grammarExplanationQuality 🟡 70/75 (93%) 94.9%
outputStructureValid ✅ 75/75 (100%) 100.0%

generate sentences

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
validPinyinFormat ✅ 5/5 (100%) 100.0%
sentenceGenerationQuality ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

word context

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
englishTranslationPresent ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

📦 Download full results

@github-actions
Copy link

🧪 AI Evaluation Results

collocation

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 4/4 (100%) 100.0%
englishTranslationPresent ✅ 4/4 (100%) 100.0%
outputStructureValid ✅ 4/4 (100%) 100.0%

explain chinese

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 70/70 (100%) 100.0%
validPinyinFormat ✅ 70/70 (100%) 100.0%
grammarExplanationQuality 🟡 68/70 (97%) 96.3%
outputStructureValid ✅ 70/70 (100%) 100.0%

explain english

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 75/75 (100%) 100.0%
validPinyinFormat ✅ 75/75 (100%) 100.0%
grammarExplanationQuality 🟡 70/75 (93%) 94.9%
outputStructureValid ✅ 75/75 (100%) 100.0%

generate sentences

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
validPinyinFormat ✅ 5/5 (100%) 100.0%
sentenceGenerationQuality ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

word context

Evaluator Pass Rate Avg Score
chineseTextPresent ✅ 5/5 (100%) 100.0%
englishTranslationPresent ✅ 5/5 (100%) 100.0%
outputStructureValid ✅ 5/5 (100%) 100.0%

📦 Download full results

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments