In writing only: email and e-filing

KSTGeneral information, not legal advice

Decision ledger · cross reading

Cross-reading protocol

PRO SE Public Decision Ledger · Blind Independent Reading by a Different Lineage of AI · 2026-10-16

Translated from the Korean original. Read the Korean

Run conditions for the 345 ledger records whose raw responses and comparisons are published.

Primary reading

The primary reading was written by Claude Opus 5.5 after reading the original texts from the National Law Information Center (Holdings, Summary of Decision, order, Reference Provisions, Reference Cases, and the beginning of the reasons). The writing path for each item is in provenance.jsonl.

Claude Message Batches API: 6 batches · 219 requests · US$9.63 at batch pricing.

Blind independent reading

The independent reading received only the same original texts (Holdings, Summary of Decision, order, Reference Cases, Reference Provisions) without seeing the primary reading, and wrote the eight axes on its own.

Model
gpt-6-astra (OpenAI)
Tool
codex-cli 0.161.0, codex exec, read-only sandbox, ephemeral
Reasoning effort
medium

Axis comparison

For the four axes of disposition, form of the decision standard, Relation to precedent, and burden of proof, a mechanical comparison was made of whether the values were the same. For the four axes of issue, decision, decision factors, and open question, the same codex received both readings side by side and determined whether they were of the same substance (this step was not blind). Claude did not participate as an adjudicator in the calculation of the agreement rate.

Decisions without a holding summary

For decisions for which the National Law Information Center original text does not carry a Summary of Decision (holdingSource "issues"), the Holdings were used as the basis for quotation. Both the primary reading and the independent reading received the Holdings, order, Reference Provisions, Reference Cases, and reasons, and the key quotations and decision factors were transcribed verbatim from the Holdings.

Normalisation

Under the notation rules for public documents, the Chinese characters and full-width punctuation in the sentences of the independent reading were deleted or changed to half-width. The original response values remain as they were before tidying in blind-readings.jsonl and adjudications.jsonl.

Instructions as sent

Blind reading instruction
You are a researcher reading Supreme Court decisions independently. In one input file in this folder (designated in the command below) are the National Law Information Center original texts of several decisions. issues is Holdings, holding is the Summary of Decision (summary of the disposition), order is the order, precedents are Reference Cases, and statutes are Reference Provisions. No other person's reading is provided. Read only the original text and, for each decision, determine the following eight axes on your own and answer according to the output schema.

1. issue: the legal question the decision answers, in one sentence, ending in ?.
2. answer: the decision's answer to that question, in one or two sentences.
3. disposition: how the order dealt with the judgment of the court below. One of reversal and remand, partial reversal and remand, reversal and self-adjudication, dismissal, or other. quote is a phrase transcribed verbatim from the order.
4. standard (form of the decision standard): one of states requirements (clarifies the requirements for establishment), totality of circumstances (directs that judgment be made in light of a totality of the circumstances), or Application to the facts (applies the existing standard to this case). Judge by the center of gravity of the Summary of Decision as a whole. quote is a supporting phrase from the holding or the issues, verbatim.
5. factors (decision factors): transcribe verbatim, from the holding or the issues, 2 to 5 things the decision cited as grounds for judgment or factors for consideration.
6. precedent (Relation to precedent): one of change of precedent, follows existing precedent, sets a new standard, or cannot be confirmed. quote is verbatim from the holding or the precedents. If there is no basis, use an empty string.
7. burden (burden of proof): one of prosecutor, the party asserting, the opposing party, or not addressed. Give a value only when the Holdings or Summary of Decision clarifies who must prove what, and otherwise use not addressed and an empty quote.
8. openQuestion: the question the decision left unanswered, in one sentence, ending in ?.

Rules: quote and factors must be exact substrings of the given original text (do not change or shorten any character). Do not use Chinese characters, Japanese kana, full-width punctuation, the middle dot ㆍ, or the dashes —, ·, –. Do not omit any of the decisions in the input, and write caseNo exactly as in the input. Do not modify or create files; output only the answer.
Blind reading instruction (no holding summary)
You are a researcher reading Supreme Court decisions independently. In one input file in this folder (designated in the command below) are the National Law Information Center original texts of several decisions. issues is Holdings, holding is the Summary of Decision (summary of the disposition), order is the order, precedents are Reference Cases, and statutes are Reference Provisions. No other person's reading is provided. Read only the original text and, for each decision, determine the following eight axes on your own and answer according to the output schema.

1. issue: the legal question the decision answers, in one sentence, ending in ?.
2. answer: the decision's answer to that question, in one or two sentences.
3. disposition: how the order dealt with the judgment of the court below. One of reversal and remand, partial reversal and remand, reversal and self-adjudication, dismissal, or other. quote is a phrase transcribed verbatim from the order.
4. standard (form of the decision standard): one of states requirements (clarifies the requirements for establishment), totality of circumstances (directs that judgment be made in light of a totality of the circumstances), or Application to the facts (applies the existing standard to this case). Judge by the center of gravity of the Summary of Decision as a whole. quote is a supporting phrase from the holding or the issues, verbatim.
5. factors (decision factors): transcribe verbatim, from the holding or the issues, 2 to 5 things the decision cited as grounds for judgment or factors for consideration.
6. precedent (Relation to precedent): one of change of precedent, follows existing precedent, sets a new standard, or cannot be confirmed. quote is verbatim from the holding or the precedents. If there is no basis, use an empty string.
7. burden (burden of proof): one of prosecutor, the party asserting, the opposing party, or not addressed. Give a value only when the Holdings or Summary of Decision clarifies who must prove what, and otherwise use not addressed and an empty quote.
8. openQuestion: the question the decision left unanswered, in one sentence, ending in ?.

Rules: quote and factors must be exact substrings of the given original text (do not change or shorten any character). Do not use Chinese characters, Japanese kana, full-width punctuation, the middle dot ㆍ, or the dashes —, ·, –. Do not omit any of the decisions in the input, and write caseNo exactly as in the input. Do not modify or create files; output only the answer.

Among the decisions in this input, those with holdingSource "issues" have an empty string for holding because the National Law Information Center original text does not carry a Summary of Decision. Read such decisions through the Holdings (issues) and the reasons. For standard, the quote and the factors are taken from the issues; for the remaining axes, the quote is transcribed verbatim from one of issues, order, precedents, statutes, or reasons.
Primary-reading addendum (no holding summary)
## Decisions without a Summary of Decision (where holdingSource is "issues")
There are decisions for which the National Law Information Center original text does not carry a Summary of Decision (summary of the disposition). In that case, holding in the input is an empty string and holdingSource is "issues". Such a decision is read as follows.
- holdingQuote: the key phrase transcribed verbatim from the Holdings (issues).
- factors: 2 to 5 phrases transcribed verbatim from the Holdings (issues). If the Holdings are short, select distinct noun phrases within them.
- quote for each axis: an exact substring of one of issues, order, precedents, statutes, or reasons. The determinations for standard, burden, and precedent are made after actually reading the reasons.
- write answer and lowerCourtContrast only to the extent confirmed in the reasons. The circumstance that there is no Summary of Decision is not written in the answer (it is displayed separately on screen).
Axis comparison instruction
You are an adjudicator comparing two readings of Supreme Court decisions. The input file (designated in the command below) contains, for each decision, the original text (issues, holding, order), the primary reading (primary), and the independent reading (independent). The independent reading was made by reading only the original text without seeing the primary reading. Determine for the four axes below whether the two readings are of the same substance, and if there is a difference, write in one sentence what is different and how. Do not determine which side is correct in light of the original text.

- issue (axis 1, issue): do the two readings point to the same legal question that the decision answered? Even if expressed differently, if it is the same question, same=true. Even if one side captures only some of several Holdings, if the central question is the same, same=true.
- answer (axis 2, decision): did the two readings understand the decision's answer to that question in the same direction and with the same substance?
- factors (axis 5, decision factors): are the decision factors cited by the two readings substantially the same (if more than half overlap and the central factors are the same, same=true).
- openQuestion (axis 8, open question): do the two readings point to the same unresolved point left by the decision?
- enumNotes: for each axis listed in enumDiffs of the input (among disposition, form of the decision standard, Relation to precedent, and burden of proof, the axes whose values differ from each other), write a one-sentence note on why the two readings may have been read differently, in light of the original text. If enumDiffs is empty, use an empty array.

Write a note briefly even when same=true. Do not use Chinese characters, Japanese kana, full-width punctuation, the middle dot ㆍ, or the dashes —, ·, –. Write caseNo exactly as in the input, and do not omit any decision. Do not modify or create files; output only the answer.

Raw files

Back to the decision ledger
You are reading PRO SE
RISCON Labsrisconlabs.com