orchestra-research/ai-research-skills

systems-paper-writing

Comprehensive guide for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys.

소스 보기
원본 Skill 문서

원본 저장소의 제목, 예시, 코드, 표, 링크, 이미지를 유지해 표시합니다.

Systems Paper Writing: Paragraph-Level Structural Blueprint

Fine-grained structural guidance for writing 10–12 page systems papers targeting top systems venues: OSDI, SOSP, ASPLOS, NSDI, and EuroSys. This skill provides page allocation per section, paragraph-level blueprints, and writing patterns distilled from authoritative guides and best-paper analysis.

When to Use This Skill

ScenarioUse This SkillUse ml-paper-writing Instead
Structuring a 12-page OSDI/SOSP paper
Page budget and paragraph planning
Systems-specific evaluation structure
General ML paper writing philosophy
Citation verification workflow
LaTeX templates and formatting
NeurIPS/ICML/ICLR paper structure

Boundary: ml-paper-writing provides general writing philosophy, multi-venue templates, and citation verification. This skill focuses exclusively on paragraph-level structural blueprints for systems conferences.


Authoritative Sources

This blueprint synthesizes guidance from established systems researchers:

  1. Levin & Redell — "How (and How Not) to Write a Good Systems Paper" (SOSP'83 PC Chairs, USENIX/ACM SIGOPS)
  2. Irene Zhang (MSR/UW) — "Hints on how to write an SOSP paper" (SOSP/OSDI PC)
  3. Gernot Heiser (UNSW, seL4) — Style Guide + Paper Writing Talk
  4. Timothy Roscoe (ETH Zürich) — "Writing reviews for systems conferences"
  5. Mike Dahlin (UT Austin/Google) — "Giving a Conference Talk"
  6. Yi Ding — "How to write good systems papers?"
  7. hzwer & DingXiaoH — WritingAIPaper (GitHub 1.3k+ stars)

Full citations and URLs: see references/section-blueprints.md.


12-Page Systems Paper Blueprint

Overview: Page Allocation

SectionPagesPurpose
Abstract~0.25150–250 words, 5-sentence structure
S1 Introduction1.5–2Problem → Gap → Insight → Contributions
S2 Background & Motivation1–1.5Terms + Production observations
S3 Design3–4Architecture + Module details + Alternatives
S4 Implementation0.5–1Prototype details, LOC, key engineering
S5 Evaluation3–4Setup + End-to-end + Microbenchmarks + Scalability
S6 Related Work1Grouped by methodology, explicit comparison
S7 Conclusion0.53-sentence summary
Total~12Submission: 12 pages strict (USENIX) / 11 pages (ACM ASPLOS). Camera-ready: up to 14 pages (USENIX) / 13 pages (ACM). Ranges above span submission through camera-ready. Target 12 pages for initial submission. References unlimited.

Abstract (150–250 words, 5 sentences)

text
Sentence 1: Problem context and importance
Sentence 2: Gap in existing approaches
Sentence 3: Key insight or thesis ("X is better for Y in environment Z")
Sentence 4: Summary of approach and key results
Sentence 5: Broader impact or availability

Source: Levin & Redell — "Can you state the new idea concisely? Use them in the abstract." Irene Zhang — "The abstract is harder to write because you cannot use terms or concepts you introduced in the paper."

S1 Introduction (1.5–2 pages)

Paragraph structure:

  1. Problem statement (~0.5 page) — Establish the domain and why it matters. Use concrete numbers (cluster sizes, workload statistics, latency requirements).
  2. Gap analysis (~0.5 page) — Enumerate specific gaps G1–Gn in existing systems. Each gap is one sentence with evidence.
  3. Key insight (1 paragraph) — The thesis statement: "X is better for applications Y running in environment Z." (Irene Zhang formula)
  4. Contributions (~0.5 page) — Numbered list of 3–5 concrete contributions. Each contribution is testable and maps to a section.

Writing pattern: hzwer Move 1 (Establish territory) → Move 2 (Find niche) → Move 3 (Occupy niche).

Source: Irene Zhang — "clearly state your target environment (Z) and application (Y)" + "clearly state why previous systems do not meet the needs"; Levin & Redell — "What exactly is the problem being solved?"

S2 Background & Motivation (1–1.5 pages)

Paragraph structure:

  1. Technical background (~0.5 page) — Define terms and systems the reader needs. Follow Gernot Heiser's "define-before-use" principle.
  2. Production observations (~0.5–1 page) — Present Observation 1, 2, 3 from real data or measurements. Each observation leads to a design insight.

Source: Irene Zhang — "clearly motivate Y and Z. Why is application Y important?"; Gernot Heiser — "define-before-use."

S3 Design (3–4 pages)

Paragraph structure:

  1. System architecture overview (~0.5 page) — Architecture diagram first (Yi Ding: "draw a picture first"). One-paragraph walkthrough of major components and data flow.
  2. Module-by-module design (~2–2.5 pages) — Each subsection: what the module does, the design choice made, alternatives considered, and why this choice wins.
  3. Design alternatives and trade-offs (~0.5–1 page) — For each major decision, explicitly discuss what was not chosen and why.

Source: Irene Zhang — "Every design choice made in X should be discussed with alternatives and the reasons for the choice"; Levin & Redell — "What were the alternatives considered at various points, and why were the choices made?"

S4 Implementation (0.5–1 page)

  1. Prototype description — Language, framework, LOC, integration with existing systems.
  2. Key engineering decisions — Non-obvious implementation choices worth documenting.

Source: Levin & Redell — "Does the paper describe something that has actually been implemented?"; Irene Zhang — "explain how you constructed a prototype to test your hypothesis."

S5 Evaluation (3–4 pages)

Paragraph structure:

  1. Experimental setup (~0.5 page) — Hardware, baselines, workloads, metrics. Enough detail to reproduce.
  2. End-to-end comparison (~1–1.5 pages) — X vs baselines for application Y on environment Z. Main performance results.
  3. Microbenchmarks / Ablation (~1–1.5 pages) — Isolate each design decision's contribution. Ablation experiments decompose the gains.
  4. Scalability (~0.5 page) — Show behavior as problem size, cluster size, or load increases.

Critical rule (Irene Zhang): State every experimental conclusion three times:

  • Section opening: hypothesis ("We expect X to outperform Y because...")
  • Section closing: conclusion ("Results show X outperforms Y by Z%")
  • Figure caption: evidence ("Figure N shows X achieves Z% better throughput than Y")

Two experiment types:

  • Type 1: X vs baselines for Y on Z (end-to-end comparison)
  • Type 2: Ablation — remove each design component to measure its individual impact

S6 Related Work (1 page)

  • Group by methodology or approach, not by individual papers.
  • For each group: what they do, what limitation remains, how your work differs.
  • Use a comparison table when comparing 4+ systems on specific dimensions.

Source: Levin & Redell — "Are comparisons with previous work clear and explicit?"; Irene Zhang — use comparison tables.

S7 Conclusion (0.5 page)

Three sentences (Irene Zhang formula):

  1. The hypothesis / problem addressed
  2. The solution approach
  3. The key result

Writing Patterns

Four reusable patterns for structuring systems papers. See references/writing-patterns.md for detailed examples.

Pattern 1: Gap Analysis (Lucid, ASPLOS'23)

Enumerate gaps G1–Gn in Introduction → map to answers A1–An in Design. Creates a clear contract with the reader.

Pattern 2: Observation-Driven (GFS, arXiv 2025)

Present production observations (O1–O3) in Motivation → derive design insights → build system around insights. Effective when you have real workload data.

Pattern 3: Contribution List (Blox, EuroSys'24; Sia, SOSP'23)

Numbered contributions in Introduction, each mapping to a section. Readers (and reviewers) can track claims through the paper.

Pattern 4: Thesis Formula (Irene Zhang)

Structure the entire paper around: "X is better for applications Y running in environment Z." Introduction states it, Design explains how, Evaluation proves it.


Conference Differences

Warning: Venue rules change yearly. Always verify against the current year's CFP before submission.
VenueFormatSubmission LimitCamera-ReadyReferences
OSDIUSENIX12 pages14 pagesUnlimited
NSDIUSENIX12 pages14 pagesUnlimited
SOSPACM SIGOPS12 pages (tech content)Unlimited
ASPLOSACM SIGPLAN11 pages13 pagesUnlimited
EuroSysACM12 pagesUnlimited

Based on 2025/2026 CFPs. Verify current limits before submission.


Writing Philosophy

Manage Reader State (Gernot Heiser)

Treat the reader's cognitive load like an OS managing process state. Never introduce a concept without context. Never reference something defined later without a forward pointer.

Six-Dimensional Quality (Levin & Redell)

Self-check against: Original Ideas, Reality (is it built?), Lessons (what did you learn?), Choices (alternatives discussed?), Context (related work fair?), Presentation (clear writing?).

Page-One Figure (hzwer)

Include a figure on the first page that captures the core idea. Reviewers form first impressions from the title, abstract, and page-one figure.


Academic Integrity Requirements

Citation Discipline

  • Never generate citations from memory. Use ml-paper-writing's citation verification workflow (Semantic Scholar / DBLP / CrossRef APIs).
  • Mark unverified references as [CITATION NEEDED].

Prohibition of Fabrication

  • Do NOT fabricate production observations, traces, deployment experiences, or experimental results.
  • Do NOT generate fake venue rules, paper metadata, or best-paper claims.
  • Do NOT copy paragraph-level text from reference papers. This blueprint provides structural guidance, not copy-paste templates.

LLM Disclosure

  • Some venues require disclosure of substantial LLM use in writing or ideation. Check each venue's AI policy in the current CFP.

Attribution

  • When structures are inspired by specific papers (e.g., Lucid's gap-analysis pattern), cite the inspiration.
  • Cross-repository references (e.g., ARIS paper-slides structure) are attributed, not copied.

Temporal Validity

  • Venue rules (page limits, format, AI policies) change annually. All venue information in this skill is based on 2025/2026 CFPs. Always verify against the current year's CFP.

Workflow: Structuring a New Systems Paper

text
Step 1: Read this SKILL.md for page allocation overview
Step 2: Read references/section-blueprints.md for per-section paragraph templates
Step 3: Choose a writing pattern from references/writing-patterns.md
Step 4: Draft section by section following the blueprint
Step 5: Run the checklist from references/checklist.md before submission
Step 6: Use ml-paper-writing for citation verification and LaTeX formatting

Quick Checklist

  • [ ] Thesis statement follows "X is better for Y in Z" formula
  • [ ] Introduction has numbered contributions (3–5)
  • [ ] Each contribution maps to a paper section
  • [ ] Design discusses alternatives for every major choice
  • [ ] Every eval conclusion stated 3 times (hypothesis, result, caption)
  • [ ] Related work grouped by methodology, not individual papers
  • [ ] Page budget within venue limits
  • [ ] All citations verified programmatically (no hallucinated references)

Common Issues and Solutions

IssueSolution
Paper feels like a "feature list"Restructure around thesis formula: X better for Y in Z
Evaluation lacks depthAdd ablation experiments isolating each design decision
Reviewers say "incremental"Strengthen gap analysis: make G1–Gn crisper with evidence
Design section too longMove implementation details to S4, keep S3 at design level
Motivation feels weakAdd production observations with concrete numbers
Related work reads like a bibliographyGroup by approach, add explicit differentiation

References

Writing Guidance

Venue-Specific

  • references/checklist.md — 7-stage pre-submission checklist covering structure, writing quality, evaluation rigor, design quality, academic integrity, venue-specific requirements (OSDI/NSDI/ASPLOS/SOSP/EuroSys), and final pass
  • references/systems-conferences.md — Conference overview, deadlines, track descriptions, formatting requirements, submission rules, and format conversion guides
  • references/reviewer-guidelines.md — How systems conference reviewers evaluate papers, with venue-specific criteria and common concerns

LaTeX Templates

같은 저장소의 Skills

더 많은 Skills

모든 Skills
orchestra-research
커뮤니티

ml-training-recipes

Battle-tested PyTorch training recipes for all domains — LLMs, vision, diffusion, medical imaging, protein/drug discovery, spatial omics, genomics. Covers training loops, optimizer selection (AdamW, Muon), LR scheduling, mixed precision, debugging, and systematic experimentation. Use when training or fine-tuning neural networks, debugging loss spikes or OOM, choosing architectures, or optimizing GPU throughput.

설치 수
1
GitHub Stars
1.3만
업데이트
6월 16일
orchestra-research
커뮤니티

academic-plotting

Generates publication-quality figures for ML papers from research context. Given a paper section or description, extracts system components and relationships to generate architecture diagrams via Gemini. Given experiment results or data, auto-selects chart type and generates data-driven figures via matplotlib/seaborn. Use when creating any figure for a conference paper.

설치 수
2
GitHub Stars
1.3만
업데이트
6월 16일
orchestra-research
커뮤니티

ara-compiler

Compiles any research input — PDF papers, GitHub repositories, experiment logs, code directories, or raw notes — into a complete Agent-Native Research Artifact (ARA) with cognitive layer (claims, concepts, heuristics), physical layer (configs, code stubs), exploration graph, and grounded evidence. Use when ingesting a paper or codebase into a structured, machine-executable knowledge package, building an ARA from scratch, or converting research outputs into a falsifiable, agent-traversable form.

설치 수
2
GitHub Stars
1.3만
업데이트
6월 16일
orchestra-research
커뮤니티

ara-research-manager

Records research provenance as a post-task epilogue, scanning conversation history at the end of a coding or research session to extract decisions, experiments, dead ends, claims, heuristics, and pivots, and writing them into the ara/ directory with user-vs-AI provenance tags. Use as a session epilogue — never during execution — to maintain a faithful, auditable trace of how a research project actually evolved.

설치 수
2
GitHub Stars
1.3만
업데이트
6월 16일