UI はローカライズ済みです。スキルの紹介と説明文書は選択した言語へ AI が自動翻訳し、コード・コマンド・パス・専門用語は原文のままです。原作者の文書が優先されます。
スキルを探す
データ・研究 · SKILL.md

scienceclaw-benchmark

scienceclaw-benchmark

Index of the 23 discipline skills (FoR30-FoR52) that mirror the disciplines of the companion ScienceClaw-Eval benchmark: find which discipline skill fits a scientific task (plant panoptic segmentation, protein fitness prediction, hippocampus segmentation, building load forecasting, molecule property prediction, music source separation, sepsis early warning,…

Independent GitHub snapshot · Automated classification · Original documentation governs

スキルの説明

GitHub

name: scienceclaw-benchmark description: "Index of the 23 discipline skills (FoR30-FoR52) that mirror the disciplines of the companion ScienceClaw-Eval benchmark: find which discipline skill fits a scientific task (plant panoptic segmentation, protein fitness prediction, hippocampus segmentation, building load forecasting, molecule property prediction, music source separation, sepsis early warning, French dependency parsing, contract evidence retrieval, ...). Use to pick the right discipline skill and the scilib tools it names." metadata: { "openclaw": { "emoji": "🧪" } }

ScienceClaw discipline skills

Each scienceclaw-benchmark-forNN skill describes one scientific task family: its inputs, the deliverable, how quality is judged, and the scilib tools and pretrained weights that fit it. The 23 skills correspond to the 23 disciplines of the companion ScienceClaw-Eval benchmark; its evaluation data is hosted on Hugging Face (https://huggingface.co/datasets/beita6969/scienceclaw-eval).

How to use

  1. Match the user's task to one row below and load that discipline skill.
  2. Confirm the tools it names with scienceclaw_tools (search, show, status, weights) and do not plan around a tool or weight that is reported as unavailable on this host.
  3. Build the workflow on the canvas (see scienceclaw-canvas): read the inputs through the task's load_<name> tools, keep the deliverable's type, shape and unit, and replay before finishing.

Disciplines

CodeDiscipline (ANZSRC division)TaskQuality metricSkill
FoR30Agricultural, veterinary and food sciencesPhenoBench hierarchical panoptic segmentationPQ+ (higher is better)scienceclaw-benchmark-for30
FoR31Biological sciencesProteinGym substitutionsmean Spearman (higher is better)scienceclaw-benchmark-for31
FoR32Biomedical and clinical sciencesMSD Task04 HippocampusDSC (higher is better)scienceclaw-benchmark-for32
FoR33Built environment and designBuildingsBenchbalanced NRMSE (%) (lower is better)scienceclaw-benchmark-for33
FoR34Chemical sciencesOGB ogbg-molhivROC-AUC (higher is better)scienceclaw-benchmark-for34
FoR35Commerce, management, tourism and servicesMonash Tourism Monthlymean MASE (lower is better)scienceclaw-benchmark-for35
FoR36Creative arts and writingMUSDB18 four-stem separationmean target-median SDR (dB) (higher is better)scienceclaw-benchmark-for36
FoR37Earth sciencesWeatherBench22m temperature RMSE (K) (lower is better)scienceclaw-benchmark-for37
FoR38EconomicsWorld Bank macro forecastingmean sMAPE (%) (lower is better)scienceclaw-benchmark-for38
FoR39EducationEedi NeurIPS 2020 Task 4organizer 10-mask accuracy (higher is better)scienceclaw-benchmark-for39
FoR40EngineeringDCASE 2024 Task 2official DCASE score (higher is better)scienceclaw-benchmark-for40
FoR41Environmental sciencesNEON aquatics forecastingmean CRPS (oxygen + temperature) (lower is better)scienceclaw-benchmark-for41
FoR42Health sciencesPhysioNet/CinC 2019 sepsisnormalized clinical utility (higher is better)scienceclaw-benchmark-for42
FoR43History, heritage and archaeologyHIPE-OCRepair 2026weighted cMER-micro (lower is better)scienceclaw-benchmark-for43
FoR44Human societyACIC 2016response-SD normalized RMSE (lower is better)scienceclaw-benchmark-for44
FoR45Indigenous studiesAmericasNLP 2026mean sentence chrF++ (higher is better)scienceclaw-benchmark-for45
FoR46Information and computing sciencesHumanEval → MBPPexecution pass@1 (higher is better)scienceclaw-benchmark-for46
FoR47Language, communication and cultureCoNLL-2018 UDLAS (higher is better)scienceclaw-benchmark-for47
FoR48Law and legal studiesContractNLImAP (higher is better)scienceclaw-benchmark-for48
FoR49Mathematical sciencesSMT-COMP 2025 QF_NIAoracle-agreement accuracy (higher is better)scienceclaw-benchmark-for49
FoR50Philosophy and religious studiesSemEval-2023 Task 4 ValueEvalofficial F1 (higher is better)scienceclaw-benchmark-for50
FoR51Physical sciencesMatbench phononsMAE (lower is better)scienceclaw-benchmark-for51
FoR52PsychologyPsych-201 discretemicro accuracy (higher is better)scienceclaw-benchmark-for52

Rules that apply to every discipline

  • Use only the inputs the task declares; never use target information, and respect the temporal order of forecasting and clinical data.
  • Prefer a frozen checkpoint whose input/output contract is documented over a model trained inside the workflow, and report which checkpoint (and version) produced a result. Pretrained weights may have seen similar data: say so.
  • Keep a simple baseline next to a pretrained route so that the gain, if any, is visible.
保存したスキル