Submit results

Submissions are made via pull request against the Open MVIS site repo. Each submission is a single YAML file following the schema below. The CI on the PR validates the schema and rebuilds the site with your entry included.

Submission schema

# src/content/leaderboard/<method>__<config>.yaml
method:
  name: CamCalib
  version: "0.4.2"
  family: discrete_factor_graph      # see families list below
  open_source: true
  url_repo: https://github.com/.../CamCalib
  url_paper: https://arxiv.org/abs/...
sensor_config:
  category: multi_imu_multi_cam      # one of 7 categories
  num_imus: 4
  num_cams: 4
  imus: [MicroStrain GX3-25, GX3-35, Xsens MTI-100, RealSense T265]
  cameras: [BlackFly, T265-L, T265-R, ELP-L]
dataset:
  name: open_mvis_4imu4cam
  version: v1.0
  sequences: [4imus_4cams_01, 4imus_4cams_02, 4imus_4cams_03]
results:
  reprojection_rmse_px:    {value: 0.41, stddev: 0.03, n_runs: 5}
  extrinsic_rot_err_deg:   {value: 0.08, stddev: 0.02, n_runs: 5}
  extrinsic_trans_err_cm:  {value: 0.12, stddev: 0.04, n_runs: 5}
  timeoffset_err_ms:       {value: 0.31, stddev: 0.05, n_runs: 5}
  runtime_s:               {value: 142,  stddev: 8,    n_runs: 5}
  convergence_rate_pct:    100
artifacts:
  report_html: reports/camcalib__open_mvis_4imu4cam.html
  raw_yaml:    raw/camcalib__open_mvis_4imu4cam.yaml
submitted:
  by: Your Name
  date: 2026-04-20
  hardware: AMD 7950X, 64 GB RAM, no GPU

Category values

Use one of these sensor_config.category values:

• cam_only_mono
• cam_only_stereo
• cam_only_multi
• single_imu_single_cam
• single_imu_multi_cam
• multi_imu_single_cam
• multi_imu_multi_cam

Family values

Use one of these method.family values:

• discrete_factor_graph — GTSAM / Ceres batch MAP
• continuous_time_bspline — SE(3) B-splines (Kalibr, Basalt)
• filter_ekf — online EKF (OpenVINS-style)
• learning_based — deep-network regression
• other — hybrid or none of the above

Filing the PR

1. Fork yangyulin/mvis_pages on GitHub.
2. Drop your YAML at site/src/content/leaderboard/<method>__<config>.yaml.
3. (Optional) Add a full HTML report and raw YAML at site/public/reports/ and reference them in the artifacts block.
4. Open a PR — schema is validated on build; the CI preview will show the new row immediately.
5. A maintainer will merge once the schema passes and the numbers look reasonable.

Reproducibility expectation

For external submissions we expect either:

• A public repo where anyone can reproduce your numbers, or
• A paper citation whose experimental protocol matches the submission, or
• Both.

Verification

For now, submissions are self-reported. A future version of the leaderboard will offer server-side evaluation on hidden ground-truth sequences (the model used by the Hilti SLAM Challenge). Until then, the submitted.by and submitted.hardware fields carry the accountability trail.