OpenMVIS

Camera-IMU Calibration
Generated 2026-11-10 22:06:17 · OpenMVIS v0.1.0

1. Summary

✓ OK
Status
0.247 px
Reproj median
✓ good
0.681 px
Reproj p95
✓ good
4
Cameras
4
IMUs
2398
States
5
Iterations
MetricValueGrade
Reprojection median (px)0.2475✓ good
Reprojection p95 (px)0.6812✓ good
Camera χ²/dof0.135✓ good
IMU χ²/dof0.136✓ good
Trajectory states2398
LM iterations5
IMU modelcalyx
t_ga gyro→accel (ms)+0.301 ± 0.023

2. 3D Geometry

Calibration process

The solved path of the rig around the board. Press Play or drag the bar to follow it, use the buttons to change the view, and drag to rotate. Click a camera on the right to put it on the frustum.

Solved rig

The solved rig to scale, in its own frame: forward along the cameras, right along the baseline. Tap a sensor for its values. Field-of-view rims are traced through each lens model from the image edges.

3. Cameras

cammodelreproj med/p95 pxfx,fy,cx,cytd mstr mslever |mm|rot |rad|baseline mm
cam0equidistant0.256 / 0.74286.5, 286.3, 414.9, 402.6+0.0040.000 (pin)130.903.13451—
cam1equidistant0.246 / 0.70286.5, 286.1, 414.4, 397.0+0.0000.000 (pin)112.333.1311963.70
cam2equidistant0.229 / 0.56426.9, 426.4, 350.4, 265.9-0.00416.692145.173.08627153.41
cam3equidistant0.244 / 0.59423.6, 423.1, 336.5, 256.9-0.00116.737185.983.09366212.75

Camera 0

cam0 — T_C→Ixyz|·|
lever (mm)64.34-110.71-27.18130.90
lever σ (mm)0.130.150.30
rotation (rad)-0.03182-2.217602.215033.13451
rotation σ (rad)3.58e-043.12e-041.91e-04
cam0 — temporal / distortionvalue
td (ms)+0.004 (σ 0.022)
tr (ms)0.000 [pinned]
intr σ (fx,fy,cx,cy)0.099 0.100 0.091 0.094
distortion-0.00535 0.03561 -0.03137 0.00406
dist σ2.00e-03 5.36e-03 5.51e-03 1.90e-03
corner accountingcorners: 46202 used, 0 past fold, 0 other invalid; 2 no-pose frames, 0 outliers; max theta 73.4 deg

Camera 1

cam1 — T_C→Ixyz|·|
lever (mm)0.67-108.99-27.17112.33
lever σ (mm)0.140.150.32
rotation (rad)-0.03921-2.212432.215393.13119
rotation σ (rad)4.47e-043.90e-041.94e-04
cam1 — temporal / distortionvalue
td (ms)+0.000 (σ 0.026)
tr (ms)0.000 [pinned]
intr σ (fx,fy,cx,cy)0.123 0.124 0.118 0.126
distortion-0.00673 0.04009 -0.03675 0.00599
dist σ2.65e-03 6.98e-03 7.05e-03 2.38e-03
corner accountingcorners: 23472 used, 0 past fold, 0 other invalid; 2 no-pose frames, 0 outliers; max theta 75.4 deg

Camera 2

cam2 — T_C→Ixyz|·|
lever (mm)-88.98-112.50-22.34145.17
lever σ (mm)0.130.150.32
rotation (rad)-0.00387-2.083572.276793.08627
rotation σ (rad)4.32e-044.81e-041.92e-04
cam2 — temporal / distortionvalue
td (ms)-0.004 (σ 0.066)
tr (ms)16.692
intr σ (fx,fy,cx,cy)0.191 0.190 0.185 0.166
distortion-0.09320 -0.00747 -0.02240 0.01782
dist σ4.83e-03 2.26e-02 4.02e-02 2.37e-02
corner accountingcorners: 14010 used, 0 past fold, 0 other invalid; 2 no-pose frames, 0 outliers; max theta 56.6 deg

Camera 3

cam3 — T_C→Ixyz|·|
lever (mm)-148.32-110.24-20.90185.98
lever σ (mm)0.130.150.32
rotation (rad)0.01350-2.113022.259583.09366
rotation σ (rad)4.04e-044.61e-041.93e-04
cam3 — temporal / distortionvalue
td (ms)-0.001 (σ 0.060)
tr (ms)16.737
intr σ (fx,fy,cx,cy)0.185 0.184 0.175 0.151
distortion-0.08939 -0.01799 -0.00427 0.00596
dist σ4.31e-03 1.88e-02 3.11e-02 1.73e-02
corner accountingcorners: 15314 used, 0 past fold, 0 other invalid; 0 no-pose frames, 0 outliers; max theta 58.6 deg

4. Reprojection Analysis

5. Motion & Excitation

Body-frame angular velocity finite-differenced from the solved trajectory states — the excitation context for lever-arm / td observability.

6. Base IMU (imu0, model calyx)

paramvalue
b_g0.00004 -0.00002 0.00010
b_g drift0.00076 -0.00013 -0.00060
b_a-0.0016 0.0018 0.0003
b_a drift0.0086 0.0028 -0.0098
R_wtoI (rad)0.00010 -0.00001 -0.00006
t_ga gyro→accel (ms)+0.301 ± 0.023 (gyro clock is reference: accel stamped t sampled at t − t_ga)

IMU intrinsics (full)

Dw (gyro)
+1.000012+0.000062+0.000004
-0.000057+1.000000-0.000106
+0.000014+0.000098+0.999961
Da (accel)
+0.999940+0.000038-0.000175
+0.000000+1.000055+0.000123
+0.000000+0.000000+0.999998
Tg (g-sensitivity)
+0.000000-0.000000-0.000000
-0.000000+0.000000-0.000000
+0.000000+0.000000-0.000000

Bias evolution

7. Aux IMUs

Per-IMU parameters in the base-IMU format; the spatial (T_IstoI) and temporal (td) rows are relative to the base IMU.

gx3_25

paramvalue
td vs base (ms)+0.002
t_ga gyro→accel (ms)+0.003 ± 0.019
χ²/dof0.28
T_IstoI lever p_IsinI (mm)[-122.80, -45.30, -3.06] |130.92|
T_IstoI rotation (rad)[2.25031, 2.18494, -0.02783] |3.13666|
b_g-0.00007 0.00005 0.00004
b_a-0.0001 0.0000 0.0002

IMU intrinsics (full)

Dw (gyro)
+1.000018+0.000007+0.000040
+0.000012+0.999991+0.000058
+0.000008+0.000008+0.999968
Da (accel)
+0.999987-0.000000-0.000062
+0.000000+1.000010+0.000019
+0.000000+0.000000+0.999986
Tg (g-sensitivity)
+0.000000-0.000000+0.000000
+0.000000-0.000000+0.000000
+0.000000-0.000000+0.000000

gx3_35

paramvalue
td vs base (ms)+0.002
t_ga gyro→accel (ms)+0.006 ± 0.021
χ²/dof0.31
T_IstoI lever p_IsinI (mm)[-82.28, -46.23, -3.46] |94.44|
T_IstoI rotation (rad)[2.23049, 2.20706, -0.01912] |3.13792|
b_g0.00000 0.00005 0.00003
b_a0.0000 -0.0000 0.0003

IMU intrinsics (full)

Dw (gyro)
+1.000021-0.000004+0.000031
+0.000018+0.999988+0.000060
+0.000009+0.000014+0.999965
Da (accel)
+0.999986-0.000006-0.000057
+0.000000+1.000009+0.000018
+0.000000+0.000000+0.999980
Tg (g-sensitivity)
+0.000000-0.000000-0.000000
-0.000000-0.000000+0.000000
+0.000000+0.000000+0.000000

t265

paramvalue
td vs base (ms)-0.001
t_ga gyro→accel (ms)-0.004 ± 0.018
χ²/dof0.67
T_IstoI lever p_IsinI (mm)[54.73, -107.47, -30.34] |124.36|
T_IstoI rotation (rad)[1.57242, -0.00538, -0.01139] |1.57247|
b_g0.00000 0.00002 0.00003
b_a-0.0018 0.0013 0.0012

IMU intrinsics (full)

Dw (gyro)
+0.999997-0.000068-0.000014
-0.000015+0.999962-0.000082
-0.000003+0.000130+1.000012
Da (accel)
+1.000014-0.000007-0.000006
+0.000000+0.999974-0.000064
+0.000000+0.000000+0.999991
Tg (g-sensitivity)
+0.000000+0.000000+0.000000
+0.000000-0.000000+0.000000
+0.000000-0.000000+0.000000

8. IMU Residuals

Per-interval cost

Cost split

residual rowscostshare
theta1283.326.3%
p2386.348.9%
v830.717.0%
bg112.02.3%
ba267.85.5%

9. Timing

stagesshare
init_s96.8316.2%
aux_init_s0.440.1%
graph_build_s31.155.2%
pre_diag_s33.295.6%
solve_s342.7657.5%
post_diag_s6.151.0%
marginals_s17.132.9%
per_iteration_s68.5511.5%
total596.29

10. Result files

Files this run wrote, verbatim. Expand one to read or copy it.

cam_imu_calib.yaml · YAML, 13.0 kB (click to expand)

cam_imu_calib.yaml

cameras:
- id: 0
  model: pinhole_equidistant
  intrinsics:
    fx: 286.5328020701859
    fy: 286.33160196345636
    cx: 414.9378009570472
    cy: 402.6344565567343
  distortion:
    model: equidistant
    coeffs:
    - -0.005347354934623327
    - 0.035610320275459406
    - -0.031365754979340084
    - 0.004058083465753569
  image_size:
  - 848
  - 800
  rolling_shutter_readout: 2.3428777523214845e-12
  td: 3.6175743631256533e-06
  T_cam_imu:
  - - -0.9997689423769407
    - 0.01935528039783312
    - -0.009350667313879962
    - 0.06621521089756413
  - - 0.009372642466677353
    - 0.001044952985188015
    - -0.9999555298344274
    - -0.02766482713722972
  - - -0.01934464865758637
    - -0.9998121229480971
    - -0.0012261216638462884
    - -0.10947728810074786
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  reproj_rms_px: 0.5484
  p_CtoC0_m: null
  corner_accounting:
    camera: 0
    model: equidistant
    n_corners: 46202
    used: 46202
    past_fold: 0
    past_fold_pass1: 0
    other_invalid: 0
    no_pose_frames: 2
    no_pose_corners: 8
    discarded_pose_corners: 0
    outliers: 0
    filter_removed: 0
    removed_invalid: 0
    max_theta_deg: 73.36268980246804
    max_theta_used_deg: 73.36268980246804
    fold_deg: null
    fold_level: none
    detected: 276852
    not_in_solve: 230642
  rostopic: /t265/fisheye1/image_raw
- id: 1
  model: pinhole_equidistant
  intrinsics:
    fx: 286.50027833753904
    fy: 286.07505573142635
    cx: 414.39750867279315
    cy: 396.9842407447665
  distortion:
    model: equidistant
    coeffs:
    - -0.006726748082337003
    - 0.04008989873688737
    - -0.03674820280588232
    - 0.00598982484592293
  image_size:
  - 848
  - 800
  rolling_shutter_readout: 7.261754022225387e-13
  td: 2.4061978934603707e-07
  T_cam_imu:
  - - -0.9996327559155915
    - 0.02502591105338825
    - -0.010395050579359546
    - 0.0031144298215478603
  - - 0.010362975581565629
    - -0.001411025820602097
    - -0.999945307375973
    - -0.02732575729997663
  - - -0.025039210005417797
    - -0.9996858070324299
    - 0.0011511647245637934
    - -0.10890746587577407
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  reproj_rms_px: 0.5752
  p_CtoC0_m:
  - 0.06369035824082336
  - -0.0006071316699007012
  - -0.0004876599535131032
  corner_accounting:
    camera: 1
    model: equidistant
    n_corners: 23472
    used: 23472
    past_fold: 0
    past_fold_pass1: 0
    other_invalid: 0
    no_pose_frames: 2
    no_pose_corners: 8
    discarded_pose_corners: 0
    outliers: 0
    filter_removed: 0
    removed_invalid: 0
    max_theta_deg: 75.41064511301929
    max_theta_used_deg: 75.41064511301929
    fold_deg: null
    fold_level: none
    detected: 282196
    not_in_solve: 258716
  rostopic: /t265/fisheye2/image_raw
- id: 2
  model: pinhole_equidistant
  intrinsics:
    fx: 426.8930008861213
    fy: 426.4472448254193
    cx: 350.40748428029104
    cy: 265.938084140461
  distortion:
    model: equidistant
    coeffs:
    - -0.0931975611033997
    - -0.007470877695349147
    - -0.02239755497874043
    - 0.01782481728812361
  image_size:
  - 640
  - 480
  rolling_shutter_readout: 0.0166922943653922
  td: -3.6120287422274078e-06
  T_cam_imu:
  - - -0.9984669789095153
    - 0.04248262756981117
    - 0.0354812398609481
    - -0.08327335884201302
  - - -0.039099964348599685
    - -0.08762392880480897
    - -0.995385975332558
    - -0.03557799289810481
  - - -0.03917760604278427
    - -0.9952473428528075
    - 0.08915066869733458
    - -0.11345831982718772
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  reproj_rms_px: 0.3912
  p_CtoC0_m:
  - 0.1532079599704636
  - -0.00627306360694737
  - 0.004749198631974219
  corner_accounting:
    camera: 2
    model: equidistant
    n_corners: 14010
    used: 14010
    past_fold: 0
    past_fold_pass1: 0
    other_invalid: 0
    no_pose_frames: 2
    no_pose_corners: 36
    discarded_pose_corners: 0
    outliers: 0
    filter_removed: 0
    removed_invalid: 0
    max_theta_deg: 56.619925612937834
    max_theta_used_deg: 56.619925612937834
    fold_deg: null
    fold_level: none
    detected: 147012
    not_in_solve: 132966
  rostopic: /elp/split_sync_image_node/left/image_raw
- id: 3
  model: pinhole_equidistant
  intrinsics:
    fx: 423.57880082083886
    fy: 423.10849172415243
    cx: 336.4993790533729
    cy: 256.92849030517397
  distortion:
    model: equidistant
    coeffs:
    - -0.08938535917526613
    - -0.017990403516830705
    - -0.004270957666424365
    - 0.0059575027795676395
  image_size:
  - 640
  - 480
  rolling_shutter_readout: 0.01673663833737512
  td: -7.693585980950851e-07
  T_cam_imu:
  - - -0.9988133056907974
    - 0.029041447970331105
    - 0.03909699061062879
    - -0.1441202957894711
  - - -0.04095392194718245
    - -0.06636734711087654
    - -0.996954438033458
    - -0.034231044118127774
  - - -0.026358236894093175
    - -0.9973725329771476
    - 0.06747795055115309
    - -0.11245057736325599
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  reproj_rms_px: 0.4435
  p_CtoC0_m:
  - 0.21255781843554983
  - -0.008266871910167953
  - 0.003638214555534716
  corner_accounting:
    camera: 3
    model: equidistant
    n_corners: 15314
    used: 15314
    past_fold: 0
    past_fold_pass1: 0
    other_invalid: 0
    no_pose_frames: 0
    no_pose_corners: 0
    discarded_pose_corners: 0
    outliers: 0
    filter_removed: 0
    removed_invalid: 0
    max_theta_deg: 58.58745196772238
    max_theta_used_deg: 58.58745196772238
    fold_deg: null
    fold_level: none
    detected: 160848
    not_in_solve: 145534
  rostopic: /elp/split_sync_image_node/right/image_raw
imus:
- name: imu0
  role: base
  model: calyx
  b_g:
  - 4.3241935693017515e-05
  - -2.1782691376322504e-05
  - 0.00010476775037079945
  b_a:
  - -0.001642252958417794
  - 0.0017936641880118185
  - 0.0003496174636140312
  topic: /imu/data
  t_ga: 0.0003012281952214258
  t_ga_sigma: 2.252599062970128e-05
  imu_intr_xi:
  - 1.157195635044584e-05
  - 6.246091828213349e-05
  - 3.903497218871344e-06
  - -5.6601868324820205e-05
  - -4.478353885129744e-07
  - -0.00010646285090257708
  - 1.4156854505435787e-05
  - 9.777572067474687e-05
  - -3.9444717607543e-05
  - -5.999434110977519e-05
  - 3.8076029977600066e-05
  - 5.513007515246971e-05
  - -0.00017542684503477667
  - 0.00012312675813567348
  - -2.0094935820113204e-06
  - 9.847184575550014e-13
  - -9.875916585609879e-12
  - 1.4123281556923505e-11
  - -1.5193828055947844e-12
  - 3.1309370516621664e-12
  - 1.6605960374752493e-13
  - -1.892189329498118e-13
  - -5.129179425614023e-12
  - -2.0699130285664915e-12
  Dw:
  - - 1.0000115719563505
    - 6.246091828213349e-05
    - 3.903497218871344e-06
  - - -5.6601868324820205e-05
    - 0.9999995521646114
    - -0.00010646285090257708
  - - 1.4156854505435787e-05
    - 9.777572067474687e-05
    - 0.9999605552823925
  Dw_decomposed:
    Dw_scale:
    - 1.00001
    - 1.0
    - 0.99996
    Dw_shear:
    - 1.0e-05
    - 2.0e-05
    - -1.0e-05
    gyro_misalign_rotvec:
    - 9.8e-05
    - -1.4e-05
    - -5.7e-05
  Da:
  - - 0.9999400056588902
    - 3.8076029977600066e-05
    - -0.00017542684503477667
  - - 0.0
    - 1.0000551300751526
    - 0.00012312675813567348
  - - 0.0
    - 0.0
    - 0.999997990506418
  Dw_diag:
  - 1.000012
  - 1.0
  - 0.999961
  Da_diag:
  - 0.99994
  - 1.000055
  - 0.999998
  R_wtoI:
  - - 0.9999999982979453
    - 5.659982879676174e-05
    - -1.4162224792548925e-05
  - - -5.6601213241711726e-05
    - 0.9999999936181881
    - -9.77748793990628e-05
  - - 1.4156690660733655e-05
    - 9.777568083175006e-05
    - 0.9999999951197521
  U_w:
  - - 1.0000115736584247
    - 5.861114462767922e-06
    - 1.806565539282192e-05
  - - 0.0
    - 0.9999995588781669
    - -8.690805188246129e-06
  - - 0.0
    - 0.0
    - 0.9999605607564473
- name: gx3_25
  role: aux
  model: calyx
  td: 1.5589933667279533e-06
  b_g:
  - -6.975880610459759e-05
  - 5.3435432967668106e-05
  - 3.8816996862160604e-05
  b_a:
  - -7.777792569141164e-05
  - 3.4391690508253737e-06
  - 0.00023823066139159194
  imu_intr_xi:
  - 1.8473078178014363e-05
  - 7.475836010421383e-06
  - 4.036121982266393e-05
  - 1.19310395060448e-05
  - -9.17786038363049e-06
  - 5.821754345319661e-05
  - 8.396984134664156e-06
  - 8.388801451911035e-06
  - -3.16489730711369e-05
  - -1.2601804039720762e-05
  - -4.902101157060121e-07
  - 9.82947335341896e-06
  - -6.171292663897079e-05
  - 1.9322102097111807e-05
  - -1.3568437329758796e-05
  - 8.113690916505746e-12
  - 2.3255235183908176e-12
  - 1.987480996125523e-12
  - -1.3775138559060414e-11
  - -1.1262613335155082e-12
  - -8.196687990907058e-12
  - 1.4186117640695487e-12
  - 2.4845277797463927e-12
  - 1.0186612821851761e-12
  Dw:
  - - 1.000018473078178
    - 7.475836010421383e-06
    - 4.036121982266393e-05
  - - 1.19310395060448e-05
    - 0.9999908221396163
    - 5.821754345319661e-05
  - - 8.396984134664156e-06
    - 8.388801451911035e-06
    - 0.9999683510269288
  Da:
  - - 0.9999873981959603
    - -4.902101157060121e-07
    - -6.171292663897079e-05
  - - 0.0
    - 1.0000098294733535
    - 1.9322102097111807e-05
  - - 0.0
    - 0.0
    - 0.9999864315626702
  Dw_diag:
  - 1.000018
  - 0.999991
  - 0.999968
  Da_diag:
  - 0.999987
  - 1.00001
  - 0.999986
  Dw_decomposed:
    Dw_scale:
    - 1.00002
    - 0.99999
    - 0.99997
    Dw_shear:
    - 2.0e-05
    - 5.0e-05
    - 7.0e-05
    gyro_misalign_rotvec:
    - 8.0e-06
    - -8.0e-06
    - 1.2e-05
  p_IsinI_m:
  - -0.12279749876123815
  - -0.04530453117208824
  - -0.0030621588293177817
  t_ga: 2.7085113498469508e-06
  t_ga_sigma: 1.9265994499319954e-05
  topic: /gx3_25/data
- name: gx3_35
  role: aux
  model: calyx
  td: 1.737185457896172e-06
  b_g:
  - 3.7312695845425017e-06
  - 5.312435533535662e-05
  - 2.8950681817827687e-05
  b_a:
  - 3.2320761964400174e-05
  - -4.6317745495855786e-05
  - 0.00034718300187958957
  imu_intr_xi:
  - 2.0952714605303183e-05
  - -3.876010358040474e-06
  - 3.120666846533379e-05
  - 1.781220711699324e-05
  - -1.2461997824597523e-05
  - 6.033656083994755e-05
  - 9.40799059591194e-06
  - 1.4283044142318698e-05
  - -3.4564249275392154e-05
  - -1.4440253351636336e-05
  - -5.685348901293316e-06
  - 9.422092405717012e-06
  - -5.734476695136897e-05
  - 1.7953666645576302e-05
  - -1.956382780192672e-05
  - 5.488761160062093e-13
  - -9.480203972196047e-14
  - 1.845088483649754e-12
  - -1.2418668835552964e-11
  - -3.01007808109293e-12
  - 4.094863305080462e-12
  - -1.693810754891616e-12
  - 1.888457052571179e-12
  - 7.620558356621445e-13
  Dw:
  - - 1.0000209527146053
    - -3.876010358040474e-06
    - 3.120666846533379e-05
  - - 1.781220711699324e-05
    - 0.9999875380021754
    - 6.033656083994755e-05
  - - 9.40799059591194e-06
    - 1.4283044142318698e-05
    - 0.9999654357507246
  Da:
  - - 0.9999855597466484
    - -5.685348901293316e-06
    - -5.734476695136897e-05
  - - 0.0
    - 1.0000094220924056
    - 1.7953666645576302e-05
  - - 0.0
    - 0.0
    - 0.9999804361721981
  Dw_diag:
  - 1.000021
  - 0.999988
  - 0.999965
  Da_diag:
  - 0.999986
  - 1.000009
  - 0.99998
  Dw_decomposed:
    Dw_scale:
    - 1.00002
    - 0.99999
    - 0.99997
    Dw_shear:
    - 1.0e-05
    - 4.0e-05
    - 7.0e-05
    gyro_misalign_rotvec:
    - 1.4e-05
    - -9.0e-06
    - 1.8e-05
  p_IsinI_m:
  - -0.08228090278773013
  - -0.04623024147047578
  - -0.003457833862037102
  t_ga: 6.161196696749847e-06
  t_ga_sigma: 2.125082651013732e-05
  topic: /gx3_35/imu/data
- name: t265
  role: aux
  model: calyx
  td: -1.2724534932916494e-06
  b_g:
  - 3.4869060355716172e-06
  - 1.6490166545529015e-05
  - 3.408671644188294e-05
  b_a:
  - -0.001779013601396903
  - 0.0012726564822227247
  - 0.0012058505400187592
  imu_intr_xi:
  - -3.3582145682921647e-06
  - -6.774114074385753e-05
  - -1.3683201722546627e-05
  - -1.4659218161003023e-05
  - -3.8311651965274404e-05
  - -8.203911976859063e-05
  - -3.428278867451384e-06
  - 0.00012999610209405343
  - 1.2269090106530445e-05
  - 1.3813736174364793e-05
  - -7.223280858526904e-06
  - -2.5903877055826276e-05
  - -6.231503257323564e-06
  - -6.424831791235146e-05
  - -8.883977260378774e-06
  - 2.067716586392519e-12
  - 7.130061481820386e-12
  - 7.415101886921506e-12
  - 1.0368243277026099e-14
  - -2.820543332716516e-13
  - -8.891296881172912e-14
  - 2.678908129993664e-12
  - 2.7317666976601236e-12
  - 3.033793269670794e-13
  Dw:
  - - 0.9999966417854317
    - -6.774114074385753e-05
    - -1.3683201722546627e-05
  - - -1.4659218161003023e-05
    - 0.9999616883480347
    - -8.203911976859063e-05
  - - -3.428278867451384e-06
    - 0.00012999610209405343
    - 1.0000122690901065
  Da:
  - - 1.0000138137361743
    - -7.223280858526904e-06
    - -6.231503257323564e-06
  - - 0.0
    - 0.9999740961229442
    - -6.424831791235146e-05
  - - 0.0
    - 0.0
    - 0.9999911160227396
  Dw_diag:
  - 0.999997
  - 0.999962
  - 1.000012
  Da_diag:
  - 1.000014
  - 0.999974
  - 0.999991
  Dw_decomposed:
    Dw_scale:
    - 1.0
    - 0.99996
    - 1.00001
    Dw_shear:
    - -8.0e-05
    - -2.0e-05
    - 5.0e-05
    gyro_misalign_rotvec:
    - 0.00013
    - 3.0e-06
    - -1.5e-05
  p_IsinI_m:
  - 0.05473229652739235
  - -0.10747169770891334
  - -0.03034309947813126
  t_ga: -3.803087892881073e-06
  t_ga_sigma: 1.8026873558198285e-05
  topic: /t265/imu
diagnostics:
  reproj_rms_px: 0.5205
  ok: true
cam_imu_camchain-imucam.yaml · YAML, 4.0 kB (click to expand)

cam_imu_camchain-imucam.yaml

cam0:
  camera_model: pinhole
  distortion_model: equidistant
  distortion_coeffs:
  - -0.005347354934623327
  - 0.035610320275459406
  - -0.031365754979340084
  - 0.004058083465753569
  intrinsics:
  - 286.5328020701859
  - 286.33160196345636
  - 414.9378009570472
  - 402.6344565567343
  resolution:
  - 848
  - 800
  rostopic: /cam0/image_raw
  T_cam_imu:
  - - -0.9997689423769407
    - 0.01935528039783312
    - -0.009350667313879962
    - 0.06621521089756413
  - - 0.009372642466677353
    - 0.001044952985188015
    - -0.9999555298344274
    - -0.02766482713722972
  - - -0.01934464865758637
    - -0.9998121229480971
    - -0.0012261216638462884
    - -0.10947728810074786
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  line_delay: 2.9285971904018556e-15
cam1:
  camera_model: pinhole
  distortion_model: equidistant
  distortion_coeffs:
  - -0.006726748082337003
  - 0.04008989873688737
  - -0.03674820280588232
  - 0.00598982484592293
  intrinsics:
  - 286.50027833753904
  - 286.07505573142635
  - 414.39750867279315
  - 396.9842407447665
  resolution:
  - 848
  - 800
  rostopic: /cam1/image_raw
  T_cam_imu:
  - - -0.9996327559155915
    - 0.02502591105338825
    - -0.010395050579359546
    - 0.0031144298215478603
  - - 0.010362975581565629
    - -0.001411025820602097
    - -0.999945307375973
    - -0.02732575729997663
  - - -0.025039210005417797
    - -0.9996858070324299
    - 0.0011511647245637934
    - -0.10890746587577407
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  line_delay: 9.077192527781733e-16
  T_cn_cnm1:
  - - 0.9999833673324054
    - 0.0010515387910256819
    - -0.005670919212484471
    - -0.06369142595796315
  - - -0.0010377360361176688
    - 0.9999964936519644
    - 0.0024363472035932397
    - 0.0006744114299495555
  - - 0.005673461241860853
    - -0.0024304217634154544
    - 0.9999809522623863
    - 0.00012483029971093417
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
cam2:
  camera_model: pinhole
  distortion_model: equidistant
  distortion_coeffs:
  - -0.0931975611033997
  - -0.007470877695349147
  - -0.02239755497874043
  - 0.01782481728812361
  intrinsics:
  - 426.8930008861213
  - 426.4472448254193
  - 350.40748428029104
  - 265.938084140461
  resolution:
  - 640
  - 480
  rostopic: /cam2/image_raw
  T_cam_imu:
  - - -0.9984669789095153
    - 0.04248262756981117
    - 0.0354812398609481
    - -0.08327335884201302
  - - -0.039099964348599685
    - -0.08762392880480897
    - -0.995385975332558
    - -0.03557799289810481
  - - -0.03917760604278427
    - -0.9952473428528075
    - 0.08915066869733458
    - -0.11345831982718772
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  line_delay: 3.4775613261233745e-05
  T_cn_cnm1:
  - - 0.998794634993937
    - -0.04588633230470237
    - -0.017427610706882868
    - -0.08953591033714066
  - - 0.04723982402914254
    - 0.9950499827119098
    - 0.08742957697898816
    - 0.0009871099854782072
  - - 0.013329521110075671
    - -0.08814746968944454
    - 0.9960182465468814
    - -0.007434706851127866
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
cam3:
  camera_model: pinhole
  distortion_model: equidistant
  distortion_coeffs:
  - -0.08938535917526613
  - -0.017990403516830705
  - -0.004270957666424365
  - 0.0059575027795676395
  intrinsics:
  - 423.57880082083886
  - 423.10849172415243
  - 336.4993790533729
  - 256.92849030517397
  resolution:
  - 640
  - 480
  rostopic: /cam3/image_raw
  T_cam_imu:
  - - -0.9988133056907974
    - 0.029041447970331105
    - 0.03909699061062879
    - -0.1441202957894711
  - - -0.04095392194718245
    - -0.06636734711087654
    - -0.996954438033458
    - -0.034231044118127774
  - - -0.026358236894093175
    - -0.9973725329771476
    - 0.06747795055115309
    - -0.11245057736325599
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
  line_delay: 3.486799653619816e-05
  T_cn_cnm1:
  - - 0.9999030705476258
    - -0.002407757257451728
    - 0.013713213132565532
    - -0.059384793637680955
  - - 0.0026984998846903414
    - 0.9997711302503346
    - -0.0212227523272151
    - -0.0008443786182725493
  - - -0.01365897535697063
    - 0.02125770032151056
    - 0.99968072031486
    - 0.0005903950820545303
  - - 0.0
    - 0.0
    - 0.0
    - 1.0
cam_imu.json · JSON, 7.9 kB (click to expand)

cam_imu.json

{
  "input": "4imus_4cams_01.roundtrip_corrected.bag",
  "ok": true,
  "reproj_rms_px": 0.52,
  "reproj_median_px": 0.247,
  "reproj_p95_px": 0.681,
  "solve_s": 539.2,
  "cams": [
    {
      "name": "cam0",
      "td_ms": 0.004,
      "reproj": 0.548,
      "reproj_median": 0.256,
      "reproj_p95": 0.741,
      "intr": [
        286.5328,
        286.3316,
        414.9378,
        402.63446,
        -0.00535,
        0.03561,
        -0.03137,
        0.00406
      ],
      "p_CinI_mm": [
        64.34,
        -110.71,
        -27.18
      ],
      "rotvec": [
        -0.03182,
        -2.2176,
        2.21503
      ],
      "corner_accounting": {
        "camera": 0,
        "model": "equidistant",
        "n_corners": 46202,
        "used": 46202,
        "past_fold": 0,
        "past_fold_pass1": 0,
        "other_invalid": 0,
        "no_pose_frames": 2,
        "no_pose_corners": 8,
        "discarded_pose_corners": 0,
        "outliers": 0,
        "filter_removed": 0,
        "removed_invalid": 0,
        "max_theta_deg": 73.36268980246804,
        "max_theta_used_deg": 73.36268980246804,
        "fold_deg": null,
        "fold_level": "none",
        "detected": 276852,
        "not_in_solve": 230642
      }
    },
    {
      "name": "cam1",
      "td_ms": 0.0,
      "reproj": 0.575,
      "reproj_median": 0.246,
      "reproj_p95": 0.699,
      "intr": [
        286.50028,
        286.07506,
        414.39751,
        396.98424,
        -0.00673,
        0.04009,
        -0.03675,
        0.00599
      ],
      "p_CinI_mm": [
        0.67,
        -108.99,
        -27.17
      ],
      "rotvec": [
        -0.03921,
        -2.21243,
        2.21539
      ],
      "corner_accounting": {
        "camera": 1,
        "model": "equidistant",
        "n_corners": 23472,
        "used": 23472,
        "past_fold": 0,
        "past_fold_pass1": 0,
        "other_invalid": 0,
        "no_pose_frames": 2,
        "no_pose_corners": 8,
        "discarded_pose_corners": 0,
        "outliers": 0,
        "filter_removed": 0,
        "removed_invalid": 0,
        "max_theta_deg": 75.41064511301929,
        "max_theta_used_deg": 75.41064511301929,
        "fold_deg": null,
        "fold_level": "none",
        "detected": 282196,
        "not_in_solve": 258716
      },
      "p_CtoC0_mm": [
        63.69,
        -0.61,
        -0.49
      ]
    },
    {
      "name": "cam2",
      "td_ms": -0.004,
      "reproj": 0.391,
      "reproj_median": 0.229,
      "reproj_p95": 0.564,
      "intr": [
        426.893,
        426.44724,
        350.40748,
        265.93808,
        -0.0932,
        -0.00747,
        -0.0224,
        0.01782
      ],
      "p_CinI_mm": [
        -88.98,
        -112.5,
        -22.34
      ],
      "rotvec": [
        -0.00387,
        -2.08357,
        2.27679
      ],
      "corner_accounting": {
        "camera": 2,
        "model": "equidistant",
        "n_corners": 14010,
        "used": 14010,
        "past_fold": 0,
        "past_fold_pass1": 0,
        "other_invalid": 0,
        "no_pose_frames": 2,
        "no_pose_corners": 36,
        "discarded_pose_corners": 0,
        "outliers": 0,
        "filter_removed": 0,
        "removed_invalid": 0,
        "max_theta_deg": 56.619925612937834,
        "max_theta_used_deg": 56.619925612937834,
        "fold_deg": null,
        "fold_level": "none",
        "detected": 147012,
        "not_in_solve": 132966
      },
      "p_CtoC0_mm": [
        153.21,
        -6.27,
        4.75
      ]
    },
    {
      "name": "cam3",
      "td_ms": -0.001,
      "reproj": 0.443,
      "reproj_median": 0.244,
      "reproj_p95": 0.591,
      "intr": [
        423.5788,
        423.10849,
        336.49938,
        256.92849,
        -0.08939,
        -0.01799,
        -0.00427,
        0.00596
      ],
      "p_CinI_mm": [
        -148.32,
        -110.24,
        -20.9
      ],
      "rotvec": [
        0.0135,
        -2.11302,
        2.25958
      ],
      "corner_accounting": {
        "camera": 3,
        "model": "equidistant",
        "n_corners": 15314,
        "used": 15314,
        "past_fold": 0,
        "past_fold_pass1": 0,
        "other_invalid": 0,
        "no_pose_frames": 0,
        "no_pose_corners": 0,
        "discarded_pose_corners": 0,
        "outliers": 0,
        "filter_removed": 0,
        "removed_invalid": 0,
        "max_theta_deg": 58.58745196772238,
        "max_theta_used_deg": 58.58745196772238,
        "fold_deg": null,
        "fold_level": "none",
        "detected": 160848,
        "not_in_solve": 145534
      },
      "p_CtoC0_mm": [
        212.56,
        -8.27,
        3.64
      ]
    }
  ],
  "diagnostics": {
    "iterations": 5,
    "cam_chi2_dof": 0.1355,
    "imu_chi2_dof": 0.1357,
    "n_states": 2398,
    "max_iterations": 40
  },
  "board": {
    "T_BinW": [
      [
        0.999986,
        -0.005048,
        0.001593,
        -0.003691
      ],
      [
        0.000331,
        0.359948,
        0.932972,
        -0.007588
      ],
      [
        -0.005283,
        -0.932959,
        0.359944,
        -0.000936
      ],
      [
        0.0,
        0.0,
        0.0,
        1.0
      ]
    ],
    "g_inB": [
      0.005283,
      0.932959,
      -0.359944
    ],
    "normal_tilt_deg": 68.9032,
    "g_inplane_deg": 89.6755,
    "shape": {
      "rms_mm": 2.2105,
      "p2p_mm": 8.8777,
      "offset_rms_mm": 0.703,
      "n_seen": 72,
      "file": "cam_imu_board_shape.yaml"
    }
  },
  "imu_model": "calyx",
  "Dw_diag": [
    1.00001,
    1.0,
    0.99996
  ],
  "Da_diag": [
    0.99994,
    1.00006,
    1.0
  ],
  "Dw_scale": [
    1.00001,
    1.0,
    0.99996
  ],
  "Dw_shear": [
    1e-05,
    2e-05,
    -1e-05
  ],
  "gyro_misalign_rotvec": [
    9.8e-05,
    -1.4e-05,
    -5.7e-05
  ],
  "t_ga_ms": 0.3012,
  "t_ga_sigma_ms": 0.0225,
  "imus": [
    {
      "name": "gx3_25",
      "td_ms": 0.002,
      "t_ga_ms": 0.0027,
      "t_ga_sigma_ms": 0.0193,
      "chi2_dof": 0.284,
      "p_IsinI_mm": [
        -122.8,
        -45.3,
        -3.06
      ],
      "rotvec": [
        2.25031,
        2.18494,
        -0.02783
      ],
      "Dw_diag": [
        1.00002,
        0.99999,
        0.99997
      ],
      "Da_diag": [
        0.99999,
        1.00001,
        0.99999
      ],
      "Dw_scale": [
        1.00002,
        0.99999,
        0.99997
      ],
      "Dw_shear": [
        2e-05,
        5e-05,
        7e-05
      ],
      "gyro_misalign_rotvec": [
        8e-06,
        -8e-06,
        1.2e-05
      ]
    },
    {
      "name": "gx3_35",
      "td_ms": 0.002,
      "t_ga_ms": 0.0062,
      "t_ga_sigma_ms": 0.0213,
      "chi2_dof": 0.309,
      "p_IsinI_mm": [
        -82.28,
        -46.23,
        -3.46
      ],
      "rotvec": [
        2.23049,
        2.20706,
        -0.01912
      ],
      "Dw_diag": [
        1.00002,
        0.99999,
        0.99997
      ],
      "Da_diag": [
        0.99999,
        1.00001,
        0.99998
      ],
      "Dw_scale": [
        1.00002,
        0.99999,
        0.99997
      ],
      "Dw_shear": [
        1e-05,
        4e-05,
        7e-05
      ],
      "gyro_misalign_rotvec": [
        1.4e-05,
        -9e-06,
        1.8e-05
      ]
    },
    {
      "name": "t265",
      "td_ms": -0.001,
      "t_ga_ms": -0.0038,
      "t_ga_sigma_ms": 0.018,
      "chi2_dof": 0.666,
      "p_IsinI_mm": [
        54.73,
        -107.47,
        -30.34
      ],
      "rotvec": [
        1.57242,
        -0.00538,
        -0.01139
      ],
      "Dw_diag": [
        1.0,
        0.99996,
        1.00001
      ],
      "Da_diag": [
        1.00001,
        0.99997,
        0.99999
      ],
      "Dw_scale": [
        1.0,
        0.99996,
        1.00001
      ],
      "Dw_shear": [
        -8e-05,
        -2e-05,
        5e-05
      ],
      "gyro_misalign_rotvec": [
        0.00013,
        3e-06,
        -1.5e-05
      ]
    }
  ]
}

11. Configuration

Run configuration · YAML, 125 lines, copy-paste ready (click to expand)
input:
  format: ros1
  path: 4imus_4cams_01.roundtrip_corrected.bag
  bags: []
  cam_topics:
  - /t265/fisheye1/image_raw
  - /t265/fisheye2/image_raw
  - /elp/split_sync_image_node/left/image_raw
  - /elp/split_sync_image_node/right/image_raw
  imu_topics:
  - /imu/data
  - /gx3_25/data
  - /gx3_35/imu/data
  - /t265/imu
  t0: 3.0
  window: 0.0
  min_obs: 4
  cache_dir: detcache
  window_mode: motion
  segment_length: 80.0
  imus: []
board:
  board_type: apriltag
  rows: 6
  cols: 6
  square_size: 0.025
  tag_family: t36h11
  tag_size: 0.088
  tag_spacing: 0.3
  aruco_dict: DICT_6X6_250
  marker_size: 0.02
  marker_separation: 0.005
  refine_subpixel: false
  heights_file: board_shape_4imus_4cams.yaml
  detection:
    min_tag_px: 20.0
    max_scale: null
    module_px_target: 25.0
    early_stop_rate: 0.95
    moderate_rate: 0.7
camera_input:
  path: camera_prior.yaml
  free_intrinsics: true
  estimate_readout: false
  rolling_mode: 0
  cameras:
  - {}
  - factor_hz: 4.0
  - estimate_readout: true
    factor_hz: 4.0
  - estimate_readout: true
    factor_hz: 4.0
solve:
  rms_gate_px: 0.0
  state_hz: 30.0
  factor_hz: 10.0
  sigma_px: 1.0
  huber_px: 2.0
  sigma_g: 0.00065
  sigma_bg: 0.001
  sigma_a: 0.0026
  sigma_ba: 0.002
  imu_intrinsics: dw_da
  imu_intrinsics_model: calyx
  pnp_method: iterative
  sigma_dw_da: 0.1
  sigma_tg: 0.05
  sigma_imu_R: 0.1
  estimate_readout: false
  rolling_mode: 0
  max_interp_dt: 0.3
  knot_hz: 0.0
  vision_pose: imu
  vision_imu_gyro: calibrated
  vision_imu_dw_column: true
  vision_imu_anchor: lower
  vision_imu_linearized: true
  vision_imu_t_ga: true
  vision_imu_frame_dt_sigma: 0.0
  sensor_clock_frame_dt_sigma: 0.02
  estimate_extrinsics: true
  estimate_td: true
  estimate_aux_extrinsics: true
  estimate_aux_td: true
  estimate_board_heights: true
  board_height_sigma: 0.003
  estimate_t_ga: true
  sigma_t_ga: 0.01
  bound_intrinsics: false
  tga_relin_threshold_s: 0.003
  imu_min_rate_hz: 200.0
  imu_upsample_method: cubic
  aux_imu_factor_hz: 0.0
  aux_imu_stride: 3
  sigma_td_prior: 0.0
  corner_subsample: two_anti
  sigma_v0: 0.5
  sigma_bg0: 0.01
  sigma_ba0: 0.1
  max_iterations: 40
  lm_lambda_lower: 0.0
  lm_lambda_upper: 100.0
  z_min_frac: 0.6
  z_min_floor: 0.05
  init_kwargs: {}
output:
  path: cam_imu.json
  calib_yaml: null
  kalibr_yaml: null
  report_html: null
  report_txt: null
estimate:
  camera:
    intrinsics: true
    distortion: null
    tr: false
    td: true
    extrinsics: true
  imu:
    intrinsics: dw_da
    model: calyx
    extrinsics: true
    td: true
  board_points: true
reference: {}