Link Search Menu Expand Document (external link)

DVGO: Direct Voxel Grid Optimization

[Project Page] [Paper-v1] [Paper-v2] [Code]

Authors

  • Cheng Sun
  • Min Sun
  • Hwann-Tzong Chen

Table of contents


What’s DVGO?

DVGO (Direct Voxel Grid Optimization)

DVGO (Direct Voxel Grid Optimization) is introduced in the CVPR 2022 oral paper, “Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction”. NeRF trains the neural network from many hours to days for a single scene. DVGO proposes the fast convergence of the neural radiance fields and high-quality generation. By utilizing the coordinate-based neural network, two voxel grid representation learns geometry and view-dependent features of the 3D scene. DVGO proposed the post-activation interpolation on voxel, which predict high-quality synthesis around the sharp surface, and they regularize the voxel grid representation with several priors. It speeds up 2-3x faster than the original NeRF using shallow MLP, and reduces the training time from many hours to 15 minutes.

dvgo

Scores

Blender

ScenePSNRSSIMLPIPSCheckpoint
chair35.200.98090.0283link
drums25.530.93180.0795link
ficus33.230.97980.0258link
hotdog37.440.98140.0345link
lego35.800.97810.0265link
materials30.580.95820.0526link
mic36.410.99090.0126link
ship30.520.88000.1500link

MS-Blender

ScenePSNRSSIMLPIPSCheckpoint
chair37.360.98780.0161link
drums27.120.94580.0561link
ficus33.000.98310.0185link
hotdog39.360.98790.0178link
lego35.710.98400.0174link
materials32.630.97670.0260link
mic37.930.99260.0101link
ship33.240.92350.0818link

LLFF

ScenePSNRSSIMLPIPSCheckpoint
fern24.920.79570.2793link
flower27.800.84300.1937link
fortress31.730.89330.1492link
horns27.790.85710.2236link
leaves20.940.70380.3060link
orchids20.270.64020.3204link
room33.240.95520.1533link
trex27.690.90250.2220link

Tanks and Temples

ScenePSNRSSIMLPIPSCheckpoint
M6018.410.64350.4935link
Playground21.830.66410.4948link
Train17.870.57490.4964link
Truck21.710.69030.4562link

LF

ScenePSNRSSIMLPIPSCheckpoint
Africa28.650.86760.3050link
Basket21.980.81580.4056link
Ship26.430.79680.3650link
Statue29.860.88180.2973link
Torch23.290.75130.4012link

NeRF-360-v2

ScenePSNRSSIMLPIPSCheckpoint
bicycle21.720.42460.5880link
bonsai29.120.84430.3164link
garden23.710.55440.4334link
kitchen27.980.80250.2570link
room30.230.85570.3342link
stump22.740.47220.5716link

Shiny Blender

ScenePSNRSSIMLPIPSCheckpoint
ball26.130.90070.2525link
car26.900.91640.0806link
coffee31.480.96240.1414link
helmet27.750.93150.1541link
teapot44.790.99550.0186link
toaster22.180.84810.2196link