About evaluation on custom datasets

[XLR-man]

I have changed my custom datasets which are colmap data format to .torch files.

And when i test it, it got an error:

Traceback (most recent call last):
  File "/data/xielangren/project/pixelsplat/src/main.py", line 130, in train
    trainer.test(
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/trainer/trainer.py", line 775, in test
    return call._call_and_handle_interrupt(
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/trainer/call.py", line 48, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/trainer/trainer.py", line 817, in _test_impl
    results = self._run(model, ckpt_path=ckpt_path)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/trainer/trainer.py", line 1012, in _run
    results = self._run_stage()
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/trainer/trainer.py", line 1049, in _run_stage
    return self._evaluation_loop.run()
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/loops/utilities.py", line 179, in _decorator
    return loop_run(self, *args, **kwargs)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/loops/evaluation_loop.py", line 145, in run
    self._evaluation_step(batch, batch_idx, dataloader_idx, dataloader_iter)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/loops/evaluation_loop.py", line 437, in _evaluation_step
    output = call._call_strategy_hook(trainer, hook_name, *step_args)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/trainer/call.py", line 328, in _call_strategy_hook
    output = fn(*args, **kwargs)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/lightning/pytorch/strategies/strategy.py", line 425, in test_step
    return self.lightning_module.test_step(*args, **kwargs)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 549, in wrapped_fn
    return wrapped_fn_impl(args, kwargs, bound, memos)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 473, in wrapped_fn_impl
    out = fn(*args, **kwargs)
  File "/data/xielangren/project/pixelsplat/src/model/model_wrapper.py", line 164, in test_step
    gaussians = self.encoder(
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 549, in wrapped_fn
    return wrapped_fn_impl(args, kwargs, bound, memos)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 473, in wrapped_fn_impl
    out = fn(*args, **kwargs)
  File "/data/xielangren/project/pixelsplat/src/model/encoder/encoder_epipolar.py", line 165, in forward
    gaussians = self.gaussian_adapter.forward(
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 549, in wrapped_fn
    return wrapped_fn_impl(args, kwargs, bound, memos)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 473, in wrapped_fn_impl
    out = fn(*args, **kwargs)
  File "/data/xielangren/project/pixelsplat/src/model/encoder/common/gaussian_adapter.py", line 89, in forward
    harmonics=rotate_sh(sh, c2w_rotations[..., None, :, :]),
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 549, in wrapped_fn
    return wrapped_fn_impl(args, kwargs, bound, memos)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/jaxtyping/_decorator.py", line 473, in wrapped_fn_impl
    out = fn(*args, **kwargs)
  File "/data/xielangren/project/pixelsplat/src/misc/sh_rotation.py", line 19, in rotate_sh
    alpha, beta, gamma = matrix_to_angles(rotations)
  File "/data/xielangren/miniconda3/envs/pixelsplat/lib/python3.10/site-packages/e3nn/o3/_rotation.py", line 404, in matrix_to_angles
    assert torch.allclose(torch.det(R), R.new_tensor(1))
AssertionError

how can i solve it?

[StriveZs]

Hi, can you provide your solution for converting colmap data format to .torch files? THX

[Fanjunyi55]

你好，你能提供一下将 colmap 数据格式转换为 .torch 文件的解决方案吗？感谢

您好，请问您能运行自己的数据吗？