Project: Simple custom GPU accelerated filtering and volume rendering pipeline #1565
Description
Draft Status
Ready - team will start page creating immediately
Category
VR/AR and Rendering
Key Investigators
- Simon Drouin (ETS Montreal, Canada)
- Rafael Palomar (Oslo University Hospital, Norway)
Project Description
3D Slicer has the potential to be a powerful dissemination platform for novel 3D rendering methods targeted at medical imaging. However, its complex architecture is challenging for most experienced graphics programmers. It is difficult to create extensions that implement novel graphics pipeline without mastering a large portion of the Slicer architecture.
Thibault Pelletier at Kitware France has recently contributed a powerful Slicer extension called Layer Displayable Manager. This extension simplifies the creation of new interactive VTK-based graphics rendering pipeline, both from Loadable or Scripted modules.
Kyle Sunderland has created another valuable tool: vtkGPUImageFilters. Each filter in this collection can be connected to the regular VTK pipeline, but use GPU for processing without having to bring the data back to the CPU memory between filters. The code is not yet integrated in VTK and is still a
The combination of Layer Displayable Manager and vtkGPUImageFilters has the potential to enable a new range of GPU accelerated filtering and volume rendering effects.
Objective
The goal of this projet is to generate a proof of concept of the potential provided by the integration of LayerDisplayableManader and vtkGPUImageFilters. The project aims at:
- Creating an experimental scripted module that can apply a gaussian blur to a volume in the GPU
- Render the resulting volume without bringing the filtered image back to the CPU memory.
Approach and Plan
- Build a simple volume rendering scripted module that implements a custom pipeline using the Layer Displayable Manager extension and the existing vtkGPUVolumeRaycastMapper
- Build Kyle Suntherland’s vtkGPUImageFilter as an external VTK module. This step may require major modifications in the code as this collection of filter was implemented for a version of VTK from 2019.
- Link the vtkGPUImageFilter module to be usable in the scripted module developed in step 1.
- In the loadable module, implement a class that derives from vtkGPUVolumeRaycastMapper but is able to take a volume already in the GPU as an input.
- Modify the pipeline of the module developed in the first step to filter the input volume and pass it on to the volume rendering mapper.
Progress and Next Steps
- Describe specific steps you have actually done.
Illustrations
No response
Background and References
- Layer Displayable Manager on GitHub
- vtkGPUImageFilters (branch on Kyle Sunderland's VTK fork)