Let's make a fully 3D visualization to see whether it works at all.
We can't really make use of SVG. Instead, we will use WebGL. In general WebGL is way too complex to use unless you have graphics and shader dev experience. Shaders are notoriously challenging to get right.
To make things a bit easier, we will use three.js, a graphics library that uses WebGL. Lots of web tools use it, and it is quite performant. Documentation and Examples
In practice, doing things in 2.5d, or an isometric projection, might be a bit easier (but it comes with its own trade-offs). We won't demo that today, but you can try out the Isomer library which actually works pretty well with d3 conventions.