Staring with a real physical object, in this case a sandstone brick wall, I create an inexpensive but high quality digital 3d scan using a stills camera and the program Agisoft Photoscan. I then model the lego brick shapes over this scan using 3d software, I make this model fit perfectly onto the scanned wall by using boolean subtraction, I add colours clone stamped from the photos, correct the scale, and finally I do a colour 3d print, which fits seamlessly onto the sandstone wall, producing a novel illusion that would be difficult to achieve by other methods.
Step 1: 3d Scanning
I took around 29 photos from different angles, and the software automatically derived a 3d mesh from those photos. I chose a sandstone block with a chipped off corner, so that my 3d print could fit into empty space left by that missing corner. The process of using agisoft photoscan is very user friendly, but poor quality photos will tend to result in a less detailed mesh with more artifacts. Try to avoid taking photos that are poorly exposed, or out of focus. The object should remain completely still while you take the photos, if it changes shape or moves it's position then the reconstruction probably won't work. The photos should not be taken from dramatically different angles, there must be some level of overlap and similarity among the photos, or a mesh cannot be derived.
I generated the mesh with Target quality set to Medium, and Geometry type set to Smooth. I generated a texture at 2048*2048 using Orthphoto Mapping mode, and Mosaic Blending mode. Then exported the mesh as an .obj file, and the texture as a .bmp.
These programs tend to work best with very textured objects. The texture gives the software features to lock on to. To get the Best results with smooth untextured objects you may have to apply a random blotchy paint pattern. Blotchy facepaint works really well when scanning people, though it may look rather silly! Shiny objects can also cause problems, because they look different from every angle. Shine may be reduced in a number of ways, talcum powder, dulling spray, or it may be filtered out using polarizing filters, one on the lens, and one on the light source. The filter should be rotated until the shine disappears. Large polarizing filters can be bought online, and it's possible to get very cheap small polarizing filters by cannibalizing the lens from a pair of 3d glasses. Some light sources such as the sky, or LDC screens, are already polarized, so they won't need a filter.
In many cases it is possible to approximate tiny micro details from the scanned object. By applying a "high pass" filter (in PhotoShop, or an equivalent image editing program) to the colour texture map one can create an image that may be used as a bump or displacement map. The results may not be perfectly accurate, but in many cases this will result in a visually convincing level of very fine detail.
Step 2: Correcting the Scale
I used a pair of calipers to take measurements from the sandstone block, then I created a box objects in 3ds Max with those measured values in their size. I then scaled the scanned mesh so that it matched up with the size of the box objects.
The same process may be achieved with a number of other programs, including free programs like Blender.
Step 3: 3D Modelling
I built the lego brick shapes using polygon modeling techniques, based on the dimensions of real lego bricks. I first modelled a false chipped off corner, attempting to get as realistic and seamless as possible. Small bumpy details were achieved by using the "displace" modifier, and a procedural noise texture map. I was careful to match the scale of the bumpy details to the scanned mesh. I placed copies of the lego brick model inside the volume of the chipped off corner, as though the sandstone block is made from lego pieces. I then combined my replacement corner model with the lego brick models. This was the most challenging part of the process, and required some careful technical modeling.
Step 4: Cloning Colours
The lighting, exposure, white balance of the photos, and the printing process may result in the colours of the 3d print looking different to the real object, so I've created a small colour sample 3d print to help calibrate the colour balance of the textures. By holding the 3d printed colour sample next to the real object I am able to work out what brightness, hue, and saturation to use.
Step 5: Subtracting the Scan Mesh From the Model
In 3ds Max booleans are achieved by clicking on the Create tab, choosing Compound Objects, clicking the ProBoolean button, and then picking the model you wish to subtract.
Booleans typically only work with "watertight" models, so I was careful to avoid open edges as I built the mesh. In some cases a simple "cap holes" modifier is enough to make a boolean operation successful.
Step 6: 3D Printing
I saved the texture maps as a .png files, and exported the object as an .X3D from 3dsmax, which required a plugin. I created a zip file containing the mesh and the texture bitmap, and uploaded it on the shapeways website. It's important to check that the scale is correct, 3d applications handle units in different ways,so some double checking, trial and error, and re-scaling may be necessary to get the correct results. I found that I had to scale my models by 39.37%, (the ratio difference between cm and inches).
Prints in the "full color sandstone material" will have a slightly grainy surface, so going over the print with very fine sandpaper can help. I also gave the 3d prints a thin coat of superglue and matte varnish, to help bring out the colour, as well as seal and protect the surface.
Step 7: Painting
I've since printed out a small color sample of the full color sandstone material, which can be used to calibrate the colours of texture maps more accurately.
Step 8: Results, Applications, Limitations, and Possible Variations.
Similar techniques are already used in the medical field, 3d models of bones and other organs can be acquired via CT or MRI scanning, and modifications are printed out in bio-compatible materials. Potentially in the future 3d prints may even be made using the patient's own cultured cells.
On a more prosaic level, these techniques could be used to repair or customise objects. Custom toys, hobby models, jewelery, cases for electronic devices, prosthetics, etc. The applications are limitless.
The main limitation of this technique is size. Larger 3d prints are exponentially more expensive than smaller prints, and shapeways currently prints at a maximum size of 25x38x20cm using the "full color sandstone" material.
A range of different effects may be achieved through variations on the technique that I describe in this tutorial. One potential example would be to create embossed text on practically any surface, as shown in the image above. For this tutorial I subtracted a 3d scan from a digital model, but it is also be possible to subtract a 3d model from itself, thereby creating a 3d print that can be tiled or tessellated. An example of this is shown in the second image above, I created a 3d printed hand that perfectly fits onto copies of itself, so once it's duplicated (in this case through a silicone mold) it may be tessellated into a sphere shape.
So, to conclude, these technologies open up a wide range of interesting and exciting creative effects that were not possible in the recent past, I'm very excited to see what other people are able to achieve with these techniques.