Your pics didn't come through and I would definitely love to see / hear more about how you dealt with the Antec Kuhler and the Q11 case....sounds like a great combo!
Here's recommended install steps, I'll try to get a complete gallery up later.
0. Burn everything in first using stock CPU cooler and whatever RAM. I lost 2 weeks in multiple RMAs trying to get a stable 2x8G setup. Getting back to those slots won't be easy.
1. Dremel or file down backplate so that only 1155/1156 posts are left. Needed for component clearance on DH77DF
2. I chose to top-mount the radiator to get the CPU heat out of the case immediately. I used a 4 3/8" hole saw, a stepped drill bit, and a half-round file to make a nice clean mounting pattern on the top. I also used a reinforced cutting disk on my dremel & file to carve out the 5 1/4" bay bracket to give clearance for the radiator. Mnpctech.com has a great guide on drilling & modding panels if you're not familiar with it.
3. Mount radiator in case
4. Don't mount motherboard, but dry fit it in case with CPU but no RAM
5. Route cables but don't attach to motherboard.
6. Get an idea of where the kuhler backing plate will be in relation to the case
7. Take motherboard out, put a piece of cardboard or book (Intel CPU manual was perfect) where the backplate will be
8. Hold Kuhler backplate on board, then put the motherboard back in the case. The book will hold the backplate where it needs to be
9. Attach CPU block firmly per instructions
10. Lift motherboard slightly, retrieve book
11. Finish mounting motherboard, ram, cables. Do video card then power supply last.
In other news, the Prolimatech Samuel 17 is back at Newegg today. I think that will fit with enough clearance and good cooling if you use a SFX power supply. Its an easier install, and might actually be quieter since there would be no pump noise.