RF and extremely high speed boards are some of the most difficult to layout, since there are a lot of constraints that need to be taken into account that don’t apply (as much) to regular board design.  High speed boards require a concerted willingness to learn and improve, some good old detective work to figure out what happened when things do go wrong, and a willingness to put your money where your mouth is a learn by making mistakes and trying again until you understand what works and what doesn’t.

While I wouldn’t say there’s a lot of good information out there on this — there alas isn’t, and what does exist isn’t always easily accessible if you’re just getting started — Avoid PC-Layout “Gotchas’ in ISM-RF Products from Maxim does cover some of the basics of correctly layout out the RF front end on boards in a reasonably accessible manner.  If you’re working on a basic RF board, but don’t know where to start with your layout, you’ll find some good tips and advice here!