I think the problem is related to both hardware and software. For this configuration, 4-layer PCB is the least and 6-layer is preferred if you can afford. Try to use smaller size SMD components which always have less EMI problem than thru-hole component. For example, a BGA package DSP is always having less EMI than a QFP package.