I did a little fiddling with this again tonight, bypassed the crystal filter with a much narrower one that has less loss and probably sounds better, to boot.
It still needs more gain in the IF but there is not much I can do about that other than redesign it with regular old BJT amps or get faster, higher slew rate opamps to replace these, and well I am not spending $5 plus on an opamp to see if that fixes the problem. So this one as hit the end of the road and is as far as I can take it. But, its working and now sounding sort of OK.
You can hear the receiver copying some CW in the above video, the 2 guys were the only signals on the band and they were not much weaker on my homebrew than they were on the Icom. So the receiver is sensitive enough, but there is a lot of room for improvement.