Its deffinatly doable. Just annoying. After 4hours I FINALLY got it with Ryu. Then tried time attack and did it first try, thank frikin God. I think you gotta be lucky and run into noone but basic strikers, and bayman. J don't mind fighting bayman his attacks are obvious.
Now just got lisas to obtain now....joy