What's the idle doing during this time? Is it fluctuating? Are the windshield wipers on, or maybe the AC? Maybe turning the steering wheel? It's possible a variable engine or electrical load (I think this car has an electrically powered PS pump, right?) is causing the idle to drop momentarily, which will roughen it up depending on how low it goes.