One problem related to manual transmission has been reported for the 2004 Lexus RX330. The most recently reported issues are listed below.
Since new the vehicle has both transmission hesitation shifting problems noted by many others. Around 40 mph, asking for acceleration with about 3/4 throtle causes the trnasmission to come out of gear and hunt for about two seconds. This is very dangerous - don't plan on passing anyone. Coasting around 10 mph, mild throtle causes the tranmission to shift hard and lurch the vehicle. Lexus acknowledges the condition, but states it is not "a problem.