I've never had oysters, but I agree that oyster sauce is quite mild and not really fishy-tasting or anything. It's a really common ingredient in a lot of sauces, though, and I've found it's often the "missing ingredient" to replicating a particular dish (e.g. mu pad king). (Then again, so is fish sauce!)