All boats will have some oil in the bilge...
Do you have a lube bottle on the engine? watch the level there to see if it is dropping. If it is the small rubber line back to transom can leak or if the input shaft seal of the drive leaks into bellows it can eventually get enough in there to leak...