Preheat oven to 375°F.
Combine sugars in a large bowl. Mix. Divide mixture into halves and place in separate bowls.
To one bowl of sugar/brown sugar, add cinnamon, eggs, vanilla, bourbon, nutmeg and salt. Mix well. Set aside.
In a medium saucepan, add milk, half & half, butter and the other 1/2 of the sugar/brown sugar.
Place over medium heat and, stirring to mix and dissolve the sugars, bring to a boil.
Remove from heat and immediately add 2 tablespoons mixture to the sugar/brown sugar/eggs mixture. Whisk to mix well.
Repeat with another 2 tablespoons. (This process prevents the hot liquid from cooking the eggs.)
Whisk the rest of the milk mixture into egg mixture.
Add raisins, reserving a small handful to sprinkle on top later, and apples. Stir.
Add bread cubes. Let stand until soaked through to center. Stir very gently (do not destroy the bread cubes) to mix.
Pour batter into buttered 10 x 13 x 3-inch baking dish.
Sprinkle reserved raisins on top.
Place in preheated oven and bake for 45 minutes.
Serve warm with vanilla ice cream.