In a medium bowl, whisk together all-purpose flour, whole-wheat flour, baking powder, baking soda, cinnamon, ginger, nutmeg, cloves and salt. Set aside.
In a larger bowl, whisk the eggs and sugars until combined. Whisk in the pumpkin puree, oil, buttermilk and vanilla. Stir in the dry ingredients until combined. Spread about 2/3 of the batter evenly into the prepared pan. Set aside.
In a bowl, with an electric mixer on medium speed, beat cream cheese, egg, sugar and vanilla until fully incorporated and smooth, scraping down the sides if necessary.
Spread this cream cheese mixture evenly over the pumpkin batter. Dollop the remaining pumpkin batter over the cream cheese layer. Take a butter knife and gently swirl the batter. Sprinkle the walnuts over the top, and using a spatula, gently press into the batter.