Preheat the oven to 350°F (180°C). Line an 8-inch square pan or a 9-inch round baking pan with parchment paper. Set aside.
For the crumble: Rub the flour, brown sugar, and cold diced butter together with your fingertips until coarse crumbs form. Chill the streusel in the freezer while you prepare the cake. This helps the crumbs stay crisp and defined as the cake bakes.
For the cake: whisk together gluten-free all-purpose flour, baking powder, baking soda, salt, and ground cinnamon in a medium bowl. Set aside.
In a large bowl, beat the softened butter and sugar on high speed using a hand mixer or stand mixer fitted with a paddle attachment until pale and smooth. Add the eggs, vanilla extract, almond extract, and buttercream, and beat on medium speed until integrated. The mixture may look slightly curdled at this point; this is normal.
Add the dry ingredients and keep beating on low speed until combined. Don’tovermix, just until combined.
Transfer the mixture to the prepared pan and smooth it out with a spatula. Arrange the plum slices over the batter, cut-side up, slightly overlapping if necessary, and sprinkle with the streusel and chopped almonds.
Bake for 40 minutes or until a toothpick inserted in the center comes out clean. Keep in mind that all ovens are different.
Let the cake cool in the pan and lift the parchment paper.