Thanks so much for the tag,
@Goonergal, and welcome to the forum,
@KR50fifty. Let me also tag
@shelley262, who might also have some good ideas.
If it is any consolation, it took me many, many attempts to get a handle on low-carb baking. So, you are not alone in your frustrations.
So, if almond flour doesn't work for you tastewise, there are lots of other non-grain and low-carb alternatives that you can try (some are even lower carb than almond flour and also significantly less expensive).
The ones I can think of off-hand are:
Oat fiber, lupin flour (these two are my favorites), sunflower seed flour, coconut flour, pumpkin seed flour (wouldn't use too much of it, though, the flavor is very distinct), sesame flour, potato fiber. Very often a mix of different flours will work better than just a single flour. For example, for bread rolls, I use a mix of oat fiber (half a cup), lupin flour (half a cup), almond flour (1/4 of a cup) and potato fiber (1/8 of a cup).
Of course, as you will probably already know, with all of these low-carb flours, you need to add something that increases the elasticity of the dough, which can be either pure gluten (which is usually very low carb, but obviously isn't an option if you are gluten intolerant or sensitive) or psyllium husk powder and some type of leavening agent such as baking powder or yeast. In the above recipe I use 1/4 cup of psyllium husk and some baking powder plus plenty of hot water.
Let us know how you progress. Keeping my fingers crossed for you.