How can I buy Bitcoin with some caveats.

I'm new to buying Bitcoin but known about it for a while so I'm familiar with it. I spent all day trying to figure out my problem and broke down made an account here to get some insight. So new to here too so sorry for any faux pas.

I been buying bitcoin through ATMs mostly through LibertyX but the fees seem a bit much 10-15+%. I opened a coinbase account and used my debit card and the first transaction went through but not anymore so I tried using my bank account and that was a no go. I believe its my bank (I looked it up) I don't have a credit card so what do? I tried PayPal but same problem my bank.

So what's a good bank to use on crypto exchanges, another way of adding $ to my coinbase account or a better way of buying bitcoin when I have no credit card. I just want to buy and put it on my hardware wallet (hodl) without the crazy fees compared to what coinbase fees are. Also I think my state is not so crypto friendly.