I am looking about 3 or 4 feet above and in front of the trap house with a soft focus.
Before reading this, understand I'm still learning but here's some things that helped my consistency.
My guess is you're allowing your peripheral vision to dictate your move which in-turn leads me to believe you're moving your gun well before actually "seeing" it.
Try picking out a spot, be it a branch, clump of weeds, a hole in the trees, anything definitive that your eyes pick up easily upon taking your post. This should be in a general area, ideally in the middle of the target path on that post so angles don't surprise you. Focus on that then when others call their targets, follow the target from that spot through the break and immediately move your eyes back to that spot and be ready for the next target, repeat. My theory is that this will allow your subconscious to tune your timing based on where you're looking with the end goal to smooth you out when it's your turn.
IMO, not moving your gun means your eyes are on target and the rest will follow. I've often noticed that my gun doesn't budge on a broken target/no target which invokes confidence. I've also had others mention that on slight angles my gun doesn't appear to move. I perceive a slight push to it but others don't. Sometimes I believe some think they
have to move, chase or swing through it. Meh, to me less is more. Trust your eyes with the end goal to eventually have your gun shooting where you're looking which isn't as easy as it sounds, especially if you don't have the adjustments to do so. And as you grow, it will change - I think you're discovering this now.
A couple more questions...
What gun are you shooting? Brand is irrelevant, I'm looking for what (if any) adjustability options are present.
When you miss (for the most part) do you have any idea as to why?
Also, don't be hard on yourself if you're not breaking the scores you think you should. The only way to get the negative thoughts out of your head is to focus on what you did right. Too often I read, "what am I doing wrong?" rather than helping shooters build off of what they're doing right.