I will make*the*critical assmption that you want lots of help and answers, since you say that you are a new boater with a 20 foot boat with a single outboard engine.
I can not give you the answer you want, but I can help you make the decision . . . remember this is a personal decision so don't let people force you into doing something you are nmot ready for
There are a few days per month when the Inlet is easy to navigate and the seas are calm, so it is easy to get out to the stream . . .
now for the difficult questions
1.* Will you have enough fuel to get back?
2.* Will the weather be nice when you come back? . . . no guarantee there
3.* What is your back-up plan if your engine dies? . . . will you always boat with a buddy
4.* How good are your navigations skills to get you back to your dock?
5.* What will be the conditions at the Inlet when you enter?
I have lots of on water experience but I am relatively new to the conditions you will find fishing off of the Outer Banks and similar areas . . . the Inlet conditions can be extreme and sometimes overpowering . . . my experience last year has lead me to the conclusion (my personal conclusion and many here on this forum will say I am a chicken) that I would not take my previous boat, a 24 footer, to the gulf stream except on the very very best of days, after consulting the tide charts to see what the Inlet will be like when I return, and that I am buddied up with someone for the entire trip.
Again, lots of guys will venture out and get back safely, however, a few have run into major problems . . . the risk is yours to take
Personally, I fish a 34 footer out of Pirates Cove near Oregon Inlet, 10 foot beam, and there are many days that I don't go out . . . but again that is my preference.