"It would also limit where I can take it."
It already does because it exceeds all eBike law, Class or otherwise in all states. You are certainly able to feel otherwise but too many people using these things as eBikes and it will cause issues for eBike access.
New York
A limited use motorcycle having a maximum performance speed between 30 mph and 40 mph shall be a class A limited use motorcycle. A limited use motorcycle having a maximum performance speed between 20 mph and 30 mph shall be a Class B limited use motorcycle. A limited use motorcycle having a maximum performance speed of not more than 20 mph shall be a Class C limited use motorcycle.
A registration issued to a Class B or Class C limited use motorcycle shall be valid only for operation on roads in the right-hand lane available for traffic, or upon a usable shoulder on the right side of the highway. This does not apply when the motorcycle operator is preparing to make a left turn.
A limited use motorcycle shall be subject to the equipment requirements that are applicable to a motorcycle.
A certificate of title is not required for a limited use motorcycle.
The following safety equipment is required: approved protective helmet and eye protection, except for moped classified as Class C limited use motorcycles. Brake acting on both wheels, horn, headlamp, tail lamp, number plate lamp, tires with at least 2/32-inch tread, 1 rear red reflector, muffler, and rearview mirror.
North Carolina
To drive a moped, no license is required, but the operator must be at least 16 years of age.
Mopeds need to be registered and operators need liability insurance.
Although it doesn't say you need a motorcycle endorsement in New York in all the other states I got this clip from some don't require any license at all, or just a regular license but registration and liability insurance seems to be popular.