Optimize for the case where fullscreen is not requested. In that case just
copy the lines into a black destination picture and let the TV do the scaling.
If your TV does not do scaling, then you will see the video in original format.

If the source and destination picture are not of the same chroma (YVUV), then
use the resizer to do chroma conversion and scale at the same time.