If the map control size is bigger, the area it rendered at the same time is bigger, which means it read more data, and takes much more time on render them. So I think the performance is slower is understandable.
The best solution for your scenario is cache. You can group the layers whose data source won't get changed high frequency, and set cache for them.
And don't forget build index for layers also.