Hi there,
The offset option in WordPress does have some issues with pagination, unfortunately.
Are these two lists on separate pages? If so, I would personally suggest just showing the 4 latest posts along with the rest of them. That’s a pretty standard layout, and it will save you a lot of headaches when it comes to battling WordPress with offsets and pagination.