Making a VCD isn't as simple as burning the mpegs to a cd-r. A VCD also needs quite a few other files and headers to play as a VCD. A VCD contains 4 folders, the mpegs are located in one of these. You can do this manually but its quite difficult, you should try to find a program to do this for you.
Also, I hate to sound negative but many stand-alone DVD players don't like cd-r's. Its worth making sure that the DVD players you intend to watch the discs on will not only play VCD's but also cd-r's as pre-recorded, bought VCD's are not the same as ones you have burned yourself using cd-r's.
I hope it works for you but you could save yourself a lot of time and effort if you find out first that your equipment isn't compatible.