You can run MacOS X in VMware (and other virtual machines) by using a modified virtual image or a special patch to add Mac OS support. If you have a Hackingtosh (standard PC with Mac OS installed) then you can dual boot by adding the necessary boot entries in Windows boot loader with EasyBCD (or manually). Or you can add just use Chameleon or whichever Hackintosh boot loader which also allows you to boot into Windows. The safest is to disconnect your Windows hard disk and try any Mac stuff in a separate disk. When successful you can connect both disks and dual-boot. If you are an advanced user, you can shrink your Windows partition, make room for Mac. Then create a new FAT32 partition to the empty space. Boot into Mac OS installer and use Disc Utility to convert the FAT32 partition to MacOS Extended Journaled. Then try installing MacOS there.
For more help about Hackingtoshes, see the
Insanelymac forum. Before trying anything, make sure your hardware supports the Mac OS X version you want to install. The newer the version, the most current must be your PC or it won't work.
In case your Mac installation fails and you cannot boot into Mac or Windows, use the Mac installer (assuming on DVD or USB flash drive) to try reinstalling. If nothing works, use Windows 10 DVD-ROM to repair startup and restore Windows boot loader so your can at least boot into Windows 10. That's why I said you must be an advanced user to dual-boot from a single hard disk. It is not that simple.
An alternative is to temporarily install Mac OS on a separate disk (can also be a USB disk or USB flash drive with enough space) while having your Windows hard disk disconnected. Once successful, connect your hard disk again, shrink Windows partition and create a new FAT32 partition for Mac. Then boot to Mac OS. Use Disk Utility to convert that partition to MacOS Extended Journaled. Then download the SuperDuper utility to clone the successful Mac OS installation on that new partition on your Windows disk. Warning: This doesn't make the partition bootable! You have to use another media (DVD or USB) to boot Mac OS on the new partition. Then install the Mac boot loader again on your disk. This will allow you to boot to Mac OS by default, but also select to boot into Windows 10. You can then modify the boot configuration to make Windows 10 default if you want. Or you can just boot into Windows 10 and use EasyBCD to add a boot entry for Mac OS.
Advice: Do all Apple Updates, but avoid those combo that upgrade the Mac OS version. They frequently fail and screw your Mac OS installation. Also your Hackintosh is set to pretend it is an actual Apple model, so Mac OS can work. Avoid any updates referring to firmware or hardware for obvious reasons!