Both CPU and Fan Spins At the Begining, But Shuts Off before Starting

I have a small HP tower that after a bit of backing up and Upgrading the OS, finally went along to seeing what was wrong with the tower itself. It originally had appeared to be a power supply issue, however, once I replaced the power, and used one of a similar wattage, I found it where the fans for the power supply spun just perfectly, but the cpu and fan coolers didn't; at least not for long. I found it where the Fans would spin once the Power cord was connected, but the CPU and tower fans would shut off once I had pressed the Power button to turn on the computer, turning off before any image could boot onto the screen. I had theorized that it maybe something on the board, but it seems like everything should be wired up to snuff. Especially the Power Jumpers. Otherwise, the Ram should be alright, so I'm Not exactly sure the Issue here, can anyone help?

I have a HP Pavilion desktop and the fans rev up the go to idle everytime I start the computer. I've had this computer for a few years and it has done this since day one. Never had a problem so I believe this is normal.