Windows 10: Distributed processing in Windows 10? Is it possible?

  1. spapakons's Avatar
    Posts : 2,486
    Windows 10 Pro 64-bit 1803 (April 2018 build 17134.345)
       22 Mar 2016 #1

    Distributed processing in Windows 10? Is it possible?


    Hello!

    Most of us have at least 2 computers connected at the home network. Is it possible to make them cooperate for resource-demanding tasks such as HD video editing? If I get the term right, I think this is called Distributed Processing. So is there any software or whatever that can use 2 or more computers connected at the same network to work in parallel and finish the job faster? The job can be for example HD video editing. For a typical 90 minute movie, my main PC (see my specs) has to work overnight to create an AVHCD-DVD version from the initial MKV video. Let alone the time wasted if I want to edit and normalize the soundtrack first. It would be a good idea to get my secondary computer and even my notebook to help done faster. Is that possible? How? It depends on the application used, or is there a way to apply it for any application? All computers will be connected to the same router/switch with cable to maximize the network bandwidth. I hope a typical 10/100 switch is enough and I won't have to buy a gigabit switch.

    Thank you in advance.

    PS: One last question... do all the computers have to run Windows 10? What if one of them is running Windows 7?
      My ComputerSystem Spec

  2.    22 Mar 2016 #2

    Distributed processing is a viable concept, but only for some application types. That would be for situations where the individual computers could operate semi independently with minimal communication between them required. Few applications fit that requirement. The problem is that with most applications the added processing power of a second computer would be overwhelmed by the overhead of network communication, even with a very fast network. The second computer would be a burden to performance, not an aid. That would seem to be the case with video editing.
      My ComputerSystem Spec

  3. spapakons's Avatar
    Posts : 2,486
    Windows 10 Pro 64-bit 1803 (April 2018 build 17134.345)
    Thread Starter
       22 Mar 2016 #3

    Hello!

    Thank you for your reply. I think you are correct for operations that can be done quickly using a single fast computer (i3 or faster), but editing HD video is not that fast, so I don't think the network speed would cause delays. Is there any application that can split a process between two or more networked computers? Alternatively, is there any video editing application that can be configured for distributed processing (less likely, I think) ?

    Just a thought: In NVidia graphics cards you can use CUDA acceleration in supported applications.
    Question 1: Is there any way to force CUDA to applications that not have native support for it? (Is there any CUDA wrapper?)
    Question 2: Is there a CUDA equivalent for Intel HD graphics? What it is? How it is used?
    Question 3: Is there a way to use OpenCL to applications that not have native support for it? (Is there any OpenCL wrapper?)

    Thank you again.
      My ComputerSystem Spec

  4.    22 Mar 2016 #4

    I don't believe there is any application for distributed processing of video files, nor do I believe such exists. I stand by my statements about the overhead involved. I don't have any practical experience with video editing, distributed or otherwise, but I have been an amateur programmer for more than 35 years and know quite a bit about how software works. That is what my statements are based on.

    I can't help you with the other questions.
      My ComputerSystem Spec

  5. spapakons's Avatar
    Posts : 2,486
    Windows 10 Pro 64-bit 1803 (April 2018 build 17134.345)
    Thread Starter
       23 Mar 2016 #5

    That's OK. Thanks. I guess my best bet is to use my faster computer with an application that allows CUDA or other acceleration and leave my slower computer doing other simpler tasks.
      My ComputerSystem Spec

  6.    23 Mar 2016 #6

    That would be nice if it could work. Video editing, specially compositing can nail an 8 core FX 8350 @5 GHz to 100% usage.
      My ComputersSystem Spec

  7.    23 Mar 2016 #7

    Typically, the application itself has to support distributed processing. This is not something done at the OS level.
      My ComputerSystem Spec


 

Related Threads
Under Win 7 I am almost certain that the DLT service DID NOT repair LNK files if the target was on a removable drive! But under Win 10 it appears that the DLT service DOES repair LNK files if the target is on a removable drive! Is anyone aware...
Anyone participate? Thinking about volunteering my new PC during my away hours. Does it noticeably shorten the lifespan of components, particularly graphics cards and overclocked CPUs?
Word Processing Problem in Software and Apps
I'm old. When I was working I wasn't much for collaboration and now, not at all. I don't want to do layouts or exotic document designs. For years I used Windows Office 2003 and was happy. I could type my documents in Word and send them through...
Yoga 2 11, device: PCI Data Acquisition and Signal Processing Controller anyone know what this is? have tried every ddriver I can find that MIGHT be the device, so far no luck.
An IT security company Norse has an live site online showing currently active Distributed Denial-of-service (DDoS) attacks live on a World map. Take a look, it's quite interesting to see how these attacks happen all the time. The live map: Norse...
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd
All times are GMT -5. The time now is 13:52.
Find Us