1.    22 Mar 2016 #1
    Join Date : Sep 2015
    Posts : 2,371
    Windows 10 Pro 64-bit 1706 (CU build 15063.674)

    Distributed processing in Windows 10? Is it possible?


    Hello!

    Most of us have at least 2 computers connected at the home network. Is it possible to make them cooperate for resource-demanding tasks such as HD video editing? If I get the term right, I think this is called Distributed Processing. So is there any software or whatever that can use 2 or more computers connected at the same network to work in parallel and finish the job faster? The job can be for example HD video editing. For a typical 90 minute movie, my main PC (see my specs) has to work overnight to create an AVHCD-DVD version from the initial MKV video. Let alone the time wasted if I want to edit and normalize the soundtrack first. It would be a good idea to get my secondary computer and even my notebook to help done faster. Is that possible? How? It depends on the application used, or is there a way to apply it for any application? All computers will be connected to the same router/switch with cable to maximize the network bandwidth. I hope a typical 10/100 switch is enough and I won't have to buy a gigabit switch.

    Thank you in advance.

    PS: One last question... do all the computers have to run Windows 10? What if one of them is running Windows 7?
      My ComputerSystem Spec
  2.    22 Mar 2016 #2
    Join Date : Oct 2014
    Posts : 770
    Windows 7

    Distributed processing is a viable concept, but only for some application types. That would be for situations where the individual computers could operate semi independently with minimal communication between them required. Few applications fit that requirement. The problem is that with most applications the added processing power of a second computer would be overwhelmed by the overhead of network communication, even with a very fast network. The second computer would be a burden to performance, not an aid. That would seem to be the case with video editing.
      My ComputerSystem Spec
  3.    22 Mar 2016 #3
    Join Date : Sep 2015
    Posts : 2,371
    Windows 10 Pro 64-bit 1706 (CU build 15063.674)
    Thread Starter

    Hello!

    Thank you for your reply. I think you are correct for operations that can be done quickly using a single fast computer (i3 or faster), but editing HD video is not that fast, so I don't think the network speed would cause delays. Is there any application that can split a process between two or more networked computers? Alternatively, is there any video editing application that can be configured for distributed processing (less likely, I think) ?

    Just a thought: In NVidia graphics cards you can use CUDA acceleration in supported applications.
    Question 1: Is there any way to force CUDA to applications that not have native support for it? (Is there any CUDA wrapper?)
    Question 2: Is there a CUDA equivalent for Intel HD graphics? What it is? How it is used?
    Question 3: Is there a way to use OpenCL to applications that not have native support for it? (Is there any OpenCL wrapper?)

    Thank you again.
      My ComputerSystem Spec
  4.    22 Mar 2016 #4
    Join Date : Oct 2014
    Posts : 770
    Windows 7

    I don't believe there is any application for distributed processing of video files, nor do I believe such exists. I stand by my statements about the overhead involved. I don't have any practical experience with video editing, distributed or otherwise, but I have been an amateur programmer for more than 35 years and know quite a bit about how software works. That is what my statements are based on.

    I can't help you with the other questions.
      My ComputerSystem Spec
  5.    23 Mar 2016 #5
    Join Date : Sep 2015
    Posts : 2,371
    Windows 10 Pro 64-bit 1706 (CU build 15063.674)
    Thread Starter

    That's OK. Thanks. I guess my best bet is to use my faster computer with an application that allows CUDA or other acceleration and leave my slower computer doing other simpler tasks.
      My ComputerSystem Spec
  6.    23 Mar 2016 #6
    Join Date : Jul 2014
    Serbia
    Posts : 10,616
    W10 Insider + Linux

    That would be nice if it could work. Video editing, specially compositing can nail an 8 core FX 8350 @5 GHz to 100% usage.
      My ComputersSystem Spec
  7.    23 Mar 2016 #7
    Join Date : Sep 2014
    Nashville, TN
    Posts : 3,143
    Windows 10 Pro

    Typically, the application itself has to support distributed processing. This is not something done at the OS level.
      My ComputerSystem Spec

 


Similar Threads
Thread Forum
Windows 10 and Distributed Link Tracking
Under Win 7 I am almost certain that the DLT service DID NOT repair LNK files if the target was on a removable drive! But under Win 10 it appears that the DLT service DOES repair LNK files if the target is on a removable drive! Is anyone aware...
General Support
Folding At Home & Distributed Computing
Anyone participate? Thinking about volunteering my new PC during my away hours. Does it noticeably shorten the lifespan of components, particularly graphics cards and overclocked CPUs?
Chillout Room
Word Processing Problem
I'm old. When I was working I wasn't much for collaboration and now, not at all. I don't want to do layouts or exotic document designs. For years I used Windows Office 2003 and was happy. I could type my documents in Word and send them through...
Software and Apps
PCI Data Acquisition and Signal Processing Controller ?
Yoga 2 11, device: PCI Data Acquisition and Signal Processing Controller anyone know what this is? have tried every ddriver I can find that MIGHT be the device, so far no luck.
Drivers and Hardware
See Distributed Denial-of-service (DDoS) attacks around the World Live
An IT security company Norse has an live site online showing currently active Distributed Denial-of-service (DDoS) attacks live on a World map. Take a look, it's quite interesting to see how these attacks happen all the time. The live map: Norse...
Chillout Room
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd
All times are GMT -5. The time now is 23:42.
Find Us
Twitter Facebook Google+ Ten Forums iOS App Ten Forums Android App



Windows 10 Forums