Distributed processing in Windows 10? Is it possible?


  1. Posts : 3,511
    Windows 10 Pro 64-bit 21H1 (May 2021 build 19043.1083)
       #1

    Distributed processing in Windows 10? Is it possible?


    Hello!

    Most of us have at least 2 computers connected at the home network. Is it possible to make them cooperate for resource-demanding tasks such as HD video editing? If I get the term right, I think this is called Distributed Processing. So is there any software or whatever that can use 2 or more computers connected at the same network to work in parallel and finish the job faster? The job can be for example HD video editing. For a typical 90 minute movie, my main PC (see my specs) has to work overnight to create an AVHCD-DVD version from the initial MKV video. Let alone the time wasted if I want to edit and normalize the soundtrack first. It would be a good idea to get my secondary computer and even my notebook to help done faster. Is that possible? How? It depends on the application used, or is there a way to apply it for any application? All computers will be connected to the same router/switch with cable to maximize the network bandwidth. I hope a typical 10/100 switch is enough and I won't have to buy a gigabit switch.

    Thank you in advance.

    PS: One last question... do all the computers have to run Windows 10? What if one of them is running Windows 7?
      My Computer


  2. Posts : 1,255
    Windows 10 Pro
       #2

    Distributed processing is a viable concept, but only for some application types. That would be for situations where the individual computers could operate semi independently with minimal communication between them required. Few applications fit that requirement. The problem is that with most applications the added processing power of a second computer would be overwhelmed by the overhead of network communication, even with a very fast network. The second computer would be a burden to performance, not an aid. That would seem to be the case with video editing.
      My Computer


  3. Posts : 3,511
    Windows 10 Pro 64-bit 21H1 (May 2021 build 19043.1083)
    Thread Starter
       #3

    Hello!

    Thank you for your reply. I think you are correct for operations that can be done quickly using a single fast computer (i3 or faster), but editing HD video is not that fast, so I don't think the network speed would cause delays. Is there any application that can split a process between two or more networked computers? Alternatively, is there any video editing application that can be configured for distributed processing (less likely, I think) ?

    Just a thought: In NVidia graphics cards you can use CUDA acceleration in supported applications.
    Question 1: Is there any way to force CUDA to applications that not have native support for it? (Is there any CUDA wrapper?)
    Question 2: Is there a CUDA equivalent for Intel HD graphics? What it is? How it is used?
    Question 3: Is there a way to use OpenCL to applications that not have native support for it? (Is there any OpenCL wrapper?)

    Thank you again.
      My Computer


  4. Posts : 1,255
    Windows 10 Pro
       #4

    I don't believe there is any application for distributed processing of video files, nor do I believe such exists. I stand by my statements about the overhead involved. I don't have any practical experience with video editing, distributed or otherwise, but I have been an amateur programmer for more than 35 years and know quite a bit about how software works. That is what my statements are based on.

    I can't help you with the other questions.
      My Computer


  5. Posts : 3,511
    Windows 10 Pro 64-bit 21H1 (May 2021 build 19043.1083)
    Thread Starter
       #5

    That's OK. Thanks. I guess my best bet is to use my faster computer with an application that allows CUDA or other acceleration and leave my slower computer doing other simpler tasks.
      My Computer


  6. Posts : 19,518
    W11+W11 Developer Insider + Linux
       #6

    That would be nice if it could work. Video editing, specially compositing can nail an 8 core FX 8350 @5 GHz to 100% usage.
      My Computers


  7. Posts : 3,257
    Windows 10 Pro
       #7

    Typically, the application itself has to support distributed processing. This is not something done at the OS level.
      My Computer


 

  Related Discussions
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd
All times are GMT -5. The time now is 11:29.
Find Us




Windows 10 Forums