是否有一个 .net 框架可以帮助解决这种情况?
我需要每晚处理大量数据。 我有一个半可信的 PC 网络、内部网 - 没有外部的,主要是台式机 - 但也有一些服务器。
我最初的想法是利用桌面的空闲时间,加上一些专用的服务器资源,如下:
1)将数据捆绑成加密的20兆块(管理员不希望任何数据写入PC磁盘,必须保留在RAM中)
2)分发。包含要执行的处理的.net dll(处理经常变化,因此分发dll)
3)解密数据
4)执行dll方法
5)返回结果
服务器将监视工作单元/作业,并且在时间 X 后,如果没有收到结果 - 检查应在其上工作的机器的状态,并在需要时分配给另一台机器。
我不会将这项工作归类为 CPU 密集型工作 - 然而,允许更快检查整个数据库的并行元素是一个真正的好处。
我认为我不需要机器间通信,只需要客户端-服务器。我很高兴客户端只需轮询服务器 - 我不需要任何复杂的作业通知方式。
我的问题是:是否有任何 .NET 框架可以做这种事情?或者这种方法完全有缺陷吗?
I have a requirement to process a lot of data on nightly basis.
I have a network of semi trusted PC's, intranet - nothing external, mostly desktops - but also some servers.
My initial thought was use the idle time of desktops, plus some dedicated server resources as follows:
1) Bundle data into encrypted 20 meg chunks (admins don’t want any data written to pc disks, must stay in ram)
2) Distribute .net dll(s) containing the processing to be carried out (the processing changes often, hence distribution of dlls)
3) Decrypt Data
4) Execute dll methods
5) Return results
A server would monitor work-units/jobs, and after a time X, if no result received - check status of the machine that should be working on them, and assign to another machine if needs be.
I would not classify the work as CPU intensive - however the parallel element that would allow a whole database to be checked sooner is a real bonus.
I don't think I need intermachine communication, just client-server. I am happy for the clients to simply poll the server - I don't need anything complex in the way of job notification.
My question is: Are there any .NET frameworks out there that do this kind of thing? or Is this approach completely flawed?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
看看这个问题 - 尽管它确实特别提到高 CPU 使用率,那里可能有适合您需求的东西。
Take a look at this question - although it does specifically mention high CPU usage there may be something there which suits your needs.