有人在实际项目中用主流语言使用过数据流编程吗?
我正在考虑在 clojure 程序中使用一些数据流编程技术,但我很难从使用 Java、C# 或其他在现实世界中使用过此类技术的主流语言的项目中找到大量信息。如果有人可以分享这方面的经验,我将不胜感激。
I am looking at using some Dataflow programming techniques in a clojure program but I am having difficulty in finding much information from projects using Java, C#, or other mainstream languages that have used such techniques in the real world. I would be grateful to hear if anyone has any expereinces they could share regarding this.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(3)
在这里,我们来了!我们已经做了...(引用自我的一篇旧帖子):
有些数据流系统甚至没有提及数据流方法:
编写数据流系统并不是火箭科学。这是我的旧帖子有关数据流框架的基础知识。
数据流这个术语很广泛。有实时同步数据流系统,例如合成器和采样器,也有异步数据流系统,例如我们的家庭自动化系统。系统(除非用户按下按钮或计时器耗尽,否则系统处于空闲状态),甚至还有不同的体系结构,例如电子表格或make。
想阅读更多有关数据流编程的内容吗?阅读 J.保罗·莫里森的网站和书籍。
Here, we are! We've made... (quotation is from one of my older post):
There're dataflow systems wich don't even mention dataflow approach:
Writing a dataflow system is not rocket science. Here's my older post about the basics of dataflow framework.
The term dataflow is wide. There are realtime synchronous dataflow systems, like synthetisers and samplers, there are asynchronous ones, like our home aut. system (the system is in idle unless the user presses a button or a timer runs out), and there're even different architectures, like spreadsheets or make.
Wanna reading more about dataflow programming? Read J. Paul Morrison's site and book.
Pervasive DataRush 是一个适用于任何 JVM 语言(包括 Clojure)的并行数据流编程框架。
Pervasive DataRush 使用数据流架构。该架构实现了一个程序,该程序作为通过数据流队列互连的计算节点图来执行。节点使用队列来共享数据。由于数据是流式传输的,因此在任何给定时间只有任何活动操作所需的数据需要存储在内存中,从而可以分析非常大的数据集。除了提供解决大于可用内存的问题的潜力之外,数据流图还利用多种形式的并行性。
客户正在使用 DataRush 进行大数据分析和数据准备 (ETL)。
Pervasive DataRush is a framework for parallel dataflow programming for any JVM language, including Clojure.
Pervasive DataRush uses a dataflow architecture. The architecture implements a program that executes as a graph of computation nodes interconnected by dataflow queues. The nodes use the queues to share data. As the data is streaming, only data required by any active operation needs to be in memory at any given time, allowing very large data sets to be analyzed. Besides offering the potential for scaling to problems larger than available memory, dataflow graphs exploit multiple forms of parallelism.
Customers are using DataRush for big data analytics and data preparation (ETL).
我们制作了另一个:带有 MySQL/PHP 后端和 AJAX 前端的协作电子表格。该软件处于测试状态,文档正在构建中。
We've made another one: a collaborative spreadsheet with MySQL/PHP backend and AJAX frontend. The software is in beta state, documentation is under construction.