为什么这个 python 脚本会慢慢消耗我的 RAM？
这个脚本慢慢地消耗了我的内存。当我运行它时，我可以看到每次循环 Python 的 RAM 使用量都会增加大约 1mb，但我不明白为什么。我已经发现是查询的迭代增加了 RAM，但这就是我能弄清楚的全部。任何帮助都会很棒。
from haystack.pmod import piliPlacement #this is the SA model
from time import sleep
from datetime import datetime
from sqlalchemy import create_engine
from sqlalchemy.orm import sessionmaker
now = datetime.now()
engine = create_engine('mssql://xxxxxxx;uid=user;pwd=xxxxx',echo=False)
Session = sessionmaker(bind=engine)
def syncPlacements(session):
query = session.query(piliPlacement).filter(piliPlacement.Time > now)
pili_placements = [p.ID_Placement for p in query.all()] # this is what adds the RAM
del pili_placements
print 'loop'
while True:
session = Session()
syncPlacements(session)
sleep(3)
This script slowly eats my RAM. When I run it, I can see the RAM usage of Python creep up by approx 1mb with each loop, but I can't figure out why. I have figured out that it is the iteration of the query that adds the RAM, but that's all I can figure out. Any help would be awesome.
from haystack.pmod import piliPlacement #this is the SA model
from time import sleep
from datetime import datetime
from sqlalchemy import create_engine
from sqlalchemy.orm import sessionmaker
now = datetime.now()
engine = create_engine('mssql://xxxxxxx;uid=user;pwd=xxxxx',echo=False)
Session = sessionmaker(bind=engine)
def syncPlacements(session):
query = session.query(piliPlacement).filter(piliPlacement.Time > now)
pili_placements = [p.ID_Placement for p in query.all()] # this is what adds the RAM
del pili_placements
print 'loop'
while True:
session = Session()
syncPlacements(session)
sleep(3)
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（3）
在将其剥离回来并与 SA IRC 频道上的一个人聊天后，这似乎是 Mac OSX 独有的问题。所以我在Linux上设置了它，但发生了同样的事情。最后，我求助于在 crontab 上运行脚本。现在工作正常。
中号
After stripping it right back, and chatting to a guy on the SA IRC channel, it appeared to be a Mac OSX only problem. So I set it up on Linux but the same thing occured. In the end, I resorted to running the script on a crontab. Works fine now.
M
您可能想看看 mdb 是否随着工作量的增加而慢慢变大。这就是为什么我假设这种情况会发生。在您的示例中，它是唯一看起来不会被垃圾收集的对象，而且它也恰好是一个对象。因此，随着它的使用越来越多，我肯定会研究它的用途。
我想知道它是否维护已执行的查询列表。
You might want to see if mdb is slowly getting larger as it does more work. That is why I'd assume that this would be occuring. It is the only object that doesn't look like it would be garbage collected in your example, and it also happens to be an object. So, I would definitely look into what it's doing as it is used more and more.
I'd wonder if it's maintaining a list of queries that have executed.
只有 3 个问题
session从哪里来？为什么不将
mdb = Connection().haystack放入while True循环中（顺便说一句，session.close()也是如此）？并将mdb和session传递给syncPlacements？整个代码块被复制，只有两个差异（即计算匹配，保存或删除）？
Just 3 questions
Where does
sessioncome from?Why not put
mdb = Connection().haystackinto thewhile Trueloop (and btwsession.close()too)? And passmdbandsessiontosyncPlacements?Whole code block is copied just with just two differences (i.e. calculate matches, save or remove)?