如何使用 vaex 包从连接字符串加载数据?

发布于 2025-01-15 01:34:00 字数 769 浏览 1 评论 0原文

如果我的服务器上有一个表,并且正在生成一个连接字符串,我如何使用 Vaex 将其加载到数据帧?

这是我正在做的事情,但是对于 Pandas:

from sqlalchemy import types, create_engine, text
import pandas as pd
import pymysql

def connect_to_data(driver='mysql+pymysql://', conn_string=''):
    try:
        conn = create_engine(driver + conn_string)
        print("MySQL Connection Successfull!")
    except Exception as err:
        print("MySQL Connection Failed!")
        print(err)
    return conn

# Connect to the db:
conn_string = 'xxxxxxxx'
conn = connect_to_data(conn_string=conn_string)

# Get all requests from the db:
query = '''SELECT * FROM table_name'''

result = conn.execute(text(query))

# Desired dataframe:
df = pd.read_sql_query(query, conn)

我怎样才能对 Vaex 做同样的事情(因为它的高性能)?

If I have a table on my server and I am producing a connection string to it, how can I, using Vaex, load it to a dataframe?

Here is what I am doing but with Pandas:

from sqlalchemy import types, create_engine, text
import pandas as pd
import pymysql

def connect_to_data(driver='mysql+pymysql://', conn_string=''):
    try:
        conn = create_engine(driver + conn_string)
        print("MySQL Connection Successfull!")
    except Exception as err:
        print("MySQL Connection Failed!")
        print(err)
    return conn

# Connect to the db:
conn_string = 'xxxxxxxx'
conn = connect_to_data(conn_string=conn_string)

# Get all requests from the db:
query = '''SELECT * FROM table_name'''

result = conn.execute(text(query))

# Desired dataframe:
df = pd.read_sql_query(query, conn)

How can I do the same with Vaex (because of it's high performance)?

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(1

满意归宿 2025-01-22 01:34:00

至少现在,你还不能直接这样做。但是 vaex 可以轻松读取 pandas 数据框,因此您可以

# Following your example..
pandas_df = pd.read_sql_query(query, conn)

df = vaex.from_pandas(pandas_df)

For now at least, you can't do it directly. But vaex can easily read a pandas dataframe so you can

# Following your example..
pandas_df = pd.read_sql_query(query, conn)

df = vaex.from_pandas(pandas_df)
~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文