Question

越来越多的人在 Pandas的基础上构建包，以满足数据准备、分析和可视化方面的特定需求。这是令人激动的，因为这意味着 Pandas 不仅帮助用户处理他们的数据任务，而且它为开发人员提供了一个更好的起点，来构建功能强大和更有针对性的数据工具。创建扩充 Pandas 功能的类库也能让 Pandas 的发展保持围绕其初心不改的原则。

这是一个不会断更的项目列表，它们给予 Pandas 构建，以便在PyData空间中能不断的提供新的工具。有关依赖 Pandas 的项目列表，请参阅 Pandas 的 libraries.io 用法页面open in new window 或 在pypi中搜索 Pandasopen in new window。

我们希望让用户更容易找到这些项目，如果您还知道您认为的应该在此列表中展示的其他不错的项目，请将它告诉我们。

统计和机器学习

Statsmodelsopen in new window

Statsmodels是着名的 Python“统计和计量经济学库”，它与Pandas长期有着的特殊关系。Statsmodels提供了超出Pandas能力范围的强大的统计数据功能，包括计量经济学，分析和建模等功能。Statsmodels利用Pandas对象作为计算的底层数据容器。

sklearn-pandasopen in new window

在 scikit-learnopen in new window 机器学习中使用 pandas 的 DataFrames。

Featuretoolsopen in new window

Featuretools是一个基于 pandas 的自动功能工程的Python库。它擅长使用可重用的特征工程“基元”将时间和关系数据集转换为用于机器学习的特征矩阵。用户可以使用Python贡献自己的原语，并与社区的其他人共享。

可视化

Altairopen in new window

Altair是用于Python的声明性统计可视化库。 使用 Altair，您可以花费更多时间来理解数据及其含义。 Altair的API简单，友好且一致，并以强大的Vega-Lite JSON规范为基础。 这种优雅的简单性用最少的代码即可产生美观，有效的可视化效果。 Altair可与Pandas DataFrames配合使用。

Bokehopen in new window

Bokeh是一个Python交互式可视化库，用于大型数据集，其本机使用最新的Web技术。 它的目标是以Protovis / D3的样式提供优雅，简洁的新颖图形构造，同时为瘦客户端提供大数据上的高性能交互性。

seabornopen in new window

Seaborn 是基于 matplotlibopen in new window 的Python可视化库。它提供了一个高级的，面向数据集的界面，用于创建吸引人的统计图形。seaborn中的绘图功能可了解熊猫对象，并在内部利用熊猫分组操作来支持复杂可视化的简洁规范。Seaborn 深圳还超越了matplotlib 和 pandas，可以在绘制图表时进行统计估计，汇总观察结果并可视化统计模型的拟合以强调数据集中的模式。

yhat/ggpyopen in new window

Hadley Wickham的 ggplot2open in new window 是R语言的基础探索性可视化包。它以“图形语法”为基础，提供了一种强大的、说明性的、极其通用的方式来生成任何类型数据的定制绘图。这真是太不可思议了。其他语言的各种实现都是可用的，但是对于Python用户来说，一直缺少一个忠实的实现。尽管还很年轻(截至2014年1月)，yhat/ggpyopen in new window 项目在这个方向上进展很快。

IPython Vegaopen in new window

IPython Vegaopen in new window 利用 Vegaopen in new window 在Jupyter Notebook中创建图形。

Plotlyopen in new window

Plotly’sopen in new window 的 Python APIopen in new window 支持交互式图形和网络共享。地图、2D、3D和实况流图是使用WebGL和D3.js渲染的。该库支持直接从 pandas 的 DataFrame打印和基于云的协作。matplotlib、Python的gglot和Sebornopen in new window 的用户可以将图形转换为基于Web的交互式绘图。绘图可以在 IPython Notebooksopen in new window 本中绘制，可以使用R或MATLAB编辑，可以在GUI中修改，也可以嵌入到应用程序和仪表板中。Ploly是免费的，可以无限制地共享，并且有云open in new window、离线open in new window或内部open in new window帐户供私人使用。

QtPandasopen in new window

qtpandasopen in new window 库是从主Pandas库派生出来的，它支持在PyQt4和PySide应用程序中实现DataFrame可视化和操作。

IDE

IPythonopen in new window

IPython is an interactive command shell and distributed computing environment. IPython tab completion works with Pandas methods and also attributes like DataFrame columns.

Jupyter Notebook / Jupyter Labopen in new window

Jupyter Notebook is a web application for creating Jupyter notebooks. A Jupyter notebook is a JSON document containing an ordered list of input/output cells which can contain code, text, mathematics, plots and rich media. Jupyter notebooks can be converted to a number of open standard output formats (HTML, HTML presentation slides, LaTeX, PDF, ReStructuredText, Markdown, Python) through ‘Download As’ in the web interface and jupyter convert in a shell.

Pandas DataFrames implement _repr_html_and _repr_latex methods which are utilized by Jupyter Notebook for displaying (abbreviated) HTML or LaTeX tables. LaTeX output is properly escaped. (Note: HTML tables may or may not be compatible with non-HTML Jupyter output formats.)

See Options and Settingsopen in new window and Available Optionsopen in new window for pandas display. settings.

quantopian/qgridopen in new window

qgrid is “an interactive grid for sorting and filtering DataFrames in IPython Notebook” built with SlickGrid.

Spyderopen in new window

Spyder is a cross-platform PyQt-based IDE combining the editing, analysis, debugging and profiling functionality of a software development tool with the data exploration, interactive execution, deep inspection and rich visualization capabilities of a scientific environment like MATLAB or Rstudio.

Its Variable Exploreropen in new window allows users to view, manipulate and edit pandas Index, Series, and DataFrame objects like a “spreadsheet”, including copying and modifying values, sorting, displaying a “heatmap”, converting data types and more. Pandas objects can also be renamed, duplicated, new columns added, copyed/pasted to/from the clipboard (as TSV), and saved/loaded to/from a file. Spyder can also import data from a variety of plain text and binary files or the clipboard into a new pandas DataFrame via a sophisticated import wizard.

Most pandas classes, methods and data attributes can be autocompleted in Spyder’s Editoropen in new window and IPython Consoleopen in new window, and Spyder’s Help paneopen in new window can retrieve and render Numpydoc documentation on pandas objects in rich text with Sphinx both automatically and on-demand.

API

pandas-datareaderopen in new window

pandas-datareader is a remote data access library for pandas (PyPI:pandas-datareader). It is based on functionality that was located in pandas.io.data and pandas.io.wb but was split off in v0.19. See more in the pandas-datareader docsopen in new window:

The following data feeds are available:

• Google Finance
• Tiingo
• Morningstar
• IEX
• Robinhood
• Enigma
• Quandl
• FRED
• Fama/French
• World Bank
• OECD
• Eurostat
• TSP Fund Data
• Nasdaq Trader Symbol Definitions
• Stooq Index Data
• MOEX Data

quandl/Pythonopen in new window

Quandl API for Python wraps the Quandl REST API to return Pandas DataFrames with timeseries indexes.

pydatastreamopen in new window

PyDatastream is a Python interface to the Thomson Dataworks Enterprise (DWE/Datastream)open in new window SOAP API to return indexed Pandas DataFrames or Panels with financial data. This package requires valid credentials for this API (non free).

pandaSDMXopen in new window

pandaSDMX is a library to retrieve and acquire statistical data and metadata disseminated in SDMXopen in new window 2.1, an ISO-standard widely used by institutions such as statistics offices, central banks, and international organisations. pandaSDMX can expose datasets and related structural metadata including data flows, code-lists, and data structure definitions as pandas Series or MultiIndexed DataFrames.

fredapiopen in new window

fredapi is a Python interface to the Federal Reserve Economic Data (FRED)open in new window provided by the Federal Reserve Bank of St. Louis. It works with both the FRED database and ALFRED database that contains point-in-time data (i.e. historic data revisions). fredapi provides a wrapper in Python to the FRED HTTP API, and also provides several convenient methods for parsing and analyzing point-in-time data from ALFRED. fredapi makes use of pandas and returns data in a Series or DataFrame. This module requires a FRED API key that you can obtain for free on the FRED website.

Domain Specific

Geopandasopen in new window

Geopandas extends pandas data objects to include geographic information which support geometric operations. If your work entails maps and geographical coordinates, and you love pandas, you should take a close look at Geopandas.

xarrayopen in new window

xarray brings the labeled data power of pandas to the physical sciences by providing N-dimensional variants of the core pandas data structures. It aims to provide a pandas-like and pandas-compatible toolkit for analytics on multi- dimensional arrays, rather than the tabular data for which pandas excels.

Out-of-core

Blazeopen in new window

Blaze provides a standard API for doing computations with various in-memory and on-disk backends: NumPy, Pandas, SQLAlchemy, MongoDB, PyTables, PySpark.

Daskopen in new window

Dask is a flexible parallel computing library for analytics. Dask provides a familiar DataFrame interface for out-of-core, parallel and distributed computing.

Dask-MLopen in new window

Dask-ML enables parallel and distributed machine learning using Dask alongside existing machine learning libraries like Scikit-Learn, XGBoost, and TensorFlow.

Odoopen in new window

Odo provides a uniform API for moving data between different formats. It uses pandas own read_csv for CSV IO and leverages many existing packages such as PyTables, h5py, and pymongo to move data between non pandas formats. Its graph based approach is also extensible by end users for custom formats that may be too specific for the core of odo.

Rayopen in new window

Pandas on Ray is an early stage DataFrame library that wraps Pandas and transparently distributes the data and computation. The user does not need to know how many cores their system has, nor do they need to specify how to distribute the data. In fact, users can continue using their previous Pandas notebooks while experiencing a considerable speedup from Pandas on Ray, even on a single machine. Only a modification of the import statement is needed, as we demonstrate below. Once you’ve changed your import statement, you’re ready to use Pandas on Ray just like you would Pandas.

# import pandas as pd
import ray.dataframe as pd

Vaexopen in new window

Increasingly, packages are being built on top of pandas to address specific needs in data preparation, analysis and visualization. Vaex is a python library for Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. It can calculate statistics such as mean, sum, count, standard deviation etc, on an N-dimensional grid up to a billion (109) objects/rows per second. Visualization is done using histograms, density plots and 3d volume rendering, allowing interactive exploration of big data. Vaex uses memory mapping, zero memory copy policy and lazy computations for best performance (no memory wasted).

• vaex.from_pandas
• vaex.to_pandas_df

Data validation

Engardeopen in new window

Engarde is a lightweight library used to explicitly state your assumptions about your datasets and check that they’re actually true.

Extension Data Types

Pandas provides an interface for defining extension typesopen in new window to extend NumPy’s type system. The following libraries implement that interface to provide types not found in NumPy or pandas, which work well with pandas’ data containers.

cyberpandasopen in new window

Cyberpandas provides an extension type for storing arrays of IP Addresses. These arrays can be stored inside pandas’ Series and DataFrame.

Accessors

A directory of projects providing extension accessorsopen in new window. This is for users to discover new accessors and for library authors to coordinate on the namespace.

Library	Accessor	Classes
cyberpandasopen in new window	ip	Series
pdvegaopen in new window	vgplot	Series, DataFrame