DA
数据与复现
Dask
Dask是一个Python 库 ，用于 parallel 、 distributed computing that enables three critical capabilities：- **Larger-than-memory exe…
K-Dense-AI/claude-scientific-skills查看
数据与复现
VA
Vaex
维护者 K-Dense Inc. · 最近更新 2026年3月31日
Vaex是一个high-performance Python 库 designed ，用于 la。
原始来源
K-Dense-AI/claude-scientific-skills
https://github.com/K-Dense-AI/claude-scientific-skills/tree/main/scientific-skills/vaex
- 维护者
- K-Dense Inc.
- 许可
- MIT license
- 最近更新
- 2026年3月31日
技能摘要
来自 SKILL.md 的关键信息
核心说明
- Vaex是一个high-performance Python 库 designed ，用于 lazy，out-of-core DataFrames to process 、 visualize tabular 数据集s that are too large to fit into RAM. Vaex can process over billion rows per second，enabling interactive data exploration 、 analysis on 数据集s ，支持 billions of rows。
- df = vaex.open('large_file.hdf5') # 或.csv，.arrow，.parquet。
原始文档
SKILL.md 摘录
When to Use This Skill
Use Vaex when:
- Processing tabular datasets larger than available RAM (gigabytes to terabytes)
- Performing fast statistical aggregations on massive datasets
- Creating visualizations and heatmaps of large datasets
- Building machine learning pipelines on big data
- Converting between data formats (CSV, HDF5, Arrow, Parquet)
- Needing lazy evaluation and virtual columns to avoid memory overhead
- Working with astronomical data, financial time series, or other large-scale scientific datasets
Core Capabilities
Vaex provides six primary capability areas, each documented in detail in the references directory:
1. DataFrames and Data Loading
Load and create Vaex DataFrames from various sources including files (HDF5, CSV, Arrow, Parquet), pandas DataFrames, NumPy arrays, and dictionaries. Reference references/core_dataframes.md for:
- Opening large files efficiently
- Converting from pandas/NumPy/Arrow
- Working with example datasets
- Understanding DataFrame structure
适用场景
- Processing tabular 数据集s larger than available RAM (gigabytes to terabytes)。
- Performing fast statistical aggregations on massive 数据集s。
- Creating visuali。
不适用场景
- Do not rely on this catalog entry alone ，用于 installation 或 maintenance details。
相关技能
相关技能
EX
Exploratory Data Analysis：执行 comprehensive exploratory 数据分析 (EDA) on scientific data files across multiple domains。 This…
K-Dense-AI/claude-scientific-skills查看
GE
数据与复现
GeoPandas
GeoPandas extends pandas to enable spatial operations on geometric types。 It combines capabilities of pandas 、 shapely ，…
K-Dense-AI/claude-scientific-skills查看
NE
数据与复现
NetworkX
NetworkX是一个Python package ，用于 creating，manipulating，、 analy。
K-Dense-AI/claude-scientific-skills查看