Python

PyArrow is a powerful tool for Python developers seeking high-performance data processing and interchange. This talk will provide a pragmatic overview of some of PyArrow's capabilities, demonstrating data interchange, storage, manipulation and transport using a single Python library.

We'll explore four key capabilities:

Array Interchange: Seamless data exchange between NumPy, pandas, and other libraries using zero-copy Storage: Efficient serialization and file format support (Parquet, ORC, Feather) with advanced compression Compute: High-performance in-memory computation and data transformation capabilities Transport: Leveraging Arrow Flight RPC for distributed data movement and processing