Contribute Media
A thank you to everyone who makes this possible: Read More

Spark Backend for Ibis: Seamless Transition Between Pandas and Spark

Description

Ibis a library that provides unified pandas-like API on top of both single-node local execution (e.g. pandas) and multi-node remote execution (e.g. BigQuery, Impala). In this talk, we will introduce a new backend for executing Ibis programs on Spark and show how you can write analytics that run on both Spark and pandas.

Details

Improve this page