Wes McKinney - DataPad: Python-powered Business Intelligence

PyData SV 2014
In this talk, I'll discuss the architecture of the DataPad system and how we are leveraging components in the scientific Python ecosystem (along with a wee bit of JavaScript) to craft a modern business intelligence and analytics system. The basic technical architecture of the Badger high performance analytical query engine (inspired by experiences Wes had building pandas) will also be included. 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

[wilsonvillagomezencinas]

🎯 Key points for quick navigation:

00:07 *Founded pandas project*
01:17 *Translations exceeded expectations*
01:58 *Started Datapad company*
02:25 *Boosting work productivity*
03:06 *Pandas flexibility praised*
04:02 *Business intelligence definition*
05:10 *Business data transformation*
05:49 *Visual analytics defined*
06:47 *Data discovery explanation*
08:22 *BI system bottleneck issues*
09:38 *Long implementation cycles*
11:02 *Data silo challenges*
12:23 *Quick ad hoc analysis*
14:15 *Demo of datapad dashboard*
16:07 *Large donations analysis*
18:11 *In-memory query processing*
20:34 *Visual analytics interface*
24:08 *Python under the hood*
25:31 *SQL limitations discussed*
26:11 *WebSockets comfort increase*
26:39 *Custom data format*
27:17 *Data connectors focus*
27:34 *Group-by implementation details*
28:00 *Analytics kernels defined*
28:41 *C code backend*
29:07 *AngularJS front-end preference*
29:35 *Custom visualizations necessity*
30:32 *Live coding skipped*
32:31 *Audience questions invited*
33:32 *Pivot tables available*
34:40 *Data edits possible*
35:28 *Cloud offering focus*
36:19 *Custom analytics flexibility*
37:14 *Cross-platform availability*
37:42 *API plans discussed*
38:09 *Data joining integrated*
38:50 *Real-time data interest*
39:15 *Visualization extension possibility*

Made with HARPA AI

[rajupowers]

Good work. Very similar to standard BI tools (I work on Microstrategy)