Codd, Chomsky, McKinney, and Wickham walk into a bar… (maybe Chamberlain and Wittgenstein should also be included?)
- the dream of substrait is true separation b/w query engines and transformation APIs
- previously, particular APIs would give better performance due to their inextricable link to the architecture of the underlying compute engine
- if the above benefit is removed, folks could use the API with which they are most familiar
- given this, we could see an industry consolidation around the “best” transformation API.