Skip to content

Instantly share code, notes, and snippets.

@ZeroICQ
Last active August 26, 2019 17:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ZeroICQ/f0c35a20cae7065368dae31d7ad9b001 to your computer and use it in GitHub Desktop.
Save ZeroICQ/f0c35a20cae7065368dae31d7ad9b001 to your computer and use it in GitHub Desktop.

Final report for GSoC 2019 with MariaDB

Student: Alexey Mogilyovkin
GitHub: @ZeroICQ
Organization: MariaDB
Project Title: Add support for Indexes on Expressions

About

My task was to add support for indexes on expression. At the very beginning it was split into two steps:

  1. Add expression matching into the optimizer, use it for generated columns. So the following request should work and use index
CREATE TABLE t1 (a int, b int, INDEX (a/2+b));
...
SELECT * FROM t1 WHERE a/2+b=100;
  1. Support the syntax to create an index on expression directly, this will automatically create a hidden generated column under the hood.
CREATE TABLE t(a int, b int, index((a+b/2)));

As for me, one of the most challenging part of participating in GSoC was to get familiar with huge codebase. It really overwhelmed me at first. But with the help of competent mentors I started coding very quickly.
There was no quick and ready solution how to make algorithm that would rewrite request to database in such a way that it would use the best index. But after some discussion with contributors in chat the solution was found. The solution was to take where clause, rewrite expressions with corresponding fields and conjunct with source one. At the second phase I added syntax support to create an index on expression directly. This task was quite difficult, because of a lot of internal optimizations.
But anyway, I've done almost everything I planned. After GSoC I will finish all the tasks.

What is done

  • Added expression matching into the optimizer.
  • Add syntax support to create an index on expression directly.

What is left to do

  • More thorough testing.
  • Implement correct display of indexes on hidden generated columns.
  • Implement automatic deletion of hidden fields on corresponding fields deletion.

Links

GitHub clone repository PR - contains code review from mentor.
GitHub MariaDB repository PR - last GSoC 2019 commit is Support the syntax to create an index on expression.
Jira task MDEV-6017
Zulipchat discussion - requires login.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment