MentDB  Mentalese Database Engine
Strong AI, Weak AI, Interoperability and Software Development
    Home  >  MQL Functions
Data quality

Here you can check your data quality.

dq algorithm show

Description

    Show all algorithms

admin
dq algorithm show
mentdb
{<br> "is_null_or_empty": "\n\tis null or empty [VAR];\n",<br> "is_hour_without_sec": "\n\ttype is_hour_without_sec [VAR];\n",<br> "is_bool": "\n\ttype is_bool [VAR] 0 1;\n",<br> "is_integer": "\n\ttype is_integer [VAR] 8;\n",<br> "is_valid_timestamp": "\n\ttype is_valid_timestamp [VAR] \"yyyy-MM-dd HH:mm:ss\";\n",<br> "is_hour": "\n\ttype is_hour [VAR];\n",<br> "is_big_int": "\n\ttype is_big_int [VAR];\n",<br> "is_matches_regex": "\n\ttype is_matches_regex [VAR] \".*ze.*\";\n",<br> "COGNITIVE_french_word": "\n\tword exist [VAR] fr;\n",<br> "is_empty": "\n\tis empty [VAR];\n",<br> "is_time": "\n\ttype is_time [VAR];\n",<br> "is_char": "\n\ttype is_char [VAR] 25;\n",<br> "is_email": "\n\ttype is_email [VAR];\n",<br> "is_enum": "\n\ttype is_enum [VAR] \"1,2,3\";\n",<br> "is_decimal": "\n\ttype is_decimal [VAR] 4 5;\n",<br> "is_null": "\n\tis null [VAR];\n",<br> "is_double": "\n\ttype is_double [VAR];\n",<br> "is_byte": "\n\ttype is_byte [VAR];\n",<br> "is_varchar": "\n\ttype is_varchar [VAR] 15;\n",<br> "is_float": "\n\ttype is_float [VAR];\n",<br> "is_int": "\n\ttype is_int [VAR];\n",<br> "is_date": "\n\ttype is_valid_date [VAR] \"yyyy-MM-dd\";\n",<br> "is_small_int": "\n\ttype is_small_int [VAR];\n",<br> "is_medium_int": "\n\ttype is_medium_int [VAR];\n",<br> "is_number": "\n\ttype is_number [VAR];\n"<br>}

dq algorithm set <key> <mql>

Description

    Set an algorithm

Parameters

    key:   The key - string - required
    mql:   The MQL source code - string - required
admin
dq algorithm set "key" (mql { type is_char [VAR] 25; })
mentdb
1

dq algorithm exist <key>

Description

    Check if an algorithm already exist

Parameters

    key:   The key - string - required
admin
dq algorithm exist "key"
mentdb
1

dq algorithm get <key>

Description

    Get an algorithm

Parameters

    key:   The key - string - required
admin
dq algorithm get "key"
mentdb
<br> type is_char [VAR] 25;<br>

dq algorithm remove <key>

Description

    Remove an algorithm

Parameters

    key:   The key - string - required
admin
dq algorithm remove "key"
mentdb
1

dq generate <cmId> <tablename> <fieldname> <jsonArrayAlgoId> <sqlSource>

Description

    Generate the Data Quality MQL script

Parameters

    cmId:   The database connection id - string - required
    tablename:   The table name - string - required
    fieldname:   The field name - string - required
    jsonArrayAlgoId:   The json array with selected algorithms id - string - required
    sqlSource:   The select query (origin) - string - required
admin
dq generate "demo_cm_mysql" "products" "quantity" "[ \"is_big_int\", \"is_date\" ]" "select * from products limit 0, 500"
mentdb
json load "dq" "[]";<br><br>json load "dq_quantity" "{}";<br>json iobject "dq_quantity" / field "quantity" STR;<br>json iobject "dq_quantity" / algo "{}" OBJ;<br>json iobject "dq_quantity" /algo "is_big_int" (mql {<br> type is_big_int [T_quantity];<br>}) STR;<br>json iobject "dq_quantity" /algo "is_date" (mql {<br> type is_valid_date [T_quantity] "yyyy-MM-dd";<br>}) STR;<br>json iarray "dq" / (json doc "dq_quantity") OBJ;<br><br>dq analyse "demo_cm_mysql" (json doc "dq") "products" "select * from products limit 0, 500";

dq analyse <cmId> <jsonArrayAlgoId> <title> <sqlSource>

Description

    Make a data quality on a database

Parameters

    cmId:   The database connection id - string - required
    jsonArrayAlgoId:   The json array with selected algorithms id - string - required
    title:   The title - string - required
    sqlSource:   The select query (origin) - string - required
admin
json load "dq" "[]"; json load "dq_name" "{}"; json iobject "dq_name" / field "name" STR; json iobject "dq_name" / algo "{}" OBJ; json iobject "dq_name" /algo "is_float" (mql { type is_float [T_name]; }) STR; json iobject "dq_name" /algo "is_null" (mql { is null [T_name]; }) STR; json iobject "dq_name" /algo "is_small_int" (mql { type is_small_int [T_name]; }) STR; json iobject "dq_name" /algo "is_valid_timestamp" (mql { type is_valid_timestamp [T_name] "yyyy-MM-dd HH:mm:ss"; }) STR; json iarray "dq" / (json doc "dq_name") OBJ; dq analyse "demo_cm_mysql" (json doc "dq") "products" "SELECT * FROM `products` LIMIT 0, 500";
mentdb
In editor ...

dq analyse show <cmId> <jsonArrayAlgoId> <algoKey> <fieldKey> <title> <sqlSource>

Description

    Show an analyse

Parameters

    cmId:   The database connection id - string - required
    jsonArrayAlgoId:   The json array with selected algorithms id - string - required
    algoKey:   The algo key selected - string - required
    fieldKey:   The field key selected - string - required
    title:   The title - string - required
    sqlSource:   The select query (origin) - string - required
admin
json load "dq" "[]"; json load "dq_name" "{}"; json iobject "dq_name" / field "name" STR; json iobject "dq_name" / algo "{}" OBJ; json iobject "dq_name" /algo "is_float" (mql { type is_float [T_name]; }) STR; json iobject "dq_name" /algo "is_null" (mql { is null [T_name]; }) STR; json iobject "dq_name" /algo "is_small_int" (mql { type is_small_int [T_name]; }) STR; json iobject "dq_name" /algo "is_valid_timestamp" (mql { type is_valid_timestamp [T_name] "yyyy-MM-dd HH:mm:ss"; }) STR; json iarray "dq" / (json doc "dq_name") OBJ; dq analyse show "demo_cm_mysql" (json doc "dq") "is_float" "name" "products" "SELECT * FROM `products` LIMIT 0, 500";
mentdb
In editor ...
    Home  >  MQL Functions
MentDB © 2012 - 2019