Piwik log analytics

gistfile1.txt

1013 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
nginx@host:/var/log/nginx $ python /srv/www/piwik/htdocs/stats/misc/log-analytics/import_logs.py --url=https://www.example.com/stats --recorders=3 --show-progress --enable-reverse-dns --replay-tracking piwik.access.log piwik.access.log-20150717
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
Parsing log piwik.access.log...
1534 lines parsed, 396 lines recorded, 197 records/sec (avg), 396 records/sec (current)
2893 lines parsed, 829 lines recorded, 276 records/sec (avg), 433 records/sec (current)
4070 lines parsed, 1800 lines recorded, 449 records/sec (avg), 971 records/sec (current)
5099 lines parsed, 2177 lines recorded, 434 records/sec (avg), 377 records/sec (current)
5998 lines parsed, 2606 lines recorded, 432 records/sec (avg), 429 records/sec (current)
Parsing log piwik.access.log-20150717...
6571 lines parsed, 3600 lines recorded, 511 records/sec (avg), 994 records/sec (current)
7512 lines parsed, 4001 lines recorded, 497 records/sec (avg), 401 records/sec (current)
8502 lines parsed, 4276 lines recorded, 472 records/sec (avg), 275 records/sec (current)
9450 lines parsed, 4738 lines recorded, 471 records/sec (avg), 462 records/sec (current)
9605 lines parsed, 5325 lines recorded, 481 records/sec (avg), 587 records/sec (current)
10258 lines parsed, 5943 lines recorded, 493 records/sec (avg), 618 records/sec (current)
11373 lines parsed, 6676 lines recorded, 511 records/sec (avg), 733 records/sec (current)
12156 lines parsed, 7262 lines recorded, 516 records/sec (avg), 586 records/sec (current)
12800 lines parsed, 7902 lines recorded, 524 records/sec (avg), 640 records/sec (current)
13215 lines parsed, 8284 lines recorded, 515 records/sec (avg), 382 records/sec (current)
13989 lines parsed, 8918 lines recorded, 522 records/sec (avg), 634 records/sec (current)
14709 lines parsed, 9488 lines recorded, 525 records/sec (avg), 570 records/sec (current)
14709 lines parsed, 10517 lines recorded, 551 records/sec (avg), 1029 records/sec (current)
14709 lines parsed, 11131 lines recorded, 554 records/sec (avg), 614 records/sec (current)

Logs import summary
-------------------

    11131 requests imported successfully
    0 requests were downloads
    3578 requests ignored:
        0 HTTP errors
        2 HTTP redirects
        1006 invalid log lines
        0 requests did not match any known site
        0 requests did not match any --hostname
        0 requests done by bots, search engines...
        2570 requests to static resources (css, js, images, ico, ttf...)
        0 requests to file downloads did not match any --download-extensions

Website import summary
----------------------

    11131 requests imported to 9 sites
        9 sites already existed
        0 sites were created:

    0 distinct hostnames did not match any existing site:



Performance summary
-------------------

    Total time: 20 seconds
    Requests imported per second: 543.62 requests per second

Processing your log data
------------------------

    In order for your logs to be processed by Piwik, you may need to run the following command:
     ./console core:archive --force-all-websites --force-all-periods=315576000 --force-date-last-n=1000 --url='https://www.example.com/stats'

nginx@host:/var/log/nginx $




mysql> SELECT *, HEX(`idvisitor`) AS `idvisitor`, HEX(`config_id`) AS `config_id`, HEX(`location_ip`) AS `location_ip` FROM `piwik_log_visit` WHERE `idsite` = '14' AND `visit_last_action_time` < '2015-07-17 10:50:00' AND `visit_last_action_time` > '2015-07-16 10:46:00' ORDER BY `visit_last_action_time`;
Empty set (0.00 sec)