| But MongoDB is a general-purpose database, and not a data analysis tool, so a common pattern when analysing data that's stored within MongoDB is to extract the results of a query into a Numpy array, or Pandas dataframe, and to run complex and potentially long running analyses using the toolkit those frameworks provide. Until recently, the performance hit of converting large amounts of BSON data, as provided by MongoDB into these data structures, has been slower than we'd like. | |
| Ref: | |
| https://www.mongodb.com/developer/languages/python/pymongoarrow-and-data-analysis/ | |
| https://arrow.apache.org/use_cases/ |
| create new branch | |
| -- git checkout -b [branch_name] | |
| delete branch local | |
| -- git branch -d [branch_name] | |
| delete remote branch | |
| -- git push origin --delete [branch_name] | |
| merge branch master remote into feature branch |
| db.getCollection("report_detail").aggregate([ | |
| {'$match':{'date':'2023-03-01'}}, | |
| { "$project": { | |
| "hashmaps": { "$objectToArray": "$$ROOT" } | |
| } }, | |
| { "$group": { | |
| "_id": null, | |
| "fields": { "$addToSet": "$hashmaps.k" } | |
| } }, | |
| { "$project": { |
| https://medium.com/@B1scuit/creating-a-worker-pool-in-go-21e62907f732 |
Make sure to export/import your settings through File -> Manage IDE settings before/after
Remove-Item '.\AppData\Local\Jetbrains\PhpStorm*'
Remove-Item '.\AppData\Roaming\Jetbrains\PhpStorm*'
| https://stackoverflow.com/questions/22699807/python-mysql-using-pymysql-auto-reconnect |
| 1. message queue | |
| queue = data structure == first in first out = the first message added to queue, is the first item to leave the queue. | |
| => a message queue contains messages with data about events that follow the FIFO order. | |
| 2. message broker: | |
| is a software, enables aplication, systems and services can communication each others |
| https://stackoverflow.com/questions/53622737/pandas-convert-strings-to-numeric-if-possible-else-keep-string-values?fbclid=IwAR3qEt7TOTIuOiB3URDPHWFQE41tClh_nFT8OgwCDKsb_8UAZKr8X-bMglw | |
| https://towardsdatascience.com/converting-data-to-a-numeric-type-in-pandas-db9415caab0b | |
| https://stackoverflow.com/questions/69659219/convert-a-data-frame-in-which-one-column-contains-array-of-numbers-as-string-to | |
| https://stackoverflow.com/questions/379906/how-do-i-parse-a-string-to-a-float-or-int | |
| https://stackoverflow.com/questions/5316720/how-to-convert-string-values-from-a-dictionary-into-int-float-datatypes | |
| https://stackoverflow.com/questions/354038/how-do-i-check-if-a-string-represents-a-number-float-or-int |
| C:\Users\Admin\AppData\Roaming\JetBrains\PhpStorm2020.2 | |
| Delete "eval" folder | |
| Delete "options/other.xml" | |
| Go to your registry editors' path: Computer\HKEY_CURRENT_USER\SOFTWARE\JavaSoft\Prefs\jetbrains\phpstorm | |
| Remove all inner folders. | |
| Relaunch PHPStorm |
| docker-compose up -d --no-deps --build app |