M. Eric DeFazio typestruct
typestruct
/ NetflixPrizeTypeStructLoadFromFiles.java
Created
November 7, 2014 13:58
typestruct loading Netflix Prize Training DataSet (100M records, 2Gb) into active memory
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package netflix; | |
| import java.io.BufferedReader; | |
| import java.io.File; | |
| import java.io.FileReader; | |
| import java.io.IOException; | |
| import com.typestruct.BaseException; | |
| import com.typestruct.api.TypeStruct.Bind; | |
| import com.typestruct.api.TypeStruct.Data; |
typestruct
/ NetflixPrizeTypeStructPrototype.java
Last active
August 29, 2015 14:08
typestruct Explaining Usage based on Netflix Prize Training DataSet (Including Prototyping large 100+million record dataset)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package netflix; | |
| import com.typestruct.api.TypeStruct.Bind; | |
| import com.typestruct.api.TypeStruct.Data; | |
| import com.typestruct.api.TypeStruct.Data.Prototype; | |
| import com.typestruct.bind.Field; | |
| import com.typestruct.bind.struct.StructWord; | |
| import com.typestruct.data.store.WordDataStore; | |
| import example.type.DayIntervalType; //this is a "custom" user defined type |
NewerOlder