Age | Commit message (Collapse) | Author | Files | Lines | |
---|---|---|---|---|---|
2014-06-11 | getBrands: Do not lose uncommitted stuffHEADmaster | Peter Wu | 2 | -0/+2 | |
2014-06-11 | getBrands: Fix hang when done | Peter Wu | 1 | -1/+4 | |
For producer thread 0 and consumer threads 1 and 2 0:queue size = 0 1:get(); hangs... 2:get(); hangs... 0:put suicide pill 1:get resumes, exits Observe that 2:get is still running (deadlocks). To "fix" this, add multiple suicide pills. The current value (16) allows up to 16 concurrent workers. | |||||
2014-06-11 | Merge branch 'master' of git.lekensteyn.nl:tue/2IOC0-DBL/Goldfarmer | Peter Wu | 2 | -0/+82 | |
Conflicts: src/main/Analyzor.java src/main/FarmShell.java | |||||
2014-06-11 | getBrands: increase worker count from 2 to 4 | Peter Wu | 1 | -1/+1 | |
Performance details: - 1 worker : 62k/min (n=60, sd=5.6k, max=70k) - 2 workers: 97k/min (n=45, sd=12k, max=123k) (+35k) - 3 workers: 133k/min (n=39, sd=23k, max=161k) (+36k) - 4 workers: 190k/min (n=102,sd=38k, max=230k) (+57k) No idea where the +57k spike comes from. | |||||
2014-06-11 | Use more workers for consumers | Peter Wu | 1 | -8/+33 | |
This improves the performance from 60k to about 95k tweets per second. | |||||
2014-06-11 | fixed.4 | s123188 | 1 | -11/+36 | |
2014-06-11 | Limit updating to unclassified tweets | Peter Wu | 1 | -1/+4 | |
Tweets which do not mention a brand at all will have a brand "no". | |||||
2014-06-11 | Commit results early to avoid data loss on abort | Peter Wu | 3 | -7/+26 | |
2014-06-11 | More numbers for estimating duration | Peter Wu | 2 | -0/+23 | |
2014-06-11 | getBrands: add periodic status reporting, save memory | Peter Wu | 4 | -31/+158 | |
Prevent out of memory error due to buffering the full resultset. This is done by disabling auto commit (starting a transaction) and setting a smaller fetch size. Watcher is based on my work in Datafiller. | |||||
2014-06-11 | fixed.3 | s123188 | 1 | -0/+1 | |
2014-06-11 | fixed.2 | s123188 | 1 | -0/+4 | |
2014-06-11 | fixed | s123188 | 3 | -134/+266 | |
2014-06-11 | new method for categorizing words | s123188 | 2 | -0/+55 | |
2014-06-11 | Change to use 'RESET' instead of boolean | Peter Wu | 2 | -23/+11 | |
Also make selection query smaller | |||||
2014-06-04 | Producer / consumer for getBrands | Peter Wu | 2 | -17/+102 | |
2014-06-04 | Formatting, remove unused imports | Peter Wu | 2 | -123/+116 | |
2014-06-04 | timezone command occurred twice. | Maurice Laveaux | 1 | -1/+0 | |
2014-06-04 | Merge remote-tracking branch 'origin/master' | Maurice Laveaux | 2 | -8/+183 | |
Conflicts: src/main/Analyzor.java src/main/FarmShell.java | |||||
2014-06-04 | Added better notifications on getBrands. | Maurice Laveaux | 2 | -585/+643 | |
* Reports amount of tweets processed. | |||||
2014-06-02 | improved ratinginterval in posneg | s123188 | 1 | -1/+3 | |
2014-06-02 | +5 | s123188 | 1 | -1/+1 | |
2014-05-31 | made a method that makes a csv to show the newsspreading process in disco. ↵ | s123188 | 2 | -2/+110 | |
Only looks at the replies/retweets of one tweet for a case, no tree by recursion (don't know how to show this in disco). Still needs testing. | |||||
2014-05-31 | made a method for the posnegVisualizer | s123188 | 1 | -7/+71 | |
2014-05-28 | Merge origin/master | daanpeters | 5 | -607/+609 | |
Conflicts: src/main/Analyzor.java src/main/FarmShell.java | |||||
2014-05-28 | Changed Timezone | daanpeters | 2 | -346/+372 | |
2014-05-27 | changed Analyzor.timezone(String query) so that it adds a legenda "timezone" ↵ | s123188 | 1 | -349/+361 | |
so that the visualizer can display a legends | |||||
2014-05-26 | Formatting, drop useless license header | Peter Wu | 3 | -57/+40 | |
Sam Hocevar doesn't know us nor does he have copyright about this work... | |||||
2014-05-26 | Optimize sentiment analysis | Peter Wu | 3 | -16/+39 | |
Do not create a new prepared statement every time. Use an optimized UPDATE query. Drop requirement for supplying a query. | |||||
2014-05-26 | FKING CRLF | Peter Wu | 1 | -345/+345 | |
2014-05-21 | Made a method in Analyzor that makes a csv file for an upcoming html app ↵ | s123188 | 1 | -296/+345 | |
that shows the amount of users in a timezone about a brand. Also made printing a csv file from a String, String, Integer hashMap a seperate method. | |||||
2014-05-21 | Change wordcloud with added brands | S129778 | 1 | -285/+296 | |
2014-05-19 | fixed wordcloud again | s123188 | 1 | -3/+3 | |
2014-05-19 | fixed wordcloud | s123188 | 1 | -1/+2 | |
2014-05-19 | better value format for wordcloud.csv | s123188 | 1 | -1/+1 | |
2014-05-19 | better header for wordcloud.csv | s123188 | 1 | -1/+1 | |
2014-05-19 | added header for wordcloud.csv | s123188 | 1 | -282/+284 | |
2014-05-19 | Merge branch 'master' of git@git.lekensteyn.nl:tue/2IOC0-DBL/Goldfarmer.git | unknown | 1 | -14/+27 | |
Conflicts: src/main/Analyzor.java | |||||
2014-05-19 | wordcloud now makes csv files for wordcloud.html | unknown | 1 | -12/+14 | |
2014-05-19 | double exception fixed | S129778 | 1 | -18/+31 | |
2014-05-19 | BrandChecker removePunct replaces everything. | Maurice Laveaux | 1 | -2/+2 | |
2014-05-19 | Also remove @ and # from input text. | Maurice Laveaux | 1 | -2/+1 | |
2014-05-19 | Replace the punctuality with spaces. | Maurice Laveaux | 1 | -1/+1 | |
2014-05-19 | Added javadoc and visibility parameters. | Maurice Laveaux | 1 | -8/+29 | |
2014-05-19 | Merge origin/master | S129778 | 1 | -23/+68 | |
2014-05-19 | Merge origin/master | S129778 | 1 | -245/+246 | |
Conflicts: src/main/Analyzor.java | |||||
2014-05-19 | Merge branch 'master' of git.lekensteyn.nl:tue/2IOC0-DBL/Goldfarmer | Maurice Laveaux | 3 | -264/+255 | |
2014-05-19 | Updated the brandchecker code and rules. | Maurice Laveaux | 1 | -23/+68 | |
* Changed the brandrules.txt ruleset to conform the new parsing of rules. * Brandchecker now doesn't count multiple equal words. * Updated the testcases, which don't work for others. | |||||
2014-05-19 | Merge origin/master | S129778 | 1 | -245/+245 | |
Conflicts: src/main/Analyzor.java | |||||
2014-05-19 | get brands connection to database | S129778 | 3 | -228/+255 | |