tue/2IOC0-DBL/Goldfarmer - Data analysis program

Age	Commit message (Collapse)	Author	Files	Lines
2014-06-11	getBrands: Do not lose uncommitted stuffHEAD master	Peter Wu	2	-0/+2

2014-06-11	getBrands: Fix hang when done	Peter Wu	1	-1/+4
	For producer thread 0 and consumer threads 1 and 2 0:queue size = 0 1:get(); hangs... 2:get(); hangs... 0:put suicide pill 1:get resumes, exits Observe that 2:get is still running (deadlocks). To "fix" this, add multiple suicide pills. The current value (16) allows up to 16 concurrent workers.
2014-06-11	Get rid of CR shit, LF ftw!	Peter Wu	1	-81/+81

2014-06-11	Merge branch 'master' of git.lekensteyn.nl:tue/2IOC0-DBL/Goldfarmer	Peter Wu	3	-81/+163
	Conflicts: src/main/Analyzor.java src/main/FarmShell.java
2014-06-11	.gitattributes: Use native EOL	Peter Wu	1	-2/+2
	Should fix future conflicts due to the editor writing CRLF files.
2014-06-11	getBrands: increase worker count from 2 to 4	Peter Wu	1	-1/+1
	Performance details: - 1 worker : 62k/min (n=60, sd=5.6k, max=70k) - 2 workers: 97k/min (n=45, sd=12k, max=123k) (+35k) - 3 workers: 133k/min (n=39, sd=23k, max=161k) (+36k) - 4 workers: 190k/min (n=102,sd=38k, max=230k) (+57k) No idea where the +57k spike comes from.
2014-06-11	Use more workers for consumers	Peter Wu	1	-8/+33
	This improves the performance from 60k to about 95k tweets per second.
2014-06-11	fixed.4	s123188	2	-92/+117

2014-06-11	Limit updating to unclassified tweets	Peter Wu	1	-1/+4
	Tweets which do not mention a brand at all will have a brand "no".
2014-06-11	Commit results early to avoid data loss on abort	Peter Wu	3	-7/+26

2014-06-11	More numbers for estimating duration	Peter Wu	2	-0/+23

2014-06-11	getBrands: add periodic status reporting, save memory	Peter Wu	4	-31/+158
	Prevent out of memory error due to buffering the full resultset. This is done by disabling auto commit (starting a transaction) and setting a smaller fetch size. Watcher is based on my work in Datafiller.
2014-06-11	fixed.3	s123188	1	-0/+1

2014-06-11	fixed.2	s123188	1	-0/+4

2014-06-11	fixed	s123188	5	-280/+355

2014-06-11	new method for categorizing words	s123188	2	-0/+55

2014-06-11	Change to use 'RESET' instead of boolean	Peter Wu	2	-23/+11
	Also make selection query smaller
2014-06-04	Producer / consumer for getBrands	Peter Wu	2	-17/+102

2014-06-04	Formatting, remove unused imports	Peter Wu	2	-123/+116

2014-06-04	timezone command occurred twice.	Maurice Laveaux	1	-1/+0

2014-06-04	get rid of CRLF again.	Maurice Laveaux	1	-81/+81

2014-06-04	Merge remote-tracking branch 'origin/master'	Maurice Laveaux	3	-89/+264
	Conflicts: src/main/Analyzor.java src/main/FarmShell.java
2014-06-04	Removed to many rules that were not needed.	Maurice Laveaux	1	-65/+8

2014-06-04	Added better notifications on getBrands.	Maurice Laveaux	2	-585/+643
	* Reports amount of tweets processed.
2014-06-02	improved ratinginterval in posneg	s123188	1	-1/+3

2014-06-02	+5	s123188	1	-1/+1

2014-05-31	made a method that makes a csv to show the newsspreading process in disco. ↵	s123188	2	-2/+110
	Only looks at the replies/retweets of one tweet for a case, no tree by recursion (don't know how to show this in disco). Still needs testing.
2014-05-31	made a method for the posnegVisualizer	s123188	2	-88/+152

2014-05-28	Changed compnay iphone into apple	Maurice Laveaux	1	-11/+11

2014-05-28	Merge origin/master	daanpeters	8	-691/+693
	Conflicts: src/main/Analyzor.java src/main/FarmShell.java
2014-05-28	Changed Timezone	daanpeters	3	-346/+555

2014-05-27	changed Analyzor.timezone(String query) so that it adds a legenda "timezone" ↵	s123188	1	-349/+361
	so that the visualizer can display a legends
2014-05-26	Formatting, drop useless license header	Peter Wu	4	-59/+42
	Sam Hocevar doesn't know us nor does he have copyright about this work...
2014-05-26	Optimize sentiment analysis	Peter Wu	3	-16/+39
	Do not create a new prepared statement every time. Use an optimized UPDATE query. Drop requirement for supplying a query.
2014-05-26	FKING CRLF	Peter Wu	3	-427/+427

2014-05-21	Made a method in Analyzor that makes a csv file for an upcoming html app ↵	s123188	2	-377/+426
	that shows the amount of users in a timezone about a brand. Also made printing a csv file from a String, String, Integer hashMap a seperate method.
2014-05-21	Change wordcloud with added brands	S129778	1	-285/+296

2014-05-21	Committed a brandrule that only return brands.	Maurice Laveaux	1	-0/+70

2014-05-19	fixed wordcloud again	s123188	1	-3/+3

2014-05-19	fixed wordcloud	s123188	1	-1/+2

2014-05-19	better value format for wordcloud.csv	s123188	1	-1/+1

2014-05-19	better header for wordcloud.csv	s123188	1	-1/+1

2014-05-19	added header for wordcloud.csv	s123188	2	-282/+285

2014-05-19	Merge branch 'master' of git@git.lekensteyn.nl:tue/2IOC0-DBL/Goldfarmer.git	unknown	1	-14/+27
	Conflicts: src/main/Analyzor.java
2014-05-19	wordcloud now makes csv files for wordcloud.html	unknown	1	-12/+14

2014-05-19	double exception fixed	S129778	1	-18/+31

2014-05-19	Updated brandrules.txt, apple and concatenated.	Maurice Laveaux	1	-2/+6

2014-05-19	BrandChecker removePunct replaces everything.	Maurice Laveaux	1	-2/+2

2014-05-19	Updated brandrules, added samsung.	Maurice Laveaux	1	-1/+9

2014-05-19	Also remove @ and # from input text.	Maurice Laveaux	1	-2/+1