tue/2IOC0-DBL/TwitterDataAnalytics - 2IOC0 DBL Twitter Data Analytics

Age	Commit message (Collapse)	Author	Files	Lines
2014-05-22	Refactored JSON to GSON's implementation.	Maurice Laveaux	1	-19/+23
	* Changed JSONException to JsonParseException.
2014-05-07	Fix null ptr when close/commit	Peter Wu	1	-1/+8
	commit closes everything via safeClose, so ensure that tweetGenerated re-opens it if necessary. Fixes: ƒ commit € Exception in thread "Thread-7" java.lang.NullPointerException at io.DataWriter.writeObject(DataWriter.java:137) at io.DataWriter.tweetGenerated(DataWriter.java:85) at provider.CompositeResultListener.tweetGenerated(CompositeResultListener.java:51) at io.StreamImpl$Poller.processObject(StreamImpl.java:255) at io.StreamImpl$Poller.run(StreamImpl.java:245) at java.lang.Thread.run(Thread.java:744)
2014-05-07	Add flush command	Peter Wu	1	-1/+13

2014-05-07	Get rid of separate profiles	Peter Wu	1	-30/+5
	These are always available from the tweets themselves...
2014-05-03	DataWriter: first read, then open for writing	Peter Wu	1	-2/+3
	Prevents occasional "Unexpected end of ZLIB input stream" errors.
2014-05-03	DataWriter: better detect errors in reading data	Peter Wu	1	-6/+13
	Now print the faulty line and line number. Using BufferedReader instead of Scanner also gave me a hint of the error, so let's stick to it.
2014-05-02	Properly close files and stream on exit	Peter Wu	1	-1/+2

2014-05-02	DataWriter should not open files in constructor	Peter Wu	1	-19/+40
	Right now Store instances are created in the constructor of DataWriter. This causes issues, namely that Store instances are unable to use DataWriter in its constructor. The real-world implication is that convertUncompressed in CompressableDataWriter is unusable for the CompressedStore.
2014-05-02	Fix typo in DataWriter	Peter Wu	1	-1/+1

2014-05-02	Abort if file cannot be read, don't leak on error	Peter Wu	1	-11/+17

2014-05-02	DataWriter: don't leak input fd	Peter Wu	1	-1/+10

2014-05-02	Refactor DataWriter once more to group a file	Peter Wu	1	-37/+79
	The input and output file are closely related, do not burden others with tracking which output and input need to be matched.
2014-05-02	Make DataWriter more generic	Peter Wu	1	-11/+40
	Prepare for compressed file formats, this requires that the data writer can handle compressed files. In theory an implementation can even write stuff over the network instead of a file.
2014-05-02	Don't ignore IOException stupid!	Peter Wu	1	-34/+23
	Files may not be accessible if they are read-only, or if the directory is read-only, or ... whatever. So, let the caller handle IOException in DataWriter. Return a set if it can be read. Do some misc cleanups (remove unused imports, fix docs, remove obsolete TODOs).
2014-05-01	Added the target command with options: file, shell.	Maurice Laveaux	1	-4/+15
	* Implemented target file, which uses DataWriter as RequestListener which writes the tweets and profiles. * Added profiles-filename, tweets-filename to the config.
2014-04-30	Fix names	Peter Wu	1	-5/+4

2014-04-30	Renamed OutputStream.java because it was part of the Java classes.	Maurice Laveaux	1	-0/+137