Age | Commit message (Collapse) | Author | Files | Lines | |
---|---|---|---|---|---|
2014-05-02 | Fix typo in DataWriter | Peter Wu | 1 | -1/+1 | |
2014-05-02 | Abort if file cannot be read, don't leak on error | Peter Wu | 1 | -11/+17 | |
2014-05-02 | CompressableDataWriter: Implement conversion from uncompressed | Peter Wu | 1 | -1/+64 | |
2014-05-02 | Support compressed files | Peter Wu | 2 | -2/+99 | |
2014-05-02 | Adjust target command help message, print available targets | Peter Wu | 1 | -7/+10 | |
2014-05-02 | DataWriter: don't leak input fd | Peter Wu | 1 | -1/+10 | |
2014-05-02 | Refactor DataWriter once more to group a file | Peter Wu | 1 | -37/+79 | |
The input and output file are closely related, do not burden others with tracking which output and input need to be matched. | |||||
2014-05-02 | Speed up compilation by ignoring samples crap | Peter Wu | 1 | -1/+1 | |
Do not remove the Chapter*/ example files, they may be useful in the future. For now just remove it from the sources list. | |||||
2014-05-02 | Make DataWriter more generic | Peter Wu | 1 | -11/+40 | |
Prepare for compressed file formats, this requires that the data writer can handle compressed files. In theory an implementation can even write stuff over the network instead of a file. | |||||
2014-05-02 | Track number of unique users for status reporting | Peter Wu | 2 | -1/+27 | |
2014-05-02 | Don't ignore IOException stupid! | Peter Wu | 2 | -39/+33 | |
Files may not be accessible if they are read-only, or if the directory is read-only, or ... whatever. So, let the caller handle IOException in DataWriter. Return a set if it can be read. Do some misc cleanups (remove unused imports, fix docs, remove obsolete TODOs). | |||||
2014-05-02 | Basic stats for tweets | Peter Wu | 2 | -0/+39 | |
2014-05-02 | Fix enabled targets print, allow multiple args, improve help | Peter Wu | 1 | -4/+10 | |
2014-05-02 | Persist a single set of targets for all streams | Peter Wu | 1 | -31/+32 | |
* Split ResultListener and ExceptionListener implementation, the methods turns out not to be closely related. * Extract CompositeResultListener from Stream, making TweetShell own it, this simplifies code and allows you to have targets even if no stream is instantiated. | |||||
2014-05-02 | Allow multiple targets to be enabled/disabled | Peter Wu | 3 | -28/+273 | |
2014-05-02 | Show hint if no keywords are added | Peter Wu | 1 | -1/+5 | |
2014-05-02 | Add "?" alias for "help" | Peter Wu | 1 | -1/+5 | |
2014-05-02 | Avoid hang during close | Peter Wu | 1 | -4/+29 | |
Apparently the socket operations are blocking in a way such that even interrupt() cannot stop it. Close the socket (which will generate an IOException masked as JSONException) to immediately close the socket. Also do not leak a socket if an error occurred in the Worker constructor (when a Stream connection is set up). | |||||
2014-05-01 | Add command to print active keywords | Peter Wu | 3 | -0/+47 | |
2014-05-01 | Don't leak connections | Peter Wu | 2 | -34/+42 | |
2014-05-01 | Prettify prompt, fix target param | Peter Wu | 1 | -2/+7 | |
2014-05-01 | StreamHandler now outputs the tweet details | Peter Wu | 1 | -2/+17 | |
2014-05-01 | run.sh: add helper to disable hostname verification | Peter Wu | 1 | -0/+5 | |
2014-05-01 | New thread for notifying of new objects | Peter Wu | 1 | -13/+95 | |
* Use volatile boolean instead of AtomicBoolean. There will only be one one writer. * Store received objects in a queue instead of printing them. * Rename thread to clarify its I/O purpose. * Create new Thread for notifying observers of new tweets and users. | |||||
2014-05-01 | Get rid of unused and broken poll function | Peter Wu | 3 | -18/+0 | |
2014-05-01 | Do not destroy the old file... | Peter Wu | 1 | -6/+6 | |
2014-05-01 | Merge branch 'master' of git.lekensteyn.nl:tue/2IOC0-DBL/TwitterDataAnalytics | Maurice Laveaux | 1 | -5/+11 | |
2014-05-01 | Moved setting the default values. | Maurice Laveaux | 2 | -5/+11 | |
* Moved from TweetShell to Configuration. | |||||
2014-05-01 | Added the target command with options: file, shell. | Maurice Laveaux | 4 | -12/+73 | |
* Implemented target file, which uses DataWriter as RequestListener which writes the tweets and profiles. * Added profiles-filename, tweets-filename to the config. | |||||
2014-05-01 | Close stream when stopping worker, English tweets only please... | Peter Wu | 1 | -5/+11 | |
2014-05-01 | Allow result and exception handler to be changed | Peter Wu | 2 | -8/+35 | |
2014-05-01 | Fix signing for OAuth POST messages, fix search param | Peter Wu | 3 | -6/+42 | |
2014-05-01 | Show more useful IO exception | Peter Wu | 1 | -1/+2 | |
2014-05-01 | [WIP] Initial hacky TweetShell | Peter Wu | 4 | -2/+257 | |
In TESTING! DefaultOAuthConsumer does not play nice with POST requests... need to fix that somehow. | |||||
2014-04-30 | TwitterApi: retry asking for PIN if missing | Peter Wu | 1 | -2/+22 | |
Also provide access to requester for stream thingey. | |||||
2014-04-30 | Use wrapped gzipinputstream from twitter | Peter Wu | 2 | -2/+38 | |
2014-04-30 | StreamImpl: Read JSON objects and validate | Peter Wu | 1 | -4/+25 | |
2014-04-30 | StreamImp: support gzip compression | Peter Wu | 1 | -1/+17 | |
May yield huge bandwidth savings and improve throughput for slow links. | |||||
2014-04-30 | [WIP] Stream processor | Peter Wu | 4 | -18/+235 | |
2014-04-30 | Fix names | Peter Wu | 1 | -5/+4 | |
2014-04-30 | Merge remote-tracking branch 'origin/master' | Peter Wu | 1 | -14/+21 | |
2014-04-30 | Drop shit from main | Peter Wu | 1 | -25/+0 | |
2014-04-30 | Don't use v1 API for OAuth check | Peter Wu | 1 | -1/+1 | |
2014-04-30 | Merge ProfileListener to TweetListener | Peter Wu | 3 | -32/+23 | |
These are quite closely coupled. | |||||
2014-04-30 | Renamed OutputStream.java because it was part of the Java classes. | Maurice Laveaux | 1 | -14/+21 | |
2014-04-30 | Stream interface | Peter Wu | 4 | -79/+35 | |
2014-04-30 | fix run.sh to detect non-existing proxy | Peter Wu | 1 | -2/+6 | |
2014-04-30 | Merge remote-tracking branch 'origin/master' | Peter Wu | 7 | -29/+143 | |
2014-04-30 | Create a class that implements ProfileListener and TweetListener. | Maurice Laveaux | 1 | -0/+130 | |
* Creates tweets.txt and profiles.txt when they don't exist. * Read these files to store a set of ids. * Consumes new tweets and profiles and writes if the ids are not found. | |||||
2014-04-30 | main: search english tweets | Peter Wu | 1 | -0/+1 | |