mirror of https://github.com/balkian/bitter.git
You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
7724967285
|
6 years ago | |
|---|---|---|
| .. | ||
| README.md | 6 years ago | |
| example_query.sh | 6 years ago | |
| extract-hashtags.sh | 6 years ago | |
| extract-interactions.sh | 6 years ago | |
| extract-limits.sh | 6 years ago | |
| extract-media.sh | 6 years ago | |
| extract-users.sh | 6 years ago | |
| extract.sh | 6 years ago | |
| extract_extended.sh | 6 years ago | |
| extract_text.sh | 6 years ago | |
| filter-edges.sh | 6 years ago | |
| functions.py | 6 years ago | |
| print-hashtags.sh | 6 years ago | |
| print-replies.sh | 6 years ago | |
| print-rts.sh | 6 years ago | |
README.md
Scripts to process jsonlines
To get the jsonlines file, you can use the streaming API or the search api, like so:
python -m bitter.cli --config .bitter.yaml api '/search/tweets' --result_type recent --q 'bitter OR #bitter OR @bitter' --tweet_mode extended --tweets --max_count 5000 >> mytweets.jsonlines
To keep track of the query that generated the file, you can save the command in a text file.
For instance, the example above is also in example_query.sh.