Tanner
f11123b441
Handle Lobsters comment parsing TypeErrors
...
Too lazy to debug this:
2023-08-29 12:56:35,111 - root - INFO - Updating lobsters story: yktkwr, index: 55
Traceback (most recent call last):
File "src/gevent/greenlet.py", line 854, in gevent._gevent_cgreenlet.Greenlet.run
File "/home/tanner/qotnews/apiserver/server.py", line 194, in feed_thread
valid = feed.update_story(story)
File "/home/tanner/qotnews/apiserver/feed.py", line 74, in update_story
res = lobsters.story(story['ref'])
File "/home/tanner/qotnews/apiserver/feeds/lobsters.py", line 103, in story
s['comments'] = iter_comments(r['comments'])
File "/home/tanner/qotnews/apiserver/feeds/lobsters.py", line 76, in iter_comments
parent_stack = parent_stack[:indent-1]
TypeError: unsupported operand type(s) for -: 'NoneType' and 'int'
2023-08-29T12:56:35Z <Greenlet at 0x7f92ad840ae0: feed_thread> failed with TypeError
2023-08-31 07:30:39 +00:00
Tanner
83fea72578
Add Tildes group whitelist
2023-07-13 22:54:36 +00:00
Tanner
3a0f7e79a2
Increase again
2023-06-13 17:11:50 +00:00
Tanner
0cfbf152eb
Increase Tildes story score requirement
2023-06-11 01:01:31 +00:00
Tanner
b051794a0c
Catch all possible Reddit API exceptions
2023-03-15 21:16:37 +00:00
Tanner
8218c849b7
Fix fix-stories bug
2022-08-10 04:06:39 +00:00
Tanner
545f2f300e
Write fixed stories to database
2022-07-05 00:57:56 +00:00
Tanner
32e1ed615e
Begin script to fix bad gzip text
2022-07-04 20:32:01 +00:00
Tanner
3db01c01f0
Move FEED_LENGTH to settings.py, use for search results
2022-07-04 19:08:24 +00:00
Tanner
9fa9899965
Add test file
2022-07-04 05:56:06 +00:00
Tanner
4816e8a5ed
Fix requests text encoding slowness
2022-07-04 05:55:52 +00:00
Tanner
26f03f883b
Return search results directly from the server
2022-07-04 04:33:01 +00:00
Tanner
c1aede8f1f
Adjust title
2022-06-30 00:05:15 +00:00
Tanner
d6cf56677b
Add noindex meta tag to stories
2022-06-29 23:20:53 +00:00
Tanner
dae40b27cb
Increase database timeout
2022-06-24 20:50:27 +00:00
Tanner
3d8ed467c9
Update software
2022-05-31 04:24:12 +00:00
Tanner
e93230d518
Improve logging, sends tweets to nitter.net
2022-03-05 23:48:46 +00:00
Tanner
f16abc2074
Remove outline API
2022-03-05 22:05:29 +00:00
Tanner
c946b150ff
Include option to disable readerserver
2022-03-05 22:04:25 +00:00
Tanner
63963e2c74
Include option to disable search
2022-03-05 21:58:35 +00:00
Tanner
e48846f4c3
Fix search to work with low-RAM server
2022-03-05 21:33:07 +00:00
Tanner
bac043d298
Improve logging
2021-09-06 00:21:05 +00:00
Tanner
13d00433cd
Add script to reindex search, abstract search API
2021-09-06 00:20:21 +00:00
Tanner
30c73a920a
Change the order by which content-type is grabbed
2021-01-30 06:36:02 +00:00
Tanner
cf5c1a3d44
Add optional skip and limit to API route
2021-01-18 03:59:33 +00:00
Tanner
214f4c50b8
Remove colons from date string so Python 3.5 can parse
2020-12-15 23:19:50 +00:00
Tanner
ce3b986e47
Add Lobsters to feed
2020-12-12 05:26:33 +00:00
Tanner
6a73fa548e
Update gitignore
2020-12-11 23:49:45 +00:00
Tanner
db92b39cda
Increase sqlite lock timeout
2020-11-19 21:38:18 +00:00
Tanner
f0946c7d1f
Blacklist sec.gov website
2020-11-19 21:37:59 +00:00
Tanner
410499518e
Add header to get content type
2020-11-03 20:27:43 +00:00
Tanner
837bb91bcc
Move feed and Praw config to settings.py
2020-11-02 02:26:54 +00:00
Tanner
a2b60f04ad
Remove Whoosh
2020-11-02 00:22:40 +00:00
Tanner
278fbf9a1c
Try Hackernews API twice
2020-11-02 00:17:22 +00:00
Tanner
917e6c412f
Improve logging
2020-11-02 00:13:43 +00:00
Tanner
0ad381bb7e
Make qotnews work with WaPo
2020-10-29 04:55:34 +00:00
Tanner
864e6192db
Monkeypatch earlier
2020-10-24 22:30:00 +00:00
Tanner
cdb14b5d4e
Add a script to delete a story
2020-10-03 23:42:21 +00:00
Tanner
4e1566961a
Adjust feeds
2020-10-03 23:41:57 +00:00
Tanner
ec859ff64c
Adjust content-type request timeout
2020-08-14 03:57:43 +00:00
Tanner
33ac9e63dd
Adjust port
2020-08-14 03:57:18 +00:00
Tanner
835c6241ee
Delete displayed-attributes when init search
2020-08-14 03:56:47 +00:00
Tanner
e05aa1c6ee
Remove business subreddit from feed
2020-08-14 03:55:28 +00:00
Tanner
1c420cc49d
Update requirements
2020-07-08 05:24:32 +00:00
Tanner
38cfc4bda4
Remove extra logging
2020-07-08 02:36:40 +00:00
Tanner
162142083b
Fix crash when HN feed fails
2020-07-08 02:36:40 +00:00
Tanner
02c8bbad20
Remove document img and ignore r/technology
2020-07-08 02:36:40 +00:00
Tanner
5ef0fd120b
Tune search rankings and attributes
2020-07-08 02:36:40 +00:00
Tanner
5634cc812c
Add more logging
2020-07-08 02:36:40 +00:00
Tanner
21c221925d
Remove get first image
2020-07-08 02:36:40 +00:00