Using PRAW in Python to Pull Historical subreddits

2 points · submitted Jun 2018 by u/bcryptom · archived

Hi, I am wondering if anyone has any experience using the Python PRAW package to gather data on historical posts on a subreddit? I have tried the code below, but that prints a "prawcore.exceptions.ServerError: received 503 HTTP response" error.

4 comments · 60% upvoted · other discussions

comments

bcryptom [OP] 1 points · Jun 2018

topics_dict = {'title':[],'score':[],'id':[],'comms_num': 
[],'created':[],'body':[]}
for submission in 
reddit.subreddit('btc').submissions(1527000000,1528000000):
    topics_dict['title'].append(submission.title)

permalink

Assailant_TLD 2 points · Jun 2018

As a below commentor noted it’s basically impossible now due to Reddit changing how their API searches for things.

If you really want to try check out r/pushshift .

permalink

[deleted] 1 points · Jun 2018

https://www.reddit.com/r/changelog/comments/7tus5f/update_to_search_api/

I cant wait for more "improvements".

permalink

bcryptom [OP] 1 points · Jun 2018

Wow...that's really doing a disservice for users!

permalink