Callback: handle_pagination_url not working

[u3533791]

Pagination url retrieved seems to be incorrect
The following code stops working after the first returned pagination url and is stuck on load forever
From the console message, we can see when the first url is valid, the next post is accessible, so there must be something wrong with the generated one

def handle_pagination_url(url):
    print(url)

for post in get_posts("387603714763860", pages=None, options={'allow_extra_requests': False, 'posts_per_page': 200}, request_url_callback=handle_pagination_url):
    print(post["time"])

Console:
https://m.facebook.com/387603714763860/posts/ 2022-04-06 23:10:02 2022-02-26 21:05:18 https://m.facebook.com/page_content_list_view/more/?page_id=387603714763860&start_cursor={"timeline_cursor":"AQHRLYbfKxftDvEg5-9QM3EV8Bhxzy613M5IgJxm4MqvZ_b3iWI0QfUlI0TNmvu8WJMm1ttvnRYEBntkrFVw8Mv51HihELDbCRbhHoyxcmqXgaEhylL-DXFE2IcsKxtGruMs","timeline_section_cursor":null,"has_next_page":true}&num_to_fetch=200&surface_type=posts_tab

[neon-ninja]

How long did you wait for? I see you set posts_per_page to 200 - 200 posts can take a long time to download. Long enough to hit the default 30 second timeout, even. At which point you need to set timeout to a higher value. Given you didn't mention hitting a ReadTimeout exception, I assume you didn't even wait 30 seconds before terminating?

After setting timeout=60, I get this output:

https://m.facebook.com/387603714763860/posts/
2022-04-07 03:10:02
2022-02-27 02:05:18
https://m.facebook.com/page_content_list_view/more/?page_id=387603714763860&start_cursor={"timeline_cursor":"AQHRhF4WYimT9ydoSoj6ILHvBuNhbnlM5z_cnswNU-ySf3luMAMjEoL428rJF-BiHADtb9Fu-eeIxjnSSyM-PYVZiYdpQ5GdLxvcBD2VsIRycHBtBbM4X46ywBvOkxJPXuSd","timeline_section_cursor":null,"has_next_page":true}&num_to_fetch=200&surface_type=posts_tab
2022-02-26 20:18:32
2022-02-20 18:48:58
2022-02-16 05:03:54
2022-02-09 07:20:42
2022-02-04 02:43:21
2020-12-31 19:44:11
2020-11-28 05:48:31
2020-11-06 18:01:40
2020-11-05 06:38:07
2020-11-02 23:46:52
2020-11-02 04:30:12
2020-10-17 00:04:14
2020-10-15 00:46:17
2020-10-13 17:03:43
2020-10-08 01:37:41
2020-10-07 00:36:22
2020-10-05 20:44:23
2020-10-02 03:15:26
2020-10-02 02:47:39
2020-10-01 22:05:32
2020-10-01 21:47:54
2020-10-01 20:57:08
2020-10-01 19:39:05
2020-10-01 16:18:46
2020-10-01 01:55:53
2020-09-26 00:02:30
2020-09-23 17:15:38
2020-09-17 04:32:09
2020-08-21 19:03:24
2020-08-13 23:05:38
2020-08-12 04:59:21
2020-08-11 11:25:04
2020-08-05 19:53:36
2020-08-03 05:20:14
2020-07-30 22:23:14
2020-07-29 22:52:48
2020-07-29 04:03:54
2020-07-24 16:23:59
2020-07-23 19:13:56
2020-07-22 11:23:07
2020-07-22 04:56:29
2020-07-22 03:00:02
2020-07-22 01:42:42
2020-07-22 00:36:24
2020-07-22 00:01:50
2020-07-17 20:31:57
2020-07-17 18:53:41
2020-07-17 17:59:55
2020-07-16 03:49:04
2020-07-13 21:16:19
2020-07-13 20:10:46
2020-07-13 16:05:16
2020-07-13 03:18:10
2020-07-13 02:09:07
2020-07-11 23:41:13

etc

[u3533791]

Thanks for the help!
I let it run for >30 minutes and it was still stuck.
I added the timeout parameter and it didn't trigger as well.

After looking at your answer, I tried to run it on python directly with cmd and it worked with or without the timeout parameter.

I was running it in Anaconda Spyder IDE built-in terminal, when it got infinitely stuck.

[neon-ninja]

Maybe you accidentally set a breakpoint?