This repo scrapes every id up to 4000. the last valid id is 3820. there where 3276 mangas found. The pages that werent found were added to the error_data table with the status code
The successfull_data table looks like this:
| ident | title | code | lang | cover | banner | authors | styles | tags | is_finished | status | evaluate |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | Saved the Public Enemy by Mistake | 0 | -en | https://i0.hdslb.com/bfs/comic-static/f326ce46ac14a5b94aaedb7e801999d5cff39cde.png | https://i0.hdslb.com/bfs/comic-static/f0f8b3ff5c9e4b3d6270980647f579d0f23780df.png | ["Liu Muqiao"] | ["Historical", "Eastern"] | ["Modern", "Frenemy"] | 0 | 0 | The peaceful life of Lu Jiu is brought to an end when a teenage cultivator turns up before his medical hall, badly injured. The young physician saves the boy, not knowing that he's Liu Jianghe, a notorious man whom many want dead. Is it too late to kill him now? |
| 3 | God Gave Me This Awkward Superpower, What is it for? | 0 | -en | https://i0.hdslb.com/bfs/comic-static/6141a151cf9e71ae4952147a8d8c3c2c9ef28155.png | https://i0.hdslb.com/bfs/comic-static/b2f0db35900446051f5b315c6d772bdca9272529.png | ["Duan Zai Hao Shen", "West Wind Comics"] | ["Fantasy", "Comedy", "Harem"] | ["Modern", "School", "Superpower", "Heartwarming", "Adventure", "Harem"] | 1 | 0 | What a strange dream..."Ding…” My cell phone transformed into a babe after I habitually picked it up to turn off the alarm? I understand now... My superpower is... Transforming the first item I touch with my right hand into a beautiful babe after waking up everyday! |
| 4 | Xian Chan Nu | 0 | -en | https://i0.hdslb.com/bfs/comic-static/1af8414b1395e1320f1ea76472f24db1ac1a890b.png | https://i0.hdslb.com/bfs/comic-static/f7839f2edfa7981eee7ef2f23ea96d4edd735a60.png | ["Lily Club", "Y Shen", "PIKAPI"] | ["GL", "Adventure", "Historical"] | ["Modern", "Humanoid", "Spirits", "Adventure", "Growth"] | 1 | 0 | Liu Shiqing is a playful daughter born to a family of armed escorts. One time while sneaking out on another one of her adventures, she finds herself kidnapped by bandits. Moments before it all seemed to be over, Xian Chan Nu suddenly shows up and swoops her off her feet, saving her and stealing her heart. This is a story of humans and demons, masters and slaves; a tale of revenge and a tale of loyalty shall is only beginning to unfold. |
| 5 | Working Overtime to Destroy the World! | 0 | -en | https://i0.hdslb.com/bfs/comic-static/f9a24be74c2c39371059aa8fc0ff2f9e3e4f3020.png | https://i0.hdslb.com/bfs/comic-static/7efdcdb26b403b4d68b909ff1bb61908d5dcb30b.png | ["Stray Reed Workshop"] | ["Comedy", "Slice of Life", "GL"] | ["Urban", "Comedy", "Cute Girl", "Romance"] | 0 | 0 | Limbo is a shut-in girl who doesn't care for anything except her tentacle comics. Aside from that, everything else is meaningless. On her birthday she wished for the "destruction of the world" and was instead met with a demonic female programmer! The two instantly hit it off, bonding over their common goal of world destruction, the two "project partners" hustle hard everyday to bring the world to an end with hilarious effect. |
| 6 | Help! Because of A BUG, I'm Getting Pestered by the Game's Babes | 0 | -en | https://i0.hdslb.com/bfs/comic-static/202868d306426d7fbc3a45f40611dbdc1a1d78d4.png | https://i0.hdslb.com/bfs/comic-static/c669d345b8f9acb6b97586f94bfbb69a41a07615.png | ["Lily Club", "Bai Li", "Jiao Tang Ju Zai"] | ["GL", "Harem", "Comedy", "Slice of Life"] | ["Modern", "Urban", "Game", "Transmigration", "Harem", "Cute"] | 1 | 0 | Game characters come to life because of a bug?! Blossom, the ancient-style girl with an ancient mindset; Cthylla, the mature girl who comes from a mysterious world; Gumi, an idol of the Meow Country, Gumi; II, the mischievous, petite magical girl, and No.7, the AI-powered agent who loves money... A group of beautiful girls appears and pesters the female game producer. Is this the beginning of a wonderful harem life? No, this is the beginning of a chaotic cohabitation life. |
| 7 | Married To A Stupid Eunuch | 0 | -en | https://i0.hdslb.com/bfs/comic-static/5dc78366bb81b22d45d41c0ecebdd1e4609e2b5e.png | https://i0.hdslb.com/bfs/comic-static/f0f2a87c6a3179528bf3f9285773a89ab8ba5d61.png | ["FANCY BOX", "Scattered Mud", "Amber Mouse", "Comic Factory"] | ["Teen", "Adaptation", "Historical"] | ["Eunuch", "Palace Drama"] | 1 | 0 | Chen Hui has transmigrated into the body of a girl, who committed suicide by bashing her head against a pillar out of reluctance to get married to a eunuch. The eunuch is insidious and cunning, enigmatic in every way. He's cannon fodder, just like the eunuchs depicted in the average TV drama series. In order to ensure her survival, Chen Hui was left with no choice but come up with various schemes to get close to the stupid eunuch, understand him, and gain his favor... |
| 8 | The Blade of Evolution Walking Alone In The Dungeon | 0 | -en | https://i0.hdslb.com/bfs/comic-static/75dba5bb7846e40560ba3e022938965316002bc5.png | https://i0.hdslb.com/bfs/comic-static/3eed4c9bf439a232b49c67462db2dd6b9f4eb23b.png | ["Small Blade"] | ["Action", "Fantasy"] | ["System", "Awakening", "Leveling Up", "Growth"] | 1 | 0 | Although Lu Xin awakens his healer talent, his healing abilities are abysmal. During a dungeon run, Lu Xin's entire team gets wiped out, leaving him as the only survivor. He activates the hidden condition "The Last High Priest" and obtains a "two-handed sword". At the same time, he activates the "two-handed sword's" development system... |
| 9 | A Single Strike Of Shimmering Frost | 0 | -en | https://i0.hdslb.com/bfs/comic-static/6fd9809c21b07ed17269550980d1adac3b11b078.png | https://i0.hdslb.com/bfs/comic-static/12d1108eea6409d565d6fe964ea9cdabf1c58bb0.png | ["Yu Xiao Lan Shan", "Jinjiang Literature City", "Ji Lv Comics"] | ["BL", "Adaptation", "Mystery", "Historical", "Drama", "Battle of Wits"] | ["Suspense", "Detective", "Romance"] | 1 | 0 | The sickly Sect Master Yun Yifeng peddles intelligence, and Prince Xiao requires his service to investigate a theft. Enticing Yun with medicine that can cure his sickness—something Prince Xiao doesn't have—the two embark on a journey to investigate the theft. Something blossoms beyond friendship along the way. |
| 10 | Craftsman | 0 | -en | https://i0.hdslb.com/bfs/comic-static/53cf69a5d3fcbc6cc3a8c62793f2316acb604fa6.png | https://i0.hdslb.com/bfs/comic-static/85fdbb76d05eea1834a7ddd0bcbbd701698fdd0f.png | ["Colorless Sugar Cube", "Man Yue You Pin"] | ["Historical"] | ["Intrigue", "Growth", "Inspirational"] | 1 | 0 | Cheng Shan, a mysterious one-armed young man, travels around the world with his companion, a young girl named Ming Cai, in search of a miraculous medicine, the "Faded Dragon Scale". The theft of the black umbrella from the imperial palace resulted in heavy sins. Due to past relations to the black umbrella, Cheng Shan and Ming Cai decide to search for the black umbrella and recover it. However, after several twists and turns where their lives were in danger, they find that the matter is not as simple as they thought. Will Cheng Shan finally be able to unravel all mysteries and distinguish good from evil? Will he be able to escape unscathed from the lethal threats and dangers lurking in every corner, and eventually find the Faded Dragon Scale? dragon? Or, is there a greater conspiracy behind this? In this life, he is destined to be unable to hide and have no other option but to fight with his life because he is... The Craftsman. |
| 11 | Me and My Zoo | 0 | -en | https://i0.hdslb.com/bfs/comic-static/b182b3b69fe181dcc4d0f30b2f872143c8729886.png | https://i0.hdslb.com/bfs/comic-static/e7a7a6634530fb3bcea0b84369faae43c138c213.png | ["La Mian Hua Tang De Tu Zi", "Jinjiang Literature City", "MKcomic"] | ["Comedy", "Slice of Life", "BL", "Adaptation"] | ["Urban", "System", "Cute Pet", "Spirits"] | 1 | 0 | The poor Duan Jiaze inherited a private zoo after graduation and was forced to bind a "rogue" app called "Lingxiao Hope Project", which ushered in bizarre "animals" such as Lu Ya, Daji, Bai Suzhen, and Black Bear Spirit. The app regularly released business-related tasks. Jiaze would be punished if he failed to complete them. In this way, Jiaze the director was forced to begin his joyful journey of worldwide fame and controlling goblins. |
The error_data table looks like this:
| 1 | 404 |
|---|---|
| 41 | 404 |
| 51 | 404 |
| 78 | 404 |
To navigate to the site:
def generate_url(ident: int):
return "https://www.bilibilicomics.com/detail/mc" + str(ident)