-
I'm looking to organize all of my scrapes in a certain structure where it's by site, then a subfolder for content and metadata separately, along with the archive file. Is there a way to do this? Here's what I'm trying to do, using Danbooru as an example:
I have this config, which mostly works: {
"extractor": {
"danbooru": {
"archive": ["danbooru.donmai.us", "archive.sqlite3"],
"directory": ["danbooru.donmai.us", "content"],
"filename": "{filename}.{extension}",
"metadata": true,
"postprocessors": [{
"directory": ["metadata"],
"name": "metadata",
"event": "post",
"filename": "{id}_{filename}.json",
"indent": "\t"
}]
}
}
} Unfortunately, it places the metadata inside of the content folder. I also tried using "directory": ["..", "metadata"], I've tried various things, but no luck, including using an object for |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
v1.27.3 has a
There's a bug with using |
Beta Was this translation helpful? Give feedback.
-
Perfect! If only I had looked again at the post-processor options documentation, but that works plenty well. Thanks for answering, and more importantly for this awesome tool. Here's the new config, for reference: {
"extractor": {
"danbooru": {
"archive": ["danbooru.donmai.us", "archive.sqlite3"],
"base-directory": ["danbooru.donmai.us"],
"directory": ["content"],
"filename": "{filename}.{extension}",
"metadata": true,
"postprocessors": [{
"base-directory": ["danbooru.donmai.us", "metadata"],
"name": "metadata",
"event": "post",
"filename": "{id}_{filename}.json",
"indent": "\t"
}]
}
}
} |
Beta Was this translation helpful? Give feedback.
v1.27.3 has a
base-directory
option formetadata
post processors. (605f6fb)There's a bug with using
..
on Windows: #5942