Releases: oPromessa/flickr-uploader
Releases · oPromessa/flickr-uploader
V2.7.1 List bad files. Album tag on uploaded pics. Several performance, control and fixes.
Fixes/Features
- New option (--list-bad-files)to list badfiles recorded no the Database (feature #27)
- Include Album as a PIC tag. To facilitate finding failed load pics (feature #29).
- From v2.7.0 onwards, uploadr adds to Flickr an album tag to each pic. uploadr v2.7.0 will automatically update the previously loaded pics with such album tag, upon first run.
- Version 2.7.1 runs in multiprocessing mode (use option -p) to add album tag. It limits function calls to flickr to 5 per second to avoid reaching the 3600 requests/hour of Flickr.
- New option: --add-albums-migrate is only available to re-run assigning album tags to previously uploaded pics, should it be necessary and in case the automated process fails.
- PLEASE NOTE FOR LARGE LIBRARIES THIS 1st RUN:
- MAY TAKE A WHILE. IN MY CASE ABOUT 10min FOR EACH 1000 PICS OR SO...
- MAY SURPASS THE Flickr 3600 requests/hour LIMIT. SIMPLY RESTART AFTER SOME TIME & UNTIL COMPLETION
- Updated uploadr.cron file with more details. Adapt the previous file you currently already have working on your system.
- Handle orphanated PICs previously loaded without a Set.
- Register on badfiles also files to large reported by Flickrt on upload (feature #37).
- Reduce file system scannig time by not checking a file in an excluded folder (feature #36. Thanks @malys).
- To confirm full resolution on: Revise try/except on upload around except error '040' (issue #28).
Questions & Answers
- Added several clarifications to Readme and Q&A section (issue #31 and #38. Thanks @ze6killer).
Output Messages
- Display current vs total number of files processed.
- Adjusted niceprint of multiprocessing messages to apply only with verbose option.
Environment and Coding
- Python 2.7 + 3.6 compatibility.
- Python 3.7-dev: Initial tests only.
- Imports module xml.etree.ElementTree in case is required to use function 'xml.etree.ElementTree.tostring' (feature #41)
- Helper class rate_limited and functions to rate limiting function calls with Python Decorators on external module (V2.7.1).
- Use flickrapi 2.4 on TravisCI tests (V2.7.1)
- Reorganized order of Init message and import.
- Reordered sys.exit codes.
- Additional protection on LOGGING_LEVEL definition.
- Function is_photo_already_uploaded: one additional result for PHOTO UPLOADED WITHOUT SET WITH ALBUM TAG when row exists on DB. Mark such row on the database files.set_id to null to force re-assigning to Album/Set on flickr.
- Addresses deleted file from local which is also deleted from flickr
- Created function getSetNameFromFile (V2.7.0)
- Adapted niceprint to print function name on new optional parameter (V2.7.0).
- Enhanced is_photo_already_uploaded function (V2.7.0).
Version 2.7.0 Tag pics with their album (similar to checksum)
Fixes/Features
- Include Album as a PIC tag. to facilitate finding failed load pics (feature #29).
- From v2.7.0 onwards, uploadr adds to Flickr an album tag to each pic. uploadr v2.7.0 will automatically update the previously loaded pics with such album tag, upon first run.
- PLEASE NOTE FOR LARGE LIBRARIES THIS 1st RUN MAY TAKE A WHILE. IN MY CASE ABOUT 10min FOR EACH 1000 PICS OR SO...
- AFTER A FEW HOURS RUNNING I'm getting "flickrapi.exceptions.FlickrError: Error: 0: Sorry, the Flickr API service is not currently available." from FLICKR. I suppose caused by too many requests to the FLickr API. Simply restart until completion
- New option: --add-albums-migrate is only available to re-run it, should it be necessary and in case the autoamted process fails.
- Handle orphanated PICs previously loaded without a Set.
- Register on badfiles also files to large reported by Flickrt on upload (feature #37).
- Display current vs total number of files processed.
- Reduce file system scannig time by not checking a file in an excluded folder (feature #36. Thanks @malys).
- To confirm full resolution on: Revise try/except on upload around except error '040' (issue #28).
Questions & Answers
- Added several clarifications to Readme and Q&A section (issue #31 and #38. Thanks @ze6killer).
Output Messages
- Display current vs total number of files processed.
Environment and Coding
- Python 2.7 + 3.6 compatibility.
- Python 3.7-dev: Initial tests only.
- Created function getSetNameFromFile.
- Adapted nuceprint to print function name on new otional parameter.
- Enhanced is_photo_already_uploaded function.
Version 2.6.7 (faster runs after 1st execution)
Fixes/Features
- Optimize calling md5Cecksum which results in huge gains in runs after the 1st one.
- README updated with further clarifications explanation on file structure and loading/replace/delete logic and more FAQs
- flush on printing progress information when in paralell processing to ensure ordered output.
- Enhancement #33: New option -u --not-is-already-uploaded to disable checking if file is already actually loaded on flickr
Output Messages
- flush on printing progress information when in paralell processing to ensure ordered output of processed pics counter
Environment and Coding
- Python 2 + 3 compatibility
V2.6.6 Stable release fixes #26, #28, #31. Python 2 and 3 compatibility.
Fixes/Features
- Clarified use of Task Scheduler/crontab/SLEEP_TIME on instructions
- adjusted some remarks
- Solved #26
- Solved #31
- retry function:
- fixed: function retry... wrong use of variable "a" not set in some cases... like error 121
- adjusted messages wiht prefix "___"
- logging.error on error ...instead of warning
uploadPhoto function fixes: - more focused try/exception
- 1st attempt at #28: Revise try/except on upload around except error '040'
- better message on uploaded
Output Messages
- Error messages and output messages adjustments
Environment and Coding
- Python 2 + 3 compatibility
- Python 3 testing scenarios
V2.6.5 Stability with more testing, Python 2 and 3 compatibility
Fixes/Features
- 2.6.4 plus fix for #26 logging level for error "190"
- Enhancement #24 Python 2.7 and 3.6 compatibility.
- Test EXCLUDED_FOLDER and -f option. Included one more pic and album for testing.
- Fixes on cachedtoken
- Removed unused perms variable
- Added one more SQL SELECT error control
Output Messages
- Corrected DB error messages and output messages adjustments
- Corrected and aligned the error codes.
Environment and Coding
- Python 2 + 3 compatibility
- Python 3 testing scenarios
- Fixed several comments
- RemoveIgnoredMedia function with unicode Python 2/3
- Further testing options. Added uploadr_excluded.ini file for testing. .travis.yml adjusted
Do not load duplicates, retry on error, fix output messages. Use of TravisCI for testing.
Do not load duplicates, retry on error, fix output messages. Use of TravisCI for testing.
Pre-release
Pre-release
Fixes/Features
- doctest isthisStringUnicode
- fixed wrong indent on replacePhoto
- check if exists compare unicode setname
- unicode character in pics and albums
- Avoid duplicated images in between loads (#15)
- retry on photosets.create
- retry on addPhoto
- corrected handling of return from addPhoto (via exception; via to be removed)
Output Messages
- corrected DB error messages and output messages adjustments
- Corrected and aligned the error codes.
- Added function StrOutisThisStringUnicode
- IGNORED_REGEX will work with unicode file names
- uploadr.ini examples for use of IGNORED_REGEX
- added mimetype video/3gp
Environment and Coding
- added use ot travisCI for continuous integration tests
- Heroku deployment plus Python 2+3 compatible exception handling
- included about 160 test images for upkloading into Flickr
- PEP8 adjustments
- handling null createResp
- Use of a wrapper function to repeat calls on flickr related functions: @Retry
- fix on Run identification
- edited function is_photo_already_uploaded
V2.5.11 More Stable. good for testing.
- fixed replacePhoto to use fileobj instead of filename to cater for unicode file names.
- should fix issue #14
- 1st step to address enhancement #15: debugging for duplicated photos (same checksum/md5, same title, same set name). Still does not fully prevent loading duplicates which namely occur due to errors. In princicple many loading errors are being avoided anyhow!
- created simplified function updatedVideoDat
- extended the use of reportError2 function (to be later renamed to reportError)
- protected more DB accesses with try/exception
- under testing.
- "-s" parameter to search for duplicates not operational yet
V2.5.10 Good for testing. (I've ran with 28K pics)
Fix for issue #5
Template uploadr.ini file was wrong. Please load up this new uploadr.ini and reconfigure. Sorry!