{"id":1668,"date":"2016-12-15T17:03:16","date_gmt":"2016-12-15T16:03:16","guid":{"rendered":"http:\/\/eskerahn.dk\/?p=1668"},"modified":"2024-03-05T01:51:58","modified_gmt":"2024-03-05T00:51:58","slug":"get-newchanged-files-from-wpd-device-e-g-android-enhanced-version-of-christopher-geers-portabledevices","status":"publish","type":"post","link":"https:\/\/eskerahn.dk\/?p=1668","title":{"rendered":"Get new\/changed files from WPD-device, e.g. Android. Enhanced version of Christophe Geers’ PortableDevices"},"content":{"rendered":"

I stumbled upon this nice project<\/a> by Christophe Geers.<\/p>\n

And edited and enhanced it to a tool that works a bit like an advanced REPLACE \/UPDATE\u00a0 to a tree on the PC based on the name of the device and the drives it exposes.<\/p>\n

It is an efficient way to get changed & new files from a device to a PC.<\/p>\n

Update: <\/strong>Now supports Exclude<\/strong> also.<\/p>\n

It works with a WPD connected device, e.g. an Android device USB-connected in MTP or PTP mode.<\/p>\n

Here an example of some of the tree generated<\/p>\n

\"\"<\/a><\/p>\n

Most backup tools does NOT allow you to do an incremental<\/span> backup, but they DO allow you to deselect e.g. images. So use this tool to do the incremental backup of the huge WPD-exposed stuff like the images\/videos\/music<\/span>, and let your backup tool do backups of all the rest – and in more finite time than a total backup of everything every time – thus making it a bliss to take backups much more often….
\n<\/strong><\/p>\n

<\/p>\n

The above picture is from my BB Priv on 6.0.1<\/p>\n

It also works on my Ancient Xperia Pro on ICS 4.0.1 (!) when connecting in MTP mode (*) , and a Samsung S8- on Oreo 8.0.0. Also tested working on the same S8- on 9.0 Pie, and the FxTec Pro1<\/a> on 9.0 Pie.<\/p>\n

The actions on existing files can be handled by command line flags, by default, files on pc are overwritten if they are not the same size and date.<\/p>\n

IF the device is rooted (my Priv isn’t) it also tries to modify time-stamps on images on the device to the DateTaken stamp.
\nThis should help if you have copied files from a previous device (or from an old copy if the device has been reset)<\/p>\n

(If you copy files from a PC to a WPD device with the explorer the files get the stamp of the time they are copied NOT the stamp of the source files, making a total mess of e.g. image-history, This is a known issue using e.g. Android !!!)<\/p>\n

It is NOT a complete backup that is provided, since not all content is exposed through the WPD interface. E.g. your SMS and MMS messages and most apps data are NOT included.<\/p>\n

It is the same content you can find in a windows EXPLORER.<\/p>\n

But as you can not mount this as a drive letter, you can not make a simple REPLACE \/U, thus the need for something like this open source tool…., unless you want to copy everything, and manually handle conflicts for different&equal files…<\/p>\n

It should be said that it is quite a task to find code that uses WPD that is not just displaying principles, but actually works(!). So again: Kudos to Christophe Geers<\/strong> his code only has a few very minor issues that needed to be corrected (it might well be that it would work flawlessly on 2011 devices).<\/p>\n

I have changed the principal behaviour from collecting the full tree initially, to handling each item as encountered through a call back – the original behaviour is stll in the code through an alternative call back.<\/p>\n

(2017-02-02) I found a strange bug on WPD sometimes reporting wrong file-sizes<\/a>, and updated the program to handle\/recognise this. Unfortunately there are no good workaround, so currently it will do a binary compare of files with same date, but reported different sizes. And if the size is the only difference, it is output in a new output group (moving up 5&6 to 6&7 sorry)<\/p>\n

 <\/p>\n

Due to the CallBack it would thus be quite easy to change this tool<\/span> to something that does something else with the information collected.<\/p>\n

 <\/p>\n

The C# source and project-files can be found here (Newest: v12, 2019-01-27)
\n<\/strong><\/p>\n

PortableDevicesIncrementalCopy_V13<\/a><\/p>\n

and executable, including Interop dll’s<\/p>\n

PortableDevicesIncrementalCopy_EXE<\/a><\/p>\n

Please note that due to a(nother) bug in the Interop DLL generated, it MUST be compiled as x86 (Compiled in x64 or AnyCPU it works, but throws an exception on program-termination)<\/p>\n

 <\/p>\n

Please fell free to add any suggestions for additional or modified functionality in the comments below.<\/strong><\/span><\/p>\n

(No guarantee that it will be implemented though, if you want to fiddle with the code and need some info, also just ask)<\/p>\n

 <\/p>\n

USAGE<\/strong><\/span><\/p>\n

Call the program with ?<\/strong> for help on possible parameters.<\/p>\n

It currently defaults to copy to “c:\\MTP_DEVICES\\<\/strong>” (overridable by command line parameter) under which a directory for each connected device is created..<\/p>\n

PortableDevicesIncrementalCopy\u00a0 see https:\/\/eskerahn.dk\/?p=1668\r\nPortableDevicesIncrementalCopy [DestFolderRoot] [NoLog] [IncludeFolderOutput]\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 [AlwaysCopy|IgnoreSize|IgnoreStamp|OverruleStamp] [ResLevelMax=n] [\/?]\r\n       [Excl {\\ | }]\r\n\u00a0\u00a0 DestFolderRoot, Default C:\\MTP_Devices\\\r\n\u00a0\u00a0 NoLog, Default a log file is created apart from the console output\r\n\u00a0\u00a0 IncludeFolderOutput : if set include lines with folder names\r\n\u00a0\u00a0 ResLevelMax= : defines the amount of output. Default=5\r\n\u00a0\u00a0\u00a0\u00a0 0 or higher: include (Copied)\r\n\u00a0\u00a0\u00a0\u00a0 1 or higher: include (Skip exists)\r\n\u00a0\u00a0\u00a0\u00a0 2 or higher: include (Skip exists sam siz)\r\n\u00a0\u00a0\u00a0\u00a0 3 or higher: include (Cmp: bin equ)\r\n\u00a0\u00a0\u00a0\u00a0 4 or higher: include (Cmp: bin equ older on device)\r\n\u00a0\u00a0\u00a0\u00a0 5 or higher: include (Wrong size reported by WPD, bin equ)\r\n\u00a0\u00a0\u00a0\u00a0 6 or higher: include (Skip exists sam siz & dat)\r\n\u00a0\u00a0 PauseAtEnd : Yes you guessed it....\r\n\u00a0The next flags are mutually exclusive, checked in this order (default NONE)\r\n\u00a0\u00a0 AlwaysCopy : Always copy\r\n\u00a0\u00a0 IgnoreSize : Skip if file exist, ignore size\r\n\u00a0\u00a0 IgnoreStamp : Skip if same size, ignore stamp\r\n\u00a0\u00a0 OverruleStamp : Binary compare even if size and stamps matches\r\n Excl the rest is seen as exclude masks list, e.g. *cache*\\ *.tmp<\/pre>\n
 <\/p>\n
NOTE: Known bug in .NET<\/strong><\/del>
\n Multiple connected devices does not work due to .NET bug:<\/del>
\n Unfortunately .NET incorrectly requires WPD GetDevices to be called with a STRING and not an ARRAY of strings.<\/del>
\n There is an old 2006(?) workaround described several places including here<\/a> , I can not get it to work (any more) though ;(<\/del><\/p>\n
So only one device can be handled at a time.<\/del><\/p>\n
Update 2018-03-06.<\/strong> I FINALLY got the trick described to work. What I precisely did is described in FULL detail in a comment in PortableDeviceCollection.cs
\nNote that you may need to manually replace the wrong version of\u00a0 Interop.PortableDeviceApiLib.dll with the corrected one multiple times, also in bin and obj…<\/p>\n
Note<\/strong> that I explicitly ignores portable devices that got a drive-letter attached, as there are SO many other ways to keep them synced. e.g. RoboCopy. So if you got a phone and a standard usb-key attached, only the phone is accessed.<\/p>\n
 <\/p>\n
Update 2019-01-27.<\/strong> Added the option to EXCLUDE<\/strong> files or folders, especially to exclude CACHE folders. Note the it only work on a general level, so you can not (currently) skip a specific mask one place and include it in another. That is –Excl Myfolder\\*cache*<\/em> would not work as you would expect, but would skip nothing….<\/p>\n
 <\/p>\n
(*) Note on ICS<\/strong>. I experienced a WPD-lock-up after copying a lot of items. Restart of the program got stuck on the exact same item inside some deep cache folder, and only continued after a long time with an exception, hanging on the next files too… BUT it was the WPD also outside the program that got sick (could not access that file through windows explorer either). After unplugging the cable, restarting the Xperia Pro and reinserting the cable, a rerun fetched the rest… (a cable unplug and re-plug was not enough)<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"
I stumbled upon this nice project by Christophe Geers. And edited and enhanced it to a tool that works a bit like an advanced REPLACE \/UPDATE\u00a0 to a tree on the PC based on the name of the device and the drives it exposes. It is an efficient way to get changed & new files […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7,6],"tags":[],"class_list":["post-1668","post","type-post","status-publish","format-standard","hentry","category-compact-cameras","category-phonesphablets"],"_links":{"self":[{"href":"https:\/\/eskerahn.dk\/index.php?rest_route=\/wp\/v2\/posts\/1668","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eskerahn.dk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eskerahn.dk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eskerahn.dk\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/eskerahn.dk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1668"}],"version-history":[{"count":12,"href":"https:\/\/eskerahn.dk\/index.php?rest_route=\/wp\/v2\/posts\/1668\/revisions"}],"predecessor-version":[{"id":3983,"href":"https:\/\/eskerahn.dk\/index.php?rest_route=\/wp\/v2\/posts\/1668\/revisions\/3983"}],"wp:attachment":[{"href":"https:\/\/eskerahn.dk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1668"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eskerahn.dk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1668"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eskerahn.dk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1668"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}