Files Are Uploaded Multiple Times by 'rclone sync'

[sourceturner]

After observing that "rclone sync" uploaded my files multiple times (and as a consequence needed ages to finish), I created the following minimal example to reproduce the issue:

The local folder "internxt-test" contains only one file named "testfile", with just a size of 12 bytes.

After enabling webdav, I ran rclone sync --no-update-dir-modtime --no-update-modtime ~/tmp/internxt-test/ internxt:internxt-test, which produced the following output:

2025/06/07 20:14:11 ERROR : testfile: Failed to copy: object not found
2025/06/07 20:14:11 ERROR : webdav root 'internxt-test': not deleting files as there were IO errors
2025/06/07 20:14:11 ERROR : webdav root 'internxt-test': not deleting directories as there were IO errors
2025/06/07 20:14:11 ERROR : Attempt 1/3 failed with 1 errors and: object not found
2025/06/07 20:14:13 ERROR : testfile: Failed to copy: object not found
2025/06/07 20:14:13 ERROR : webdav root 'internxt-test': not deleting files as there were IO errors
2025/06/07 20:14:13 ERROR : webdav root 'internxt-test': not deleting directories as there were IO errors
2025/06/07 20:14:13 ERROR : Attempt 2/3 failed with 1 errors and: object not found
2025/06/07 20:14:16 ERROR : testfile: Failed to copy: object not found
2025/06/07 20:14:16 ERROR : webdav root 'internxt-test': not deleting files as there were IO errors
2025/06/07 20:14:16 ERROR : webdav root 'internxt-test': not deleting directories as there were IO errors
2025/06/07 20:14:16 ERROR : Attempt 3/3 failed with 1 errors and: object not found
2025/06/07 20:14:16 NOTICE: Failed to sync: object not found

Afterwards, the web interface on https://drive.internxt.com showed me that the file was present in the folder (the folder had already been created previously). Additionally, the file had been added twice to the Trash.

The file ~/.internxt-cli/logs/internxt-webdav-combined.log contained the following log lines:

{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.203Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /internxt-test","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.203Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test/\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.384Z"}
{"level":"info","message":"[PROPFIND] Request received for folder at /internxt-test/","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.384Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /internxt-test/\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.701Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /internxt-test/","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.701Z"}
{"level":"info","message":"[MKCOL] ❌ Folder '/internxt-test/' already exists","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.879Z"}
{"level":"error","message":"[ERROR MIDDLEWARE] [MKCOL - /internxt-test/] Folder already exists","name":"MethodNotAllowed","service":"internxt-webdav","stack":"MethodNotAllowed: Folder already exists\n    at handle (/usr/lib/node_modules/@internxt/cli/dist/webdav/handlers/MKCOL.handler.js:32:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)","statusCode":405,"timestamp":"2025-06-07T18:14:10.879Z"}
{"level":"info","message":"WebDav request received\nMethod: PUT\nURL: /internxt-test/testfile\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"content-length\":\"12\",\"authorization\":\"Basic <deleted>\",\"content-type\":\"application/octet-stream\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"x-oc-mtime\":\"1749320026\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.881Z"}
{"level":"info","message":"[PUT] Request received for file at /internxt-test/testfile","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.881Z"}
{"level":"info","message":"[PUT] Uploading 'testfile' to '/internxt-test/'","service":"internxt-webdav","timestamp":"2025-06-07T18:14:10.881Z"}
{"level":"info","message":"[PUT] ✅ File uploaded to network","service":"internxt-webdav","timestamp":"2025-06-07T18:14:11.788Z"}
{"level":"info","message":"[PUT] ✅ File uploaded in 831ms to Internxt Drive","service":"internxt-webdav","timestamp":"2025-06-07T18:14:11.901Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test/testfile\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:11.903Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /internxt-test/testfile","service":"internxt-webdav","timestamp":"2025-06-07T18:14:11.903Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test/\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.003Z"}
{"level":"info","message":"[PROPFIND] Request received for folder at /internxt-test/","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.003Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /internxt-test/\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.528Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /internxt-test/","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.528Z"}
{"level":"info","message":"[MKCOL] ❌ Folder '/internxt-test/' already exists","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.703Z"}
{"level":"error","message":"[ERROR MIDDLEWARE] [MKCOL - /internxt-test/] Folder already exists","name":"MethodNotAllowed","service":"internxt-webdav","stack":"MethodNotAllowed: Folder already exists\n    at handle (/usr/lib/node_modules/@internxt/cli/dist/webdav/handlers/MKCOL.handler.js:32:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)","statusCode":405,"timestamp":"2025-06-07T18:14:12.704Z"}
{"level":"info","message":"WebDav request received\nMethod: PUT\nURL: /internxt-test/testfile\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"content-length\":\"12\",\"authorization\":\"Basic <deleted>\",\"content-type\":\"application/octet-stream\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"x-oc-mtime\":\"1749320026\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.707Z"}
{"level":"info","message":"[PUT] Request received for file at /internxt-test/testfile","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.707Z"}
{"level":"info","message":"[PUT] Uploading 'testfile' to '/internxt-test/'","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.707Z"}
{"level":"info","message":"[PUT] File 'testfile' already exists in '/internxt-test', trashing it...","service":"internxt-webdav","timestamp":"2025-06-07T18:14:12.893Z"}
{"level":"info","message":"[PUT] ✅ File uploaded to network","service":"internxt-webdav","timestamp":"2025-06-07T18:14:13.495Z"}
{"level":"info","message":"[PUT] ✅ File uploaded in 617ms to Internxt Drive","service":"internxt-webdav","timestamp":"2025-06-07T18:14:13.612Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test/testfile\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:13.613Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /internxt-test/testfile","service":"internxt-webdav","timestamp":"2025-06-07T18:14:13.613Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test/\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:13.716Z"}
{"level":"info","message":"[PROPFIND] Request received for folder at /internxt-test/","service":"internxt-webdav","timestamp":"2025-06-07T18:14:13.717Z"}
{"level":"info","message":"WebDav request received\nMethod: MKCOL\nURL: /internxt-test/\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.244Z"}
{"level":"info","message":"[MKCOL] Request received for folder at /internxt-test/","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.244Z"}
{"level":"info","message":"[MKCOL] ❌ Folder '/internxt-test/' already exists","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.413Z"}
{"level":"error","message":"[ERROR MIDDLEWARE] [MKCOL - /internxt-test/] Folder already exists","name":"MethodNotAllowed","service":"internxt-webdav","stack":"MethodNotAllowed: Folder already exists\n    at handle (/usr/lib/node_modules/@internxt/cli/dist/webdav/handlers/MKCOL.handler.js:32:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)","statusCode":405,"timestamp":"2025-06-07T18:14:14.413Z"}
{"level":"info","message":"WebDav request received\nMethod: PUT\nURL: /internxt-test/testfile\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"content-length\":\"12\",\"authorization\":\"Basic <deleted>\",\"content-type\":\"application/octet-stream\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"x-oc-mtime\":\"1749320026\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.414Z"}
{"level":"info","message":"[PUT] Request received for file at /internxt-test/testfile","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.415Z"}
{"level":"info","message":"[PUT] Uploading 'testfile' to '/internxt-test/'","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.415Z"}
{"level":"info","message":"[PUT] File 'testfile' already exists in '/internxt-test', trashing it...","service":"internxt-webdav","timestamp":"2025-06-07T18:14:14.594Z"}
{"level":"info","message":"[PUT] ✅ File uploaded to network","service":"internxt-webdav","timestamp":"2025-06-07T18:14:16.367Z"}
{"level":"info","message":"[PUT] ✅ File uploaded in 1778ms to Internxt Drive","service":"internxt-webdav","timestamp":"2025-06-07T18:14:16.475Z"}
{"level":"info","message":"WebDav request received\nMethod: PROPFIND\nURL: /internxt-test/testfile\nBody: undefined\nHeaders: {\"host\":\"webdav.local.internxt.com:3005\",\"user-agent\":\"rclone/v1.69.3\",\"authorization\":\"Basic <deleted>\",\"depth\":\"1\",\"referer\":\"https://webdav.local.internxt.com:3005/\",\"accept-encoding\":\"gzip\"}","service":"internxt-webdav","timestamp":"2025-06-07T18:14:16.478Z"}
{"level":"info","message":"[PROPFIND] Request received for file at /internxt-test/testfile","service":"internxt-webdav","timestamp":"2025-06-07T18:14:16.478Z"}

This makes using rclone/webdav extremely cumbersome, because a sync of the folder that I usually want to backup (a folder of ~ 240 GB) needed more than 4 days (!) the last time that I tried, and the Trash was full of duplicate files afterwards.

Please fix this very soon!

[horstthorsten]

I can confirm the issue, even after installing CLI 1.5.4. Much appreciated if you fix this soon! Thanks.

[MyUncleSam]

I can confirm this too. rclone sync seems to be not working with the current version as sync is allowed to delete data too. So it uploads a file, gets an error and deletes the file (even if the file was transfered correctly).

Of course you could use rclone copy which is not allowed to delete files, but it behaves different and would get the same error (so you are never sure if the file transfer worked fine).

[larryrider]

Hey @sourceturner, @horstthorsten, @MyUncleSam !

I've seen there's an --ignore-existing parameter for rclone sync (docs here) that skips files if they already exist in the destination. Have you tried it?

[sourceturner]

Hey @larryrider, sorry for the late reply, I was away on vacation,

well, --ignore-existing has the obvious disadvantage that it would not update changed files, but for the sake of finding out more I will give it a try and report my findings.

[JuanmaCano]

same problem here, 1 day for sync 47 Gb ???

currently, uploading at 10 Kib/s ... 1.124 GiB / 1.162 GiB, 97%, 10.650 KiB/s, ETA 1h2m27s (xfr#0/163)

I have the feeling that webdav backend has a bottleneck

[sourceturner]

I am sorry for the late reply.

Using rclone sync --no-update-dir-modtime --no-update-modtime ~/tmp/internxt-test/ internxt:internxt-test no additional copies of the file were added to the trash. But as already said, this has the considerable disadvantage that any files that have been changed will not be backed up any more.

[kaveh-ahmadian]

I am having the same issue with Internxt CLI 1.6.0 and have tried both installing it via Nix packages and running it via the Docker container.

@larryrider is there any fix planned for this? My suspicion is that rclone is failing on listing the existing file even when it is there. I tried -vv option, but am not seeing anything useful in the debug output that indicates what is going on.

[kaveh-ahmadian]

I have some more info. As I suspected, the issue seems to be that the ls commands of rclone are timing out. In my case I tried lsl on a file I know to exist.

If these commands fails, then I think that is why rclone doesn't think the files are there and it uploads them again. For example, I let rclone run for multiple days (it shouldn't take that long to transfer the files I'm trying to, but I think the timeouts contribute to it). It completed the transfers and then just sat a while doing nothing but not exiting either. I came back and saw it was re-transferring everything all over again. The amount of data and files transferred is greater than the actual files and sizes.

I've seen this behavior twice now. My guess is that there is some final check that rclone does at the end that might also rely on an ls command, and when that fails, it restarts all the transfers. This behavior is in addition to rclone simply re-transferring files that are already there when running a fresh instance of the rclone sync command on a particular folder that already has (all of?) the files.

It might be a scale issue as well. The folder I'm trying to sync is almost 23,000 files and 138 GB. @larryrider are you able to test at this scale? I have even seen the web and mobile UI struggle with listing this many files in the folder too.

These commands were executed with the Docker container image running with podman (despite being in a nix shell) and the file path/name has been altered for privacy:

(nix:nix-shell-env) bash-5.3$ rclone lsl "internxt:/path/to/existing.file" --no-check-certificate --tpslimit 10 -vv
2026/01/06 07:42:41 INFO  : Starting transaction limiter: max 10 transactions/s with burst 1
2026/01/06 07:42:41 DEBUG : rclone: Version "v1.72.0" starting with parameters ["rclone" "lsl" "internxt:/path/to/existing.file" "--no-check-certificate" "--tpslimit" "10" "-vv"]
2026/01/06 07:42:41 DEBUG : Creating backend with remote "internxt:/path/to/existing.file"
2026/01/06 07:42:41 DEBUG : Using config file from "/Users/kaveh/.config/rclone/rclone.conf"
2026/01/06 07:42:41 DEBUG : found headers: 
2026/01/06 07:42:54 DEBUG : fs cache: renaming child cache item "internxt:/path/to/existing.file" to be canonical for parent "internxt:path/to"
2026/01/06 07:47:54 DEBUG : pacer: low level retry 1/10 (error Propfind "https://127.0.0.1:3005/path/to/": net/http: timeout awaiting response headers)
2026/01/06 07:47:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/01/06 07:52:54 DEBUG : pacer: low level retry 2/10 (error Propfind "https://127.0.0.1:3005/path/to/": net/http: timeout awaiting response headers)
2026/01/06 07:52:54 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/01/06 07:57:04 DEBUG : pacer: low level retry 3/10 (error 500 Internal Server Error)
2026/01/06 07:57:04 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/01/06 08:02:04 DEBUG : pacer: low level retry 4/10 (error Propfind "https://127.0.0.1:3005/path/to/": net/http: timeout awaiting response headers)
2026/01/06 08:02:04 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/01/06 08:07:04 DEBUG : pacer: low level retry 5/10 (error Propfind "https://127.0.0.1:3005/path/to/": net/http: timeout awaiting response headers)
2026/01/06 08:07:04 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/01/06 08:10:46 DEBUG : pacer: low level retry 6/10 (error 500 Internal Server Error)
2026/01/06 08:10:46 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/01/06 08:14:02 DEBUG : pacer: low level retry 7/10 (error 500 Internal Server Error)
2026/01/06 08:14:02 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
^C

I stopped it rather than waiting for all the retries. Note the last couple of errors were of type 500. I tried restarting the container and trying again, but it didn't help.

I was getting the same behavior when running with the nix version of the CLI locally. It is easier with the local CLI to check the WebDAV server error logs, and when I do, I get a lot of errors that look like this (note the same path, albeit once again altered for privacy here, as above):

{"level":"error","message":"[ERROR MIDDLEWARE] [PROPFIND - /path/to/] \"\"\nStack: Error: \"\"\n    at new AppError (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/sdk/dist/shared/types/errors.js:21:28)\n    at HttpClient.normalizeError (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/sdk/dist/shared/http/client.js:190:15)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async Axios.request (/Users/kaveh/Projects/drive_sync/node_modules/axios/dist/node/axios.cjs:4726:14)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:36:27)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at Axios.request (/Users/kaveh/Projects/drive_sync/node_modules/axios/dist/node/axios.cjs:4731:41)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:36:27)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)\n    at async DriveFolderService.getAllSubfiles (/Users/kaveh/Projects/drive_sync/node_modules/@internxt/cli/dist/services/drive/drive-folder.service.js:38:33)","service":"internxt-webdav","timestamp":"2026-01-06T14:14:02.326Z"}

Finally, the behavior seems inconsistent. At times the variants of rclone's ls command do succeed, albeit after significant delay and with folders that have a lot less files), but other times it will fail with nonsensical errors like "directory not found" when it is there and subsequent attempts don't produce the same error.

This has become somewhat of a show stopper for me as I'm not aware of any other way to reliably sync my external drive to Internxt without using my internal drive as a intermediary (which I cannot because it is much smaller) as I would need to using the desktop drive mounting app. I'm also worried that the number of files is too much for web UI transfer (this is just one folder, I have lots more, so my scale is very large). Please advise.

[kaveh-ahmadian]

@larryrider any update on this? I'm starting to wonder if it is related to issue #133 as well

[larryrider]

@larryrider any update on this? I'm starting to wonder if it is related to issue #133

Hey!!
Could you confirm if this still happens with the latest version of the Internxt CLI (v1.6.2)? We have made a number of improvements over the past versions, so it would be great to know if the behavior persists there.

Also, since your original tests, we have added native integration with rclone, which should work much better and faster than using WebDAV. I would strongly recommend trying that

You can find the setup instructions here:
https://rclone.org/internxt/

This integration avoids the WebDAV layer entirely and communicates directly through the supported backend, which significantly improves reliability and performance, especially for large directories like the one you described

[kaveh-ahmadian]

Hi @larryrider thank you for the reply!

I tried with version 1.6.3 of the CLI, with and without the --size-only flag and I don't think it made a difference (I tried a test folder with only 2 files and that worked correctly, but my folder with over 35k files is still exhibiting the same behavior). It also throws Object not found errors like it was before (again with the large folder containing many files).

I tried the latest version of rclone with the native Internxt integration and the performance is night and day (in a good way). However, after letting it complete transfers (at this point I was already suspicious since I have transferred the same folder probably 5 times now), I ran the same command again and it started uploading copies again. I stopped that command and am currently running it with the --size-only flag, but that also seems to just be transferring everything again. I'm going to let it finish and see what happens (will take hours and maybe over a day, but will try to post an update here).

My issue is with this many files in a single folder, I can't really validate the number and size to see if they match the source (external SSD). I tried running the rclone size command on the remote path, but I get this error (again using the native rclone integration from now on):

2026/03/14 16:55:51 ERROR : error listing: failed to list all files at offset 50: list files: Service Unavailable (status 503)
2026/03/14 16:55:51 NOTICE: Failed to size with 2 errors: last error was: failed to list all files at offset 50: list files: Service Unavailable (status 503)

When I try to get folder details via the Internxt web UI, it shows me 1000 files, which I know is incorrect, so there may be cap in how that is calculated (just scrolling I can see more than 1000 files in the folder).

The other issue with the native rclone integration is that it seems to mess with the terminal output when using the --progress flag and I believe these are due to DEBUG messages that are getting sent back. They flash on my screen so it was hard to capture them, but I did get one:

[DEBUG] Uploading thumbnail for file 484434d0-7b65-415f-af2e-70aa35ee1850

I'm willing to have a working session to walk through the behavior I'm seeing if that would help. I'm very invested in this and would like to help. Currently, this is really effecting my ability to use the service as I planned and I've paid a considerable amount for 2 separate accounts. Please let me know.

[cheikemate]

I am having this behavior again with version 1.6.3. Everything that was already in sync is again being "re-uploaded" at around 130/150Kb/s. It will take ages :-( .
Looks like files are again being sent to trash.
I am also available to troubleshoot the issue. @larryrider just ask what you need.

{"level":"info","message":"[PUT] File '2013-08-26-14-49-37-202.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:07:35.973Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-50-03-801.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:07:47.529Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-50-35-202.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:08:18.087Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-51-06-429.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:08:40.266Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-51-26-234.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:08:43.844Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-52-06-747.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:08:57.620Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-52-36-551.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:09:26.711Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-53-02-507.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:09:50.758Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-54-01-752.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:09:54.653Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-53-30-395.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:09:57.928Z"}
{"level":"info","message":"[PUT] File '2013-08-26-14-54-30-556.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:10:40.623Z"}
{"level":"info","message":"[PUT] File '2013-09-03-23-03-58-998.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:10:57.988Z"}
{"level":"info","message":"[PUT] File '2013-09-03-23-04-20-135.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:10:59.723Z"}
{"level":"info","message":"[PUT] File '2013-09-03-23-50-46-925.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:11:07.044Z"}
{"level":"info","message":"[PUT] File '2013-09-07-20-24-42-710.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:11:53.931Z"}
{"level":"info","message":"[DELETE] [85e5be52-a753-4200-a11c-90a6ab42e616] Trashing file","service":"internxt-webdav","timestamp":"2026-03-15T11:12:05.926Z"}
{"level":"info","message":"[PUT] File '2013-09-07-20-25-24-113.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:12:06.209Z"}
{"level":"info","message":"[DELETE] [c183ba1d-9759-45c0-880e-b5b34a6e5124] Trashing file","service":"internxt-webdav","timestamp":"2026-03-15T11:12:33.183Z"}
{"level":"info","message":"[PUT] File '2013-09-07-20-26-24-817.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:13:03.868Z"}
{"level":"info","message":"[PUT] File '2013-09-14-19-07-42-898.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:13:10.124Z"}
{"level":"info","message":"[PUT] File '2013-09-14-19-10-38-987.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:15:58.683Z"}
{"level":"info","message":"[PUT] File '2013-09-14-19-10-54-145.jpg' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:16:19.750Z"}
{"level":"info","message":"[PUT] File '20130922_113825.JPG' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:16:42.736Z"}
{"level":"info","message":"[PUT] File '20130922_113849.JPG' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:17:03.860Z"}
{"level":"info","message":"[PUT] File '20130929_134330.JPG' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:17:27.468Z"}
{"level":"info","message":"[PUT] File '20131006_115211.JPG' already exists in '/TrueNAS Sync/PhonePhotoCollection/Paulo/Familia', trashing it...","service":"internxt-webdav","timestamp":"2026-03-15T11:17:48.583Z"}

[kaveh-ahmadian]

I ended up stopping the transfer after an overnight. I was just copying everything again. I tried running it with --ignore-existing and even that doesn't work (this time it showed 0 checks, which seems odd). I cannot get rclone (with either webdav using the cli or the native integration) to not just copy everything all over again. This is really becoming a deal breaker for me. How is anyone getting this working??