Quantcast
Channel: Syncthing Community Forum - Latest topics
Viewing all articles
Browse latest Browse all 6194

Sync not completing, out of sync/scanning rapidly

$
0
0

Server: Arch Linux, syncthing 1.7.0 Laptop: Mac-OS 10.15.6, syncthing-macos 1.7.0-1

Server has global state of 9,779 files, 1,896 folders, ~21.9GiB. Being logged into the html gui it’s rapidly flashing between Scanning, Waiting to Update, Scanning, Up to Date, and back 10s of times a second. The Rescan button is flickering dark/light grey constantly.

Other syncs with other machines appears to be fine.

Laptop is showing same global state, and a local state of: 9,553 files, 1,896 folders, 21.2 GiB. Out of sync: 226 items, ~751MiB

Failed items appears to be a rapidly incrementing number which keeps dropping back to (near) zero and then looping around again.

If I turn on all the logs, then pick a file that is failing:

% grep DSCF2013 serverlog
2020-08-08 18:05:03 Walk [Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG] Matcher/[]@0xc007bf66c0
2020-08-08 18:05:03 rescan: File{Name:"Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG", Sequence:69443, Permissions:0755, ModTime:2011-12-26 11:04:38 +0000 GMT, Version:{[{D75YGLZ 1596863605} {ER2BSBG 1596906303}]}, Length:0, Deleted:false, Invalid:false, LocalFlags:0x4, NoPermissions:false, BlockSize:131072, Blocks:[]} 1324897478 -rwxr-xr-x
2020-08-08 18:05:03 to hash: Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG File{Name:"Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG", Sequence:0, Permissions:0755, ModTime:2011-12-26 11:04:38 +0000 GMT, Version:{[{D75YGLZ 1596863605} {ER2BSBG 1596906303}]}, Length:3105969, Deleted:false, Invalid:false, LocalFlags:0x0, NoPermissions:false, BlockSize:131072, Blocks:[]}
2020-08-08 18:05:03 real to hash: Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:05:03 Walk progress done bpnqy-r3f6j [Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG] Matcher/[]@0xc007bf66c0

On the laptop I’m seeing:

% grep DSCF2013 laptop
2020-08-08 18:38:58 sendreceive/bpnqy-r3f6j@0xc0000f8380 need file Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG; copy 24, reused 0
2020-08-08 18:38:58 log 29197 ItemStarted map[action:update folder:bpnqy-r3f6j item:Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG type:file]
2020-08-08 18:38:58 progress emitter: registering bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 1
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 2
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): ER2BSBG-OMQCEPB-MKFTTAC-<SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=131072 s=131072 h=1f936ae02a26bf957ddb88d67a8de3746209a2a718116b1c7b2d3770fada258c wh=22ace515 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=0 s=131072 h=5d88b21607573aab4d9eb7adc87171b25d4aa46652bf9ac8a21717383a425bd4 wh=7cd48711 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 3
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 4
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=393216 s=131072 h=c571a1babda3b7b7fa3aecb3dbec51b7670a91d4f7b9579402cbf3257318f627 wh=62b1fe6e ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=262144 s=131072 h=efa1fe011d5c07d847e10ce4ab7f451590788a59f25d292ca23ffd7999e1864e wh=a174b6c4 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 5
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 6
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=655360 s=131072 h=eaa49a2bd30fd8e9904233285e9404d896c2cfe3524096daae4a525f44b687f3 wh=20b1cf99 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=524288 s=131072 h=9cefd50a2d03da945ef0d55cf540d4279b8dc05a0a7a92a98579b090fdc7bd34 wh=6ce2b624 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 7
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 8
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=917504 s=131072 h=300b168e6710c473b1288a65b38af72a10cc977987fffdb6f99261802d4fe916 wh=312c6e36 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=786432 s=131072 h=2c5f537bf63364d32051e44a639eb7fe2246b72c817755eb8f19dc81a045f6ba wh=8203ea9d ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 9
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 10
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2228224 s=131072 h=afa61de1302947f57a5453b635a639b536f8105268561c31e52c9076ed5791c8 wh=e34ce58 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2097152 s=131072 h=9f6a802c226d25b5b32b7a0a600ab1b0e9b7d8298cac6ddb8ea6fd198207d7b2 wh=50b52a4b ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 11
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 12
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2490368 s=131072 h=c30190d72309e16648c277091dd654ad3bf8138d408a6f639e9366adbaa45cfe wh=2da6bb1f ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2359296 s=131072 h=63099ed8ecac477af210f6c59f5608b80794fe7062dfc05e03bd53107ebf68d4 wh=6f6e028b ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 13
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 14
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2752512 s=131072 h=32069909d86696cf8779003d8ef90760211c4ef7458b8bc6a21a7d5dcce47036 wh=59a57366 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2621440 s=131072 h=56d4d6cd22eb864921d07efdf38e9aa03d9d09a48e867c961e28ac4416c51d02 wh=f19d2d62 ft=false
2020-08-08 18:38:58 basic /Users/samantha/restore Watch: Ignoring Documents/dropbackup/more pictures from lindas camera/.syncthing.DSCF2013.JPG.tmp
2020-08-08 18:38:58 basic /Users/samantha/restore Watch: Ignoring Documents/dropbackup/more pictures from lindas camera/.syncthing.DSCF2013.JPG.tmp
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 15
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 16
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=3014656 s=91313 h=6cdf4a8d9b005965ad4ac8ac2cab126d393993c17f1e742a224d275bad3867fd wh=c87fa88 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2883584 s=131072 h=5a0cfda0b0372090d3ada04d65d382305b54d54cd9588c7f9270403afdc1a7ef wh=50632f84 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 17
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 18
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1179648 s=131072 h=137b5239181333631bdb32be6d4abd1f15c4fbbe97715d9f760bf1b828f498cb wh=1d692408 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 19
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 20
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 21
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 22
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1441792 s=131072 h=8b2da9476e45c1141e31f74f8a1f2f79c6ac003d293210c15fe94fd350c98322 wh=d23635eb ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1310720 s=131072 h=8501ccbb8597b20b0a5bc2ca9b6b2db9d29afafd6bdf1e8e842b59123dc13f94 wh=34015b54 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 23
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1703936 s=131072 h=87a6f36e4bbd22048a5aa245aea332263f2e5eefe9ccb4f24c113dd2d3ae1aaf wh=5e4d234a ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 24
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1966080 s=131072 h=9a6e65a67e201b580f256a9a8909dda01609ef793e9faad92eea50b35e159763 wh=4ac11854 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1048576 s=131072 h=44126567c316f4680237b16eff60134a38c6927d34c553fbf06245137ded4e82 wh=6f8260cc ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1572864 s=131072 h=68e824caccb931c59faabd3f9037e5868591e4d67abf6dcf1b4924b692562fed wh=3f407d8a ft=false
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 524288 131072 returned error: no such file
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1835008 s=131072 h=5f734ea725c6553e5cdcc74dee2d8b308db3a2b61de5f9b14bbb9b01129c8fa0 wh=bdff4eff ft=false
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 655360 131072 returned error: no such file
2020-08-08 18:38:58 sendreceive/bpnqy-r3f6j@0xc0000f8380 closing Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:38:58 Repeat error on puller (folder "Samantha-laptop-backup" (bpnqy-r3f6j), item "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG"): pull: no such file
2020-08-08 18:38:58 progress emitter: deregistering bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 0 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 786432 131072 returned error: no such file
2020-08-08 18:38:58 log 29200 ItemFinished map[action:update error:0xc00091a2b0 folder:bpnqy-r3f6j item:Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG type:file]
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2228224 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 131072 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 262144 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 917504 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2097152 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 393216 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2490368 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2359296 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2621440 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2752512 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2883584 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 3014656 91313 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1703936 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1441792 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1310720 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1966080 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1179648 131072 returned error: no such file
samantha@Samanthas-Air ~ % 

I haven’t tried hard to get an exact timestamp comparison of each side because both are spamming lots of logs with the same content.

If, on the server, I sudo over to the syncthing user I can sha1sum the file without issue so it’s not a permissions problem.

[syncthing@server Samantha-laptop-backup]$ whoami
syncthing
[syncthing@server Samantha-laptop-backup]$ sha1sum Documents/dropbackup/more\ pictures\ from\ lindas\ camera/DSCF2013.JPG 
44a1eac72c1a14f4c7210a565bd019ad4751b789 Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG

Any suggestions on how to diagnose what is happening?

1 post - 1 participant

Read full topic


Viewing all articles
Browse latest Browse all 6194

Trending Articles