userdocs / lftp4win Goto Github PK

If i delete the file in my seedbox, it wont delete the Local file even though the remote file is not there

I recently updated to the newest build. Since then parallel and segmented downloads are no longer working. When using pget-to-local the terminal screen shows the following:

It appears that it only uses one connection now.

Create lftpsync task.bat

Is it possible to specify a different time from the default 20:00 hrs as per script? I would like to set a different time from this.

I get this error and bash just immediately closes. I cannot figure out why.,

Assertion "stack_ptr>0" failed: file "/home/ASchulma/dev/cygwin/lftp/lftp-4.7.8-2.x86_64/src/lftp-4.7.8/src/SMTask.cc", line 161, function: static void SMTask::Leave(SMTask*)

Winscp crashes after a while during transfer. This happened twice in the last two hours. The Conemu window disappears, but the Conemu process keeps downloading.

When I select multiple files and attempt mirror to local sometimes I get only one file that downloads at a time and other times I will get multiple files. What am I missing? I have it set to download parallel or multiple files simultaneously but It will only pull one at a time. I am not using any of the winscp download buttons. How can I troubleshoot?

I'm getting an error message that i'm missing mintty,exe and also when I click on lftp conf option in the menu bar nothing happens. notepad++ doesn't load as it says it should

did a fresh install of lftp4win and am getting a segmentation fault error whenever i try and download something with pget to local, also happened using built in updater which is why i tried the clean install to rule out it being an updater issue.

Hello, I am having trouble installing LFTP4WIN, I ran as administrator and cygwin seemed to install fine, but it gets here and fails: 'C:\Windows\system32>"D:\Programs\LFTP4WIN\system\bin\mkgroup.exe" -c 1>system/etc/group || goto :fail
The system cannot find the path specified.'

I guess it's trying to access or create a folder path and failing but I don't understand why. I've tried installing from a different drive, as well as manually creating the 'group' folder under system/etc/, which of course did not help. Any advice is much appreciated!

C:\Windows\system32>"D:\Programs\LFTP4WIN\system\tmp\setup-x86_64.exe" --no-admin  --site "https://cygwin.mirrors.hoobly.com"  --root "D:\Programs\LFTP4WIN\system"  --local-package-dir "D:\Programs\LFTP4WIN\system\.pkg-cache"  --no-shortcuts  --no-desktop  --delete-orphans  --upgrade-also  --no-replaceonreboot  --quiet-mode  --packages wget,ca-certificates,gnupg,bsdtar,bash-completion,curl,lftp,ssh-pageant,openssh,openssl,sshpass,procps-ng    || goto :fail
Starting cygwin install, version 2.915
User has backup/restore rights
User has symlink creation right
Current Directory: D:\Programs\LFTP4WIN\system\.pkg-cache
root: D:\Programs\LFTP4WIN\system system
Selected local directory: D:\Programs\LFTP4WIN\system\.pkg-cache
net: Preconfig
site: https://cygwin.mirrors.hoobly.com/
solving: 12 tasks, update: yes, use test packages: no
solving: 0 tasks, update: no, use test packages: no
Augmented Transaction List: is empty
Changing gid back to original
running: D:\Programs\LFTP4WIN\system\bin\dash.exe "/etc/postinstall/0p_000_autorebase.dash"
running: D:\Programs\LFTP4WIN\system\bin\dash.exe "/etc/postinstall/0p_update-info-dir.dash"
running: D:\Programs\LFTP4WIN\system\bin\dash.exe "/etc/postinstall/zp_man-db-update-index.dash"
Changing gid to Administrators
Ending cygwin install

C:\Windows\system32>if "yes" == "yes" (rd /s /q "D:\Programs\LFTP4WIN\system\.pkg-cache" )

C:\Windows\system32>(
echo # /etc/fstab
 echo # IMPORTANT: this files is recreated on each start by LFTP4WIN-terminal.cmd
 echo #
 echo #    This file is read once by the first process in a Cygwin process tree.
 echo #    To pick up changes, restart all Cygwin processes.  For a description
 echo #    see https://cygwin.com/cygwin-ug-net/using.html#mount-table
 echo #
 echo none /cygdrive cygdrive binary,noacl,posix=0,sparse,user 0 0
) 1>"D:\Programs\LFTP4WIN\system\etc\fstab"

C:\Windows\system32>"D:\Programs\LFTP4WIN\system\bin\mkgroup.exe" -c   1>system/etc/group  || goto :fail
The system cannot find the path specified.

C:\Windows\system32>if exist "" (del "" )

C:\Windows\system32>echo.


C:\Windows\system32>echo ###########################################################
###########################################################

C:\Windows\system32>echo # Installing [LFTP4WIN Portable] FAILED!
# Installing [LFTP4WIN Portable] FAILED!

C:\Windows\system32>echo ###########################################################
###########################################################

C:\Windows\system32>echo.


C:\Windows\system32>timeout /T 60

Waiting for 49 seconds, press a key to continue ...

Batch file fails right after "Installing [Cygwin Portable]", and it seems to happen @ line 114 with the bitsadmin download command for Cygwin. I have tried editing the config's customization options, manually starting the BITS service, browsed past issues here for any solutions related to this and I'm at a loss. I had a previous installation setup on the machine , which is running Windows 7 x64, that installed fine but folder was since deleted. Maybe a conflict with the previous install/leftovers?

Thanks for your time and all your work in bringing this project to life!

Is it possible to run multiple instances of lftp terminal to sync 2 different directories? If so, how?
I request you to dumb down the solution for me. I've tried having 2 copies of the lftp-windows project but they both run simultaneously but I want only one of them to initiate the download and other to wait till the first instance completes it's work.
Sorry if this is too obvious, I'm not really familiar with the terminal or lftp.
Thanks.

As of a few days ago, transfers of large files using pget result in a freeze of up to two minutes before the transfer starts again.
Setting 'set file:use-fallocate false' in lftp.conf appears to resolve the issue, but I can't remember pre-allocation ever taking this long previously and it's driving me crazy.

Thanks!

It is no longer possible to install the correct versions of openssh (7.9) and openssl (1.0.2) from cygwin setup. Oldest selectable openssh is 8.0p 1-2 and openssl is 1.1.1b-1.

Either using mirroring or pget the disk usage is constantly quite high with write speeds of around 70-80 MB/s which disrupts work performed on that particular drive and produces concerns in regards to SSD life. Additionally when i am initially downloading a file lftp seems to freeze but the console appears to respond. when this occurs there is no internet activity but the disk usage is still high likewise when it is downloading. to get it to download for some reason ctl + x at times seems to kick it to download otherwise i restart and hope for the best. I'm happy to provide additional information if it helps diagnosing the problem.

Hi!
The installer seems to choose a cygwin mirror (cygwin.mirror.uk.sargasso.net) which is unbearably slow. I am from the netherlands, so it's not distance or anything.
Would either a choice, like in the cygwin setup or just another, faster mirror be possible to implement?

EDIT: After looking more into it, I noticed that you created a variable which I could easily change. So thanks!

:: change the URL to the closest mirror https://cygwin.com/mirrors.html
set CYGWIN_MIRROR=https://ftp.fau.de/cygwin/

But maybe for other people who blindly run the script make a disclaimer in the "installing" section?

When I run the LFTP4WIN-installer.cmd file, the script stops early after only displaying the following

I am on Windows 11 home x64

If any other info is needed I will happily provide

Latest version of lftp-windows, OS windows 10. I get the following message when clicking pget or lftp options. Everything else works fine. I did have cygwin installed previously but uninstalled it. When I open conemu from the help folder and enter echo $path I get:
[ ~/scripts] echo $PATH
/usr/bin
[ ~/scripts]
The error message is:

I'm not sure what I did, but I can't seem to pull any files through lftp anymore. I am able to pull files with WinScp, just not through any of the LFTP commands. The last thing I remember doing was force closing several consoles because I accidentally tried to pull too many files. I'm still learning how to use lftp, so I haven't messed around with any automation. Everything is pretty much untouched except the server being added through the WinScp interface.

I've tried the same setting on my laptop and it works fine. It's just when I do it on my main computer I get the following error and the console closes immediately.
https://i.imgur.com/T8eBpeH.png

I've googled the following error "pget: access failed: failure" and can't seem to find anything on the subject either.

fork of the installer with fixed 32-bit support: https://github.com/glodomorrapl/LFTP4WIN-LEGACY

script no longer runs properly on x86 systems due to cygwin starting to drop x86 support:

• https://cygwin.com/pipermail/cygwin/2022-November/252542.html
• http://www.crouchingtigerhiddenfruitbat.org/Cygwin/timemachine.html

the current version of cygwin errors out on x86 systems by default. to get it going on 32-bit windows 7, cygwin mirror in line 47 needs to be set to http://ctm.crouchingtigerhiddenfruitbat.org/pub/cygwin/circa/2022/11/23/063457 and the --allow-unsupported-windows option parameter needs to be added to line 123.

the script also needs to be altered to fetch cygwin 3.3.6 (setup 2.924) on x86 systems, as that version is the last one that's going to support x86 with those extra parameters.

Hi, I am getting this issue with the latest release. It still works though. Just errors like this then starts downloading.

  0 [main] lftp 911 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 911 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 914 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 914 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  1 [main] lftp 921 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  1 [main] lftp 921 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 922 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 922 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 923 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)
  0 [main] lftp 923 child_info_fork::abort: \??\C:\Users\User\Desktop\lftp-test\lftp-windows-master\system\bin\cygz.dll: Loaded to different address: parent(0x170000) != child(0x1B0000)

`...UbuntuLinux.ISO', got 864616448 of 3622323816 (23%) 8.71M/s eta:6m
oo........ooo........ooo........ooo........oo.........oo........ooo........oo.........ooo........oo.........

Most issues posted here are regarding the skeleton template LFTP4WIN-CORE

If you have an issue with lftp, a custom command, a script or anything that is not related to the scripted installation, please use the other repo.

https://github.com/userdocs/LFTP4WIN-CORE

Noob question,
If I set filter masks in WinSCP>Preferences, it doesn't apply to the synchronization process. Is it because we're overriding the default settings with the settings in the script? How do I add file constraints to the synchronization?
For example, I want to only sync video files and ignore when a png,jpg or literally any other file is seen.
Sorry if this wasn't the right place to ask.
Thanks.

Hello,

I seem to be doing something wrong because I can't seem to get pget to work when using the mirror-to-local command. It opens the terminal and begins the download, but it only seems to be downloading one file with one pget request at a time. I have no issue when running pget-to-local but I'd like to not have to manually select all the files within a folder, if possible.

Additionally, I must be blind but what parameter or setting do I add to make it auto-add files to my queue instead of asking me if I want to queue them?

I've attached the lftp.conf file and the overrides file below in case I set something up wrong.

lftp.conf

# debug 10 -o "~/lftp-debug.log"
set bmk:save-passwords true
set cache:enable no
set cmd:default-protocol sftp
set cmd:move-background true
set cmd:move-background-detach true
set cmd:parallel 5
set cmd:prompt "lftp \\[\\e[01;32m\\]\\h\\[\\e[00m\\]:\\[\\e[01;34m\\]\\w\\[\\e[00m\\] % "
set cmd:queue-parallel 5
set color:use-color auto
set dns:cache-enable no
set dns:order "inet inet6"
set ftp:ssl-allow true
set ftp:ssl-auth TLS
set ftp:ssl-force true
set ftp:ssl-protect-data true
set ftp:ssl-protect-list true
set ftps:initial-prot P
set log:enabled no
set log:enabled/xfer no
set log:level/debug 10
set log:max-size 5M
set mirror:parallel-directories yes
set mirror:parallel-transfer-count 5
set mirror:set-permissions off
set mirror:use-pget-n 20
set net:reconnect-interval-base 10
set net:timeout 10
set pget:default-n 20
set pget:min-chunk-size 50M
set sftp:auto-confirm yes
set sftp:connect-program "ssh -a -x"
set ssl:verify-certificate false
set xfer:temp-file-name *.lftp
set xfer:use-temp-file yes

lftp-conf-override-sh

# Options should be set or modified in the /etc/lftp.conf and applied globally if not editable here.
#
# Here you can customize some settings for the mirror command that will override the lftp.conf defaults.
#
# This is where you can set the command switches for the mirror command.
mirror_args='-c'
# Optional - The number of parallel files to download with the mirror command.
# If this variable is empty or 0 the lftp.conf settings will be used instead.
mirror_parallel_transfer_count='5'
# Optional - Set the number of connections per file lftp can open when using the mirror command.
# If this variable is empty or 0 the lftp.conf settings will be used instead.
mirror_use_pget_n='20'
#
# Here you can customize some settings for the pget command that will override the lftp.conf defaults.
#
# This is where you can set the command switches for the pget command.
pget_args='-c'
# Optional - Set the number of connections per file lftp can open when using the pget command.
# If this variable is empty or 0 the lftp.conf settings will be used instead.
pget_default_n='20'
#

Thanks for this program and for taking the time to read this issue. :)