This is a read-only archive!

ncftp, wget

ncftp simply doesn't like to do recursive GETs. It'll churn along happily until it hits some random file and then timeout. If I restart the same command it'll sometimes get further and timeout, sometimes timeout sooner. Oh how I wish I could find a linux FTP client that doesn't suck half the time. I still entertain notions of writing my own someday. I know pretty well how I want the UI to work, it's the backend that I always get hung up on. I'm not going to re-implement the FTP protocol. Ruby has a nice FTP library but it seems somewhat limited in certain ways. Or else I haven't delved into it enough.

Either way. I'm going to use wget for my recursive FTP downloads from now on. Probably should've done that to begin with.

wget -r -x --ftp-user USERNAME  --ftp-password PASSWORD 'ftp://SERVER/DIRECTORY/*'

I at first was upset about having my FTP password lying around on the command line / process list but then I realized that I'm the only person who uses now and who will ever use this computer. I'll delete it from ~/.bash_history after I'm done. If someone is psing my process list right now, I have much bigger problems than having them gank my FTP password.

February 11, 2007 @ 4:36 AM PST
Cateogory: Linux

3 Comments

Jan-Hendrik Zab
Quoth Jan-Hendrik Zab on February 11, 2007 @ 6:33 AM PST

Hey, have you ever tried lftp or yafc? I haven't got any problems with them so far. :)

Brian
Quoth Brian on February 11, 2007 @ 8:06 AM PST

Thank you very much for the suggestion. I am going to give yafc an extended try.

Levi Figueira
Quoth Levi Figueira on October 05, 2007 @ 10:50 AM PDT

As to the password, try doing this: wget -rx 'ftp://user:pass@host.com'

wget will turn it into: ftp://user:password@host.com

on both screen and logs! ;)

Cheers, ~Levi F.