bestistbuddy on "Moving web files"

I am new to WordPress, I haven't started using it yet, but wanted to know how I move files created with wordpress to my desktop computer. I like to keep a copy of all my web files. Can this be done or are all files stored in wp.