When setting up a File Transfer, FTP from within an agent job you are using two sets of privileges.
1. On the agent side your are using the privileges of the agent environment user on the system that you are running.
2. On the remote system you are using the privileges of the user that is entered in the File Transfer System.