Module Mapred_taskfiles
module Mapred_taskfiles:sig..end
Copy files to and from the task nodes
class type taskfile_manager =object..end
val scp_taskfile_manager : Mapred_config.mapred_config ->
Mapred_def.mapred_job_config -> taskfile_manager
A taskfile manager that uses
scp to copy file to remote nodes.
The local_directory is set to mr_task_tmpdir/job_id_"local".
The log_directory is set to mr_task_tmpdir/job_id_"log".
val ssh_cmd : string -> string -> stringssh_cmd host cmd: Generates a shell command that runs cmd on
hostval scp_to_cmd : string list -> string -> string -> stringscp_to_cmd localfiles host dest: Generates a shell command that
copies localfiles to host into the destination dest