A | |
access [Mapred_auth] | |
access [Pfs_auth] | |
allocinfo [Nn_db] |
The allocinfo records contains information about selected blocks
of a file.
|
async_readers [Mapred_io] | |
B | |
bgreader [Mapred_io_bgreader] | |
bl_cache [Plasma_inodecache] |
A blocklist cache
|
blocklist [Nn_blocklist] |
Common representation of blocklists: This maps datanode identities
to range sets as represented by
BlockRM
|
brange [Plasma_blocks] | |
buf_state [Plasma_filebuf] |
Buffer states: an
`Invalid buffer is reserved for a certain block but it is
not yet filled with any meaningful data, a `Clean buffer contains valid data of a file which is unmodified, a `Dirty buffer contains modified data of a file (which still needs
to be written), a `Reading buffer is being filled with data. For the user this is
very much like `Invalid (data are unusable), but the argument
engine terminates when the buffer changes state again., a `Writing buffer is being written out. For the user this is
very much like `Clean (data can be read but not modified again).
The argument engine terminates when the buffer changes state again., the `Written state is used after `Writing as long as it is
still unclear whether the write is successful or not. On success,
the buffer can be set to `Clean again. On error, it will go back
to `Dirty . , a `Dropped buffer is reused for a different purpose
|
buffer [Plasma_filebuf] |
Buffer descriptor.
|
buffer_system [Plasma_filebuf] | |
C | |
client [Nn_push] | |
client_auth [Pfs_auth] | |
codec [Mapred_toolkit.Place] |
A codec (coder/decoder) says how to convert
a record to string, and how to read it back.
|
commit_id [Nn_push] | |
commit_monitor [Nn_commit_monitor] |
The process-local part of the monitor
|
commit_monitor_shm [Nn_commit_monitor] |
The shm part of the monitor
|
condition [Pfs_condition] |
The condition variable
|
condition [Plasma_shm] | |
config [Mapred_toolkit.DSeq] | |
copy_flag [Mapred_fs] | |
copy_in_flags [Plasma_client] |
see
copy_in
|
copy_out_flags [Plasma_client] |
see
copy_out
|
counter_name [Nn_state] |
Performance counters:
`Transactions_total : number of transaction starts, `Commits_total : number of writing commits, `RPC_filesystem : number of RPC calls of the "Filesystem" program
|
D | |
datastore [Nn_datastores] | |
db [Pkv_api] | |
designation [Mapred_def] |
How to determine the files of
input_dir :
|
discovered [Nn_datastores] | |
dn_shm [Dn_shm] | |
dn_store [Dn_store] | |
ds_init_source [Nn_db] | |
E | |
emap_task [Mapred_tasks] |
Enhanced map tasks do not only map, but also prepartition the result
and sort it
|
engine [Platform.Line_splitter] |
The engine runs in a separate thread (C level, so this thread can
run in parallel with Ocaml code)
|
errno [Nn_state] | |
errno [Plasma_client] |
see errno_code for documentation
|
errno [Plasma_filebuf] | |
ext_location [Mapred_toolkit.Place] | |
F | |
file [Mapred_tasks] | |
file_fragment [Mapred_tasks] |
Filename, start block pos, length in blocks.
|
file_tag [Mapred_tasks] |
Tags may be attached to files.
|
fileinfo [Mapred_io] |
A file is either
`Regular n where n is the length, or
`Directory , or `Other .
|
flush_request [Plasma_filebuf] | |
format [Mapred_toolkit] |
How a file is split into records.
|
I | |
ic_manager [Plasma_inodecache] | |
id [Plasma_shm] | |
inode [Plasma_client] |
inodes are int64 numbers
|
inodeinfo [Nn_db] | |
int64_ser [Pfs_condition] |
Shared part of the serializer
|
int_page [Pkv_xdr_aux] | |
J | |
journal [Nn_state] |
A journal is a queue of database modifications.
|
K | |
key [Pkv_xdr_aux] | |
key_p [Pkv_xdr_aux] | |
kind [Plasma_shm] | |
L | |
leaf_page [Pkv_xdr_aux] | |
level [Pfs_auth] |
Levels of protection:
`None : No protection (unauthenticated access), `Authenticated : The user needs to log in, but the messages
are unprotected otherwise, `Integrity : The user needs to log in, and additionally
the messages are integrity-protected (signed). This is the
recommended minimum level., `Privacy : The user needs to log in, and additionally
the messages are encypted (this includes integrity-protection).
|
link_flag [Mapred_fs] | |
locality [Mapred_tasks] |
For some outputs, it is possible to request where the file is
placed.
|
location [Mapred_toolkit.Place] | |
M | |
m_job_config [Mapred_job_config] | |
machine_params [Mapred_job_exec] | |
map_task [Mapred_tasks] | |
mkdir_flag [Mapred_fs] | |
modification [Nn_db] |
Database modification operations that are covered by the 2-phase
commit protocol.
|
multi_read_task [Plasma_client] | |
O | |
openflag [Pkv_api] | |
openflag_e [Pkv_api] | |
owner [Nn_state] | |
owner [Nn_blockmap] | |
P | |
page [Pkv_xdr_aux] | |
page_type [Pkv_xdr_aux] | |
phases [Mapred_def] |
Which phases are enabled:
|
plan [Mapred_sched] |
A plan contains: tasks, dependencies between tasks, whether a task is done or not done
|
plan_config [Mapred_sched] | |
plasma_cluster [Plasma_client] |
an open Plasma cluster
|
plasma_trans [Plasma_client] |
plasma transaction
|
R | |
read_file_flag [Mapred_fs] | |
read_flag [Mapred_io] |
Flags for the reader:
`Bof_block n : Assume that the first record to read is at position
n of the file. The position should not be after the first block
to read., `Eof_pos n : Assume that the EOF position is at n (in bytes)
`Bof and `Eof can be used to read from a part of the file
only.
|
read_flag [Mapred_fs] | |
read_only [Pfs_db] |
the
mode that is conventionally used for read-only connections
|
read_request [Plasma_client] | |
read_response [Plasma_client] | |
read_write [Pfs_db] |
the
mode that is conventionally used for read-write connections
|
readdir_flag [Mapred_fs] | |
readlink_flag [Mapred_fs] | |
remove_flag [Mapred_fs] | |
rename_flag [Mapred_fs] | |
reserve_info [Nn_blockmap] |
Optional information for block reservations
|
result [Mapred_toolkit.DSeq] |
The result of a distributed operation
|
rfun [Mapred_rfun] |
A registered function has this type.
|
rmdir_flag [Mapred_fs] | |
ro_async_connection [Pfs_db] |
abbrev
|
role [Nn_elect] | |
root_page [Pkv_xdr_aux] | |
rpolicy [Nn_alloc_types] | |
running_job [Mapred_job_exec] | |
runtime_job_config [Mapred_job_exec] | |
rw_async_connection [Pfs_db] |
abbrev
|
S | |
seq [Mapred_toolkit.Seq] |
A sequence
(el,mode) seq contains elements of type el ,
and can be accessed according to mode : mode=[`R] : the sequence is read-only, mode=[`W] : the sequence is write-only, mode=[`R|`W] : the sequence is read-write
|
ser [Pfs_condition] |
Shared part of the serializer
|
sh_state_shm [Nn_state] |
The shm part of shared_state_t.
|
shuffle_task [Mapred_tasks] |
Shuffling means to rearrange the output of the map/sort tasks
into a set of partitions.
|
size_flag [Mapred_fs] | |
sort_task [Mapred_tasks] | |
spec [Mapred_main] |
Specification of a command for
dispatch .
|
stats [Mapred_stats] | |
status [Mapred_job_exec] | |
store [Mapred_toolkit.Store] |
A store is a container for data
|
strmem [Plasma_client] |
The user buffer for
read and write can be given as string or as
bigarray
(memory).
|
strmem [Plasma_filebuf] | |
symlink_flag [Mapred_fs] | |
sync_readers [Mapred_io] | |
T | |
t [Mapred_toolkit.Place] |
A place for storing records of type
'a
|
t [Mapred_tasks.Ord] | |
task [Mapred_tasks] | |
task_ok [Mapred_tasks] | |
task_result [Mapred_tasks] |
-
`Ok ok : Task is successful.
|
test_flag [Mapred_fs] | |
test_type [Mapred_fs] |
Tests:
`N : the file name exists, `E : the file exists, `D : the file exists and is a directory, `F : the file exists and is regular, `H : the file exists and is a symlink (possibly to a non-existing
target), `R : the file exists and is readable, `W : the file exists and is writable, `X : the file exists and is executable, `S : the file exists and is non-empty
|
ticket_verifier [Nn_datanode_ctrl] |
This is almost the same as
Nn_alloc_types.transacted_datastores
|
topology [Plasma_client] |
see
copy_in
|
transacted_datastores [Nn_alloc_types] | |
triv_range [Nn_blockmap] |
(startblock, number)
|
U | |
update_characteristics [Nn_commit_monitor] | |
W | |
wait_entry [Pfs_condition] |
Each process that wants to
wait needs a wait_entry .
|
wait_set [Pfs_condition] |
A set of
wait_entry , for easier management.
|
watermarks [Plasma_shm] | |
write_common [Mapred_fs] |
The intersection of
write_flag and write_file_flag
|
write_file_flag [Mapred_fs] | |
write_flag [Mapred_fs] | |
X | |
x_copy_flag [Plasma_netfs] | |
x_link_flag [Plasma_netfs] | |
x_read_file_flag [Plasma_netfs] | |
x_write_file_flag [Plasma_netfs] | |
x_write_flag [Plasma_netfs] |