Index of class methods

Drops resources - intended to be used for error cleanup

Drops resources - intended to be used for error cleanup

Access a blockmap stored in DB row id and for datastore identity, with an initial size.

whether this object refers to an existing row in the datastore table.

Add a group.

Add a user.

Write an admin table (this does not fit anywhere else)

The contents of this object as admin tables.

The contents of this object as admin tables.

Gets the allocinfo list for this inode

The owner tuple used by this view

The authentication ticket

Map/reduce processes files in units of bigblocks.

Same as Mapred_def.mapred_job_config.bigblock_size.

Reserve blocks and allocate at commit time.

Returns the allocation size

Mark blocks and deallocate at commit time.

Get the contents of the blockalloc table for this datastore identity, wrapped into a blockmap_t object

If the blockmap exists, return it.

Ensures that all known blockmaps are loaded

Pin these blocks until commit/rollback.

This is used to synchronize accesses to the in-memory blockmap with the per-inode blocklists in the db.

All blockmaps so far loaded

Books this ID with this (total) size, and pushes the new entry

The byte position of the record that will be written next

Return the cauth record

Check the config.

Close the client (deallocate the message box)

Releases resources (e.g.

Releases resources (e.g.

The clustername

commit owner: commits owner's reservations, and makes them permanent.

Commits the transaction (prepared or not), and returns

Estimate where we are

The map/reduce server configuration

The config file containing config

The connection.

The connection.

continue_with f: Set f as the continuation.

Copies the mentioned file to the task nodes, and places them into the local_directory.

Returns current revision identifier

Get a custom parameter or raise Not_found

The list of allowed custom parameters

Delete this row in the datastore table

Get the contents of the datastore table

Maximum ID used in the datastore table (None if use_id was never called)

The secret random number used for securing transactional writes

Change the row in datastore identified by id so that the fields identity, size, and enabled are updated.

Record that this ID is now also used in a transaction

Delete the group.

Delete the user

A delayed allocation is not immediately pushed to the shared book.

Inodes to be deleted at the end of the transaction.

Deletes the local directory on the task nodes.

Disable this master

disable_slave name

Expected blocksize of datanodes

The blocksize.

The blocksize.

The blocksize.

The clustername

The directory containing the store.

The directory containing the store.

The number of dn_io processes.

For the liveliness monitoring: how many errors (missing response messages) are at most acceptable.

The address to use for multicasting.

Every how many seconds a new multicast messge is emitted

The number of hops (routers+1) for multicasting.

The timeout for connects and RPC calls to data nodes

The data node port

The security level the datanodes expect

The size of the shm queue, in blocks.

The size of the shm queue, in blocks.

How often the file is synced to disk

Get a dump of the internal state

Current sums for `Shm and `Buf as debug string

If >0, enhanced map tasks are created.

Whether there are still enough enabled slaves

The common event system

The event system this transaction uses

The event system this transaction uses

Extracts the key from a record.

The count is the number of names for an inode (same as length of list returned by filename_rev_get_e)

Returns the inode of the member name of directory dir_inode

adds this filename.

Lists subnames of a potential directory name, together with inodes

Returns the parent directory

Works only for directories, and obtains an existence lock for the directory.

filename_rev_get does not acquire locks.

deletes this filename from this directory.

fill_blockmap index data: Fills the blockmap at index with data, a string consisting of 0 and 1.

Set that the map is filled, i.e.

fill_from_db index n: Fills the n rows at index from the db (synchronously)

whether the object is completely filled with data

finish_transaction_serialized f: Run f esys in a serialized way.

Flushes the records from the buffer to disk

Forget everything about this datastore identity

free l owner: deallocates these blocks.

Outputs the records coming from this file.

Get the blockmap for this identity, or Not_found

get_changes owner: Returns the changes made by owner.

Find a group entry by name or by gid

Find a group entry by name or by gid

getgroups user: Returns the set of effective group memberships for user

getgroups user: Returns the set of effective group memberships for user

Find a passwd entry by name or by uid

Find a passwd entry by name or by uid

Return the users and groups

Return the users and groups

whether there are still free blocks

the datastore db table id

This is the blockmap for this datastore identity

whether nothing is being executed

Inactivate

Sets active to false

Inserts a new inode and returns the ID.

deletes the inode.

returns blocks.

Serializer for getting a new ID from the inode table

like inode_get_e but immediately acquires a write lock for the inode

Maximum ID used in the inode table (None if use_id was never called)

First delete the blocks in the del range, then add the blocks from add.

Updates the inode.

This update of mtime/ctime is lock-free

Record that this ID is now also used in a transaction

This plasma directory contains the input files

Reads one record, and advances the cursor.

Reads some records and appends them to the passed queue.

Whether this slave is disabled

An automatically generated name.

The directory path on the task nodes for files that are needed by tasks

lock_filename (dir_inode,name) lock_type owner: Locks the name member of directory dir_inode.

Returns Some unlock if successful where calling unlock removes the lock, or reverts to the previous state (1-step undo)

This plasma directory is used for log files.

The directory path on the task nodes where the tasks can put files, and these files are finally copied to PlasmaFS

The mapper reads records, maps them, and writes them into a second file.

The number of map tasks that should not be exceeded.

The master in host:port syntax

Whether the master (i.e.

How many files are merged at most by a shuffle task

How many enabled slaves we need at minimum

High watermark for buffer memory.

Alternate way for setting the high watermark as fraction of available physical RAM.

Low watermark for buffer memory.

Alternate way for setting the low watermark as fraction of available physical RAM.

Maximum for buffer memory.

Alternate way for setting the maximum as fraction of available physical RAM.

Same as Mapred_config.mapred_config.mr_buffer_size.

The normal size of I/O buffers.

Same as Mapred_config.mapred_config.mr_buffer_size_tight.

The size of I/O buffers when RAM is tight.

High watermark for shared memory.

Alternate way for setting the high watermark as fraction of available shared memory.

Low watermark for shared memory.

Alternate way for setting the low watermark as fraction of available shared memory.

Maximum for shared memory.

Alternate way for setting the maximum as fraction of available shared memory.

The size of the buffers for sorting.

Load limit per task server (in number of tasks).

Task nodes (only hostname)

The port number

A directory where to put executables, logs, etc.

let se = serialized il f: Same as serializing over all values of il (in a nested way)

A name for identifying this job, e.g.

allocates a new ID for an shm or buf object

Creates a new revision identifier

If there is a delayed continuation execute it now

The clustername

The clustername

For how many seconds to wait for neighbor namenodes

The hostname of this node.

Which inodecaches are announced to the clients

After these many seconds transactions are not retried on ECONFLICT

How many name nodes need to be alive to continue with operations

How many name nodes need to be alive at cluster startup

The timeout for connects and RPC calls to name nodes

The name nodes in "host:port" syntax

The name nodes in "host:port" syntax

The name nodes in "host:port" syntax

How much pool RAM is allocated (shared memory)

The rank of this node compared to other nodes.

Default replication factor

the configuration

Opens the cluster filesystem

This plasma directory will get output files.

Outputs these records.

The partition.

Determines the partition of a key.

The number of partitions = number of reduce tasks

Reads the record, but does not advance the cursor, i.e.

pin l owner: marks these blocks as "to keep" even if a competing transaction frees them.

The PlasmaFS cluster

The PlasmaFS cluster

The ordinal number of the record that will be read next.

The ordinal number of the record that will be written next.

Needs to be called after a commit.

This is run by the job process after the last task is finished

Prepares the commit, and returns the journal to commit

This is run by the job process before the first task is started

Prepares the transaction for commit

Push allocations to the shared book.

The reducer reads all the records of one partition, and puts them into an output file.

Release the pinned blocks

release owner: Unpins the blocks of this owner.

The request ID.

reserve n owner ri: finds n free blocks and returns their indices.

return the transaction to the pool or closes it

return the transaction to the pool

The same connection coerced to read-only

Rolls this view back

rollback owner: unreserves owner's blocks.

Rolls the transaction back, and returns

Unless noprepare is set, prepare the query first, and execute it then.

let se = serialized i f: If already a serializer is running for the passed value of i, it is waited until the previous engines reach a final state, and then it is run e = f esys.

Sets the identitifer returned by cur_rev_ident

Shut the process down

Size of the blockmap in blocks

Connections to the name slaves as triples (name,client,enabled).

How many files are created by a shuffle task.

Number of used, transitional, free blocks

Deletes the entire log directory.

These files are copied at job start to the "local" directory for this job on all task nodes.

Returns the files that are still in the log directory

This filename prefix is used for log files

Copies these files of the log directory into PlasmaFS.

to_any_e dest: like to_fd_e but the data is not written to a file descriptor.

to_fd_e fd: The records are written to fd.

unlock all filenames of this owner

unlock all inodes of this owner

Effective watermarks

This plasma directory is used for temporary files.