Access Control List (ACL), Using ACLs
examples, Examples
how they work, How ACLs Work
using, Using ACLs with the Lustre Software
audit
change logs, Audit with Changelogs
backup, Backing up a File System
aborting recovery, Aborting Recovery
index objects, Backing Up an OST or MDT (Backend File System Level)
MDT file system, Backing Up an OST or MDT (Backend File System Level)
MDT/OST device level, Backing Up and Restoring an MDT or OST (ldiskfs Device Level)
new/changed files, Backing up New/Changed Files to the Backup File System
OST and MDT, Backing Up an OST or MDT
OST config, Backing Up OST Configuration Files
OST file system, Backing Up an OST or MDT (Backend File System Level)
restoring file system backup, Restoring a File-Level Backup
restoring OST config, Restoring OST Configuration Files
rsync, Lustre_rsync
examples, lustre_rsync Examples
using, Using Lustre_rsync
using LVM, Using LVM Snapshots with the Lustre File System
creating, Creating an LVM-based Backup File System
creating snapshots, Creating Snapshot Volumes
deleting, Deleting Old Snapshots
resizing, Changing Snapshot Volume Size
restoring, Restoring the File System From a Snapshot
ZFS to ldiskfs, Migrate from a ZFS to an ldiskfs based filesystem, Migrate from an ldiskfs to a ZFS based filesystem
ZFS ZPL, Migration Between ZFS and ldiskfs Target Filesystems
barrier, Global Write Barriers
impose, Impose Barrier
query, Query Barrier
remove, Remove Barrier
rescan, Rescan Barrier
application profiling, Collecting Application Profiling Information (stats-collect)
local disk, Testing Local Disk Performance
MDS performance, Testing MDS Performance (mds-survey)
network, Testing Network Performance
OST I/O, Testing OST I/O Performance (ost-survey)
OST performance, Testing OST Performance (obdfilter-survey)
raw hardware with sgpdd-survey, Testing I/O Performance of Raw Hardware (sgpdd-survey)
remote disk, Testing Remote Disk Performance
tuning storage, Tuning Linux Storage Devices
with Lustre I/O Kit, Using Lustre I/O Kit Tools
change logs (see monitoring)
commit on share, Commit on Share
tuning, Tuning Commit On Share
working with, Working with Commit on Share
configlogs, Lustre Configuration Logs
adaptive timeouts, Configuring Adaptive Timeouts
LNet options, LNet Options
module options, Module Options
multihome, Multihome Server Example
network
forwarding, forwarding ("")
rnet_htable_size, rnet_htable_size
routes, routes ("")
SOCKLND, SOCKLND Kernel TCP/IP LND
tcp, networks ("tcp")
network topology, Network Topology
debug
utilities, Testing / Debugging Utilities
debugging, Diagnostic and Debugging Tools
admin tools, Tools for Administrators and Developers
developer tools, Tools for Developers
developers tools, Lustre Debugging for Developers
disk contents, Looking at Disk Content
external tools, External Debugging Tools
kernel debug log, Controlling Information Written to the Kernel Debug Log
lctl example, Sample lctl Run
memory leaks, Finding Memory Leaks Using leak_finder.pl
message format, Understanding the Lustre Debug Messaging Format
procedure, Lustre Debugging Procedures
tools, Lustre Debugging Tools
using lctl, Using the lctl Tool to View Debug Messages
using strace, Troubleshooting with strace
design (see setup
DLC
Code Example, Adding a route code example
dom, Introduction to Data on MDT (DoM), User Commands, DoM Stripe Size Restrictions, lfs getstripe for DoM files, lfs find for DoM files, The dom_stripesize parameter, Disable DoM
disabledom, Disable DoM
domstripesize, DoM Stripe Size Restrictions
dom_stripesize, The dom_stripesize parameter
intro, Introduction to Data on MDT (DoM)
lfsfind, lfs find for DoM files
lfsgetstripe, lfs getstripe for DoM files
lfssetstripe, lfs setstripe for DoM files
usercommands, User Commands
e2scan, e2scan
errors (see troubleshooting)
failover, What is Failover?, Setting Up a Failover Environment
and Lustre, Failover Functionality in a Lustre File System
capabilities, Failover Capabilities
configuration, Types of Failover Configurations
high-availability (HA) software, Selecting High-Availability (HA) Software
MDT, MDT Failover Configuration (Active/Passive), MDT Failover Configuration (Active/Active)
OST, OST Failover Configuration (Active/Active)
power control device, Selecting Power Equipment
power management software, Selecting Power Management Software
setup, Preparing a Lustre File System for Failover
feature overview
configuration, Configuration
file layout
See striping, Lustre File Layout (Striping) Considerations
filefrag, filefrag
fileset, Fileset Feature
fragmentation, Description
Hierarchical Storage Management (HSM)
introduction, Introduction
High availability (see failover)
HSM
agents, Agents
agents and copytools, Agents and copytool
archiveID backends, Archive ID, multiple backends
automatic restore, Automatic restore
changelogs, change logs
commands, Commands
coordinator, Coordinator
file states, File states
grace_delay, grace_delay
hsm_control, hsm_controlpolicy
max_requests, max_requests
policy, policy
policy engine, Policy engine
registered agents, Registered agents
request monitoring, Request monitoring
requests, Requests
requirements, Requirements
robinhood, Robinhood
setup, Setup
timeout, Timeout
tuning, Tuning
I/O, Handling Full OSTs
adding an OST, Adding an OST to a Lustre File System
bringing OST online, Returning an Inactive OST Back Online
direct, Performing Direct I/O
disabling OST creates, Disabling creates on a Full OST
full OSTs, Handling Full OSTs
migrating data, Migrating Data within a File System
OST space usage, Checking OST Space Usage
pools, Creating and Managing OST Pools
imperative recovery, Imperative Recovery
Configuration Suggestions, Configuration Suggestions for Imperative Recovery
MGS role, MGS role
Tuning, Tuning Imperative Recovery
inodes
MDS, Setting Formatting Options for an ldiskfs MDT
OST, Setting Formatting Options for an ldiskfs OST
installing, Steps to Installing the Lustre Software
preparation, Preparing to Install the Lustre Software
Introduction, Introduction
Requirements, Requirements
ior-survey, ior-survey
Isolation, Isolating Clients to a Sub-directory Tree
client identification, Identifying Clients
configuring, Configuring Isolation
making permanent, Making Isolation Permanent
jobstats (see monitoring)
large_xattr
ea_inode, File and File System Limits, Upgrading to Lustre Software Release 2.x (Major Release)
lctl, lctl
ldiskfs
formatting options, Setting ldiskfs File System Formatting Options
lfs, lfs
lfs_migrate, lfs_migrate
llodbstat, llobdstat
llog_reader, llog_reader
llstat, llstat
llverdev, llverdev
ll_decode_filter_fid, ll_decode_filter_fid
ll_recover_lost_found_objs, ll_recover_lost_found_objs
LNet, Introducing LNet, Overview of LNet Module Parameters, Dynamically Configuring LNet Routes, lustre_routes_config, lustre_routes_conversion, Route Configuration Examples (see configuring)
best practice, Best Practices for LNet Options
buffer yaml syntax, Enable Routing and Adjust Router Buffer Configuration
capi general information, General API Information
capi input params, API Common Input Parameters
capi output params, API Common Output Parameters
capi return code, API Return Code
cli, Configuring LNet, Displaying Global Settings, Adding, Deleting and Showing Networks, Manual Adding, Deleting and Showing Peers, Adding, Deleting and Showing routes, Enabling and Disabling Routing, Showing routing information, Configuring Routing Buffers, Importing YAML Configuration File, Exporting Configuration in YAML format, Showing LNet Traffic Statistics
asymmetrical route, Asymmetrical Routes
dynamic discovery, Dynamic Peer Discovery
comments, Including comments
Configuring LNet, Configuring LNet via lnetctl
cyaml, Internal YAML Representation (cYAML)
error block, Error Block
escaping commas with quotes, Escaping commas with quotes
features, Key Features of LNet
hardware multi-rail configuration, Hardware Based Multi-Rail Configurations with LNet
InfiniBand load balancing, Load Balancing with an InfiniBand* Network
ip2nets, Setting the LNet Module ip2nets Parameter
lustre.conf, Setting Up lustre.conf for Load Balancing
lustre_lnet_config_buf, Adjusting Router Buffer Pools
lustre_lnet_config_net, Adding a Network Interface
lustre_lnet_config_ni_system, Configuring LNet
lustre_lnet_config_route, Adding Routes
lustre_lnet_del_net, Deleting a Network Interface
lustre_lnet_del_route, Deleting Routes
lustre_lnet_enable_routing, Enabling and Disabling Routing
lustre_lnet_show stats, Showing LNet Traffic Statistics
lustre_lnet_show_buf, Showing Routing information
lustre_lnet_show_net, Showing Network Interfaces
lustre_lnet_show_route, Showing Routes
lustre_yaml, Adding/Deleting/Showing Parameters through a YAML Block
management, Updating the Health Status of a Peer or Router
module parameters, Setting the LNet Module networks Parameter
network yaml syntax, Network Configuration
proc, Monitoring LNet
route checker, Configuring the Router Checker
router yaml syntax, Route Configuration
routes, Setting the LNet Module routes Parameter
routing example, Routing Example
self-test, LNet Self-Test Overview
show block, Show Block, The LNet Configuration C-API
starting/stopping, Starting and Stopping LNet
statistics yaml syntax, Show Statistics
supported networks, Supported Network Types
testing, Testing the LNet Configuration
tuning, Tuning LNet Parameters
understanding, Introducing LNet
using NID, Using a Lustre Network Identifier (NID) to Identify a Node
yaml syntax, YAML Syntax
logs, Snapshot Logs
lr_reader, lr_reader
lshowmount, lshowmount
lsom
enablelsom, Enable LSoM
intro, Introduction to Lazy Size on MDT (LSoM)
lfsgetsom, lfs getsom for LSoM data
usercommands, User Commands
lst, lst
Lustre, What a Lustre File System Is (and What It Isn't)
at scale, Lustre Cluster
cluster, Lustre Cluster
components, Lustre Components
configuring, Configuring a Simple Lustre File System
additional options, Additional Configuration Options
for scale, Scaling the Lustre File System
simple example, Simple Lustre Configuration Example
striping, Changing Striping Defaults
utilities, Using the Lustre Configuration Utilities
features, Lustre Features
fileset, Fileset Feature
I/O, Lustre File System Storage and I/O
LNet, Lustre Networking (LNet)
MGS, Management Server (MGS)
Networks, Lustre Networks
requirements, Lustre File System Components
storage, Lustre File System Storage and I/O
striping, Lustre File System and Striping
upgrading (see upgrading)
lustre
errors (see troubleshooting)
recovery (see recovery)
troubleshooting (see troubleshooting)
lustre_rmmod.sh, lustre_rmmod.sh
lustre_rsync, lustre_rsync
LVM (see backup)
l_getidentity, l_getidentity
maintenance, Working with Inactive OSTs, Working with Inactive MDTs
aborting recovery, Aborting Recovery
adding a OST, Adding a New OST to a Lustre File System
adding an MDT, Adding a New MDT to a Lustre File System
backing up OST config, Backing Up OST Configuration Files
bringing OST online, Returning an Inactive OST Back Online
changing a NID, Changing a Server NID
changing failover node address, Changing the Address of a Failover Node
Clearing a config, Clearing configuration
finding nodes, Finding Nodes in the Lustre File System
full OSTs, Migrating Data within a File System
identifying OST host, Determining Which Machine is Serving an OST
inactive MDTs, Working with Inactive MDTsL 2.4
inactive OSTs, Working with Inactive OSTs
mounting a server, Mounting a Server Without Lustre Service
pools, Creating and Managing OST Pools
regenerating config logs, Regenerating Lustre Configuration Logs
reintroducing an OSTs, Returning a Deactivated OST to Service
removing an MDT, Removing an MDT from the File System
removing an OST, Removing and Restoring MDTs and OSTs, Removing an OST from the File System
restoring an OST, Removing and Restoring MDTs and OSTs
restoring OST config, Restoring OST Configuration Files
separate a combined MGS/MDT, Separate a combined MGS/MDT
MDT
multiple MDSs, Upgrading to Lustre Software Release 2.x (Major Release)
migrating metadata, Migrating Metadata within a Filesystem, Whole Directory Migration, Striped Directory Migration
mkfs.lustre, mkfs.lustre
Lustre Changelogs, Lustre Jobstats
additional tools, Other Monitoring Options
change logs, Lustre Changelogs, Working with Changelogs
jobstats, Lustre Jobstats, How Jobstats Works, Enable/Disable Jobstats, Check Job Stats, Clear Job Stats, Configure Auto-cleanup Interval
Lustre Monitoring Tool, Lustre Monitoring Tool (LMT)
mount, mount
mount.lustre, mount.lustre
MR
addremotepeers, Adding Remote Peers that are Multi-Rail Capable
configuring, Configuring Multi-Rail
deleteinterfaces, Deleting Network Interfaces
deleteremotepeers, Deleting Remote Peers
health, LNet Health
mrhealth
display, Displaying Information
failuretypes, Failure Types and Behavior
initialsetup, Initial Settings Recommendations
interface, User Interface
value, Health Value
mrrouting, Notes on routing with Multi-Rail
routingex, Multi-Rail Cluster Example
routingmixed, Mixed Multi-Rail/Non-Multi-Rail Cluster
routingresiliency, Utilizing Router Resiliency
multipleinterfaces, Configure Multiple Interfaces on the Local Node
overview, Multi-Rail Overview
multiple-mount protection, Overview of Multiple-Mount Protection
obdfilter-survey, obdfilter-survey
operations, Mounting by Label, Snapshot Operations
create, Creating a Snapshot
degraded OST RAID, Handling Degraded OST RAID Arrays
delete, Delete a Snapshot
erasing a file system, Erasing a File System
failover, Specifying Failout/Failover Mode for OSTs, Specifying NIDs and Failover
identifying OSTs, Identifying To Which Lustre File an OST Object Belongs
list, List Snapshots
mkdir, Creating a directory striped across multiple MDTs
modify, Modify Snapshot Attributes
mount, Mounting a Snapshot
mounting, Mounting a Server
mounting by label, Mounting by Label
multiple file systems, Running Multiple Lustre File Systems
parameters, Setting and Retrieving Lustre Parameters
reclaiming space, Reclaiming Reserved Disk Space
remote directory, Creating a sub-directory on a given MDT
replacing an OST or MDS, Replacing an Existing OST or MDT
setdirstripe, Creating a directory striped across multiple MDTs
shutdownLustre, Stopping the Filesystem
starting, Starting Lustre
striped directory, Creating a directory striped across multiple MDTs
unmount, Unmounting a Snapshot
unmounting, Unmounting a Specific Target on a Server
ost-survey, ost-survey
performance (see benchmarking)
pings
evict_client, Client Death Notification
suppress_pings, "suppress_pings" Kernel Module Parameter
plot-llstat, plot-llstat
pools, Creating and Managing OST Pools
usage tips, Tips for Using OST Pools
proc
adaptive timeouts, Configuring Adaptive Timeouts
block I/O, Monitoring the OST Block I/O Stream
client metadata performance, Tuning the Client Metadata RPC Stream
client stats, Monitoring Client Activity
configuring adaptive timeouts, Configuring Adaptive Timeouts
debug, Enabling and Interpreting Debugging Logs
free space, Allocating Free Space on OSTs
LNet, Monitoring LNet
locking, Configuring Locking
OSS journal, Enabling OSS Asynchronous Journal Commit
read cache, Tuning OSS Read Cache
read/write survey, Monitoring Client Read-Write Offset Statistics, Monitoring Client Read-Write Extent Statistics
readahead, Tuning File Readahead and Directory Statahead
RPC tunables, Tuning the Client I/O RPC Stream
static timeouts, Setting Static Timeouts
thread counts, Setting MDS and OSS Thread Counts
watching RPC, Monitoring the Client RPC Stream
profiling (see benchmarking)
programming
upcall, User/Group Upcall
Quotas
allocating, Quota Allocation
configuring, Working with Quotas
creating, Quota Administration
enabling disk, Enabling Disk Quotas
Interoperability, Quotas and Version Interoperability
known issues, Granted Cache and Quota Limits
statistics, Lustre Quota Statistics
verifying, Quota Verification
recovery, Recovery Overview
client eviction, Client Eviction
client failure, Client Failure
commit on share (see commit on share)
corruption of backing ldiskfs file system, Recovering from Errors or Corruption on a Backing ldiskfs File System
corruption of Lustre file system, Recovering from Corruption in the Lustre File System
failed recovery, Failed Recovery
LFSCK, Checking the file system with LFSCK
locks, Lock Recovery
MDS failure, MDS Failure (Failover)
metadata replay, Metadata Replay
network, Network Partition
oiscrub, Checking the file system with LFSCK
orphaned objects, Working with Orphaned Objects
OST failure, OST Failure (Failover)
unavailable OST, Recovering from an Unavailable OST
VBR (see version-based recovery)
reporting bugs (see troubleshooting)
restoring (see backup)
root squash, Using Root Squash
configuring, Configuring Root Squash
enabling, Enabling and Tuning Root Squash
tips, Tips on Using Root Squash
round-robin algorithm, Managing Free Space
routerstat, routerstat
rsync (see backup)
selinux policy check, Checking SELinux Policy Enforced by Lustre Clients
determining, Determining SELinux Policy Info
enforcing, Enforcing SELinux Policy Check
making permanent, Making SELinux Policy Check Permanent
sending client, Sending SELinux Status Info from Clients
setup, Hardware Considerations
hardware, Hardware Considerations
inodes, Setting Formatting Options for an ldiskfs MDT
ldiskfs, Setting ldiskfs File System Formatting Options
limits, File and File System Limits
MDT, MGT and MDT Storage Hardware Considerations, Determining MDT Space Requirements
memory, Determining Memory Requirements
client, Client Memory Requirements
MDS, MDS Memory Requirements, Calculating MDS Memory Requirements
OSS, OSS Memory Requirements, Calculating OSS Memory Requirements
MGT, Determining MGT Space Requirements
network, Implementing Networks To Be Used by the Lustre File System
OST, OST Storage Hardware Considerations, Determining OST Space Requirements
space, Determining Space Requirements
sgpdd-survey, sgpdd-survey
How Lustre File System Striping Works
considerations, Lustre File Layout (Striping) Considerations
determining MDT requirements, Determining MDT Space Requirements
determining MGT requirements, Determining MGT Space Requirements
determining OST requirements, Determining OST Space Requirements
determining requirements, Determining Space Requirements
free space, Managing Free Space
location weighting, Adjusting the Weighting Between Free Space and Location
striping, How Lustre File System Striping Works
stats-collect, stats-collect
storage
configuring, Selecting Storage for the MDT and OSTs
external journal, Choosing Parameters for an External Journal
for best practice, Reliability Best Practices
for mkfs, Computing file system parameters for mkfs
MDT, Metadata Target (MDT)
OST, Object Storage Server (OST)
RAID options, Formatting Options for ldiskfs RAID Devices
SAN, Connecting a SAN to a Lustre File System
performance tradeoffs, Performance Tradeoffs
striping (see space)
allocations, Stripe Allocation Methods
configuration, Setting the File Layout/Striping Configuration (lfs setstripe)
considerations, Lustre File Layout (Striping) Considerations
count, Setting the Stripe Count
getting information, Retrieving File Layout/Striping Information (getstripe)
how it works, How Lustre File System Striping Works
metadata, Creating a directory striped across multiple MDTs
on specific OST, Creating a File on a Specific OST
overview, Lustre File System and Striping
per directory, Setting the Striping Layout for a Directory
per file system, Setting the Striping Layout for a File System
PFL, Progressive File Layout(PFL)
remote directories, Locating the MDT for a remote directory
round-robin algorithm, Managing Free Space
size, Choosing a Stripe Size
weighted algorithm, Managing Free Space
wide striping, Lustre Striping Internals
suppressing pings, Suppressing Pings
troubleshooting, Lustre Error Messages
'Address already in use', Handling/Debugging "Bind: Address already in use" Error
'Error -28', Handling/Debugging Error "- 28"
common problems, Common Lustre File System Problems
error messages, Viewing Error Messages
error numbers, Error Numbers
OST out of memory, Log Message 'Out of Memory' on OST
reporting bugs, Reporting a Lustre File System Bug
slowdown during startup, Slowdown Occurs During Lustre File System Startup
timeouts on setup, Handling Timeouts on Initial Lustre File System Setup
tunefs.lustre, tunefs.lustre
tuning, Optimizing the Number of Service Threads (see benchmarking)
for small files, Improving Lustre I/O Performance for Small Files
Large Bulk IO, Large Bulk IO (16MB RPC)
libcfs, libcfs Tuning
LND tuning, LND Tuning
LNet, Tuning LNet Parameters
lockless I/O, Lockless I/O Tunables
MDS binding, Binding MDS Service Thread to CPU Partitions
MDS threads, Specifying the MDS Service Thread Count
Network interface binding, Binding Network Interface Against CPU Partitions
Network interface credits, Network Interface Credits
Network Request Scheduler (NRS) Tuning, Network Request Scheduler (NRS) Tuning
client round-robin over NIDs (CRR-N) policy, Client Round-Robin over NIDs (CRR-N) policy
Delay policy, Delay policy
first in, first out (FIFO) policy, First In, First Out (FIFO) policy
object-based round-robin (ORR) policy, Object-based Round-Robin (ORR) policy
Target-based round-robin (TRR) policy, Target-based Round-Robin (TRR) policy
Token Bucket Filter (TBF) policy, Token Bucket Filter (TBF) policy
OSS threads, Specifying the OSS Service Thread Count
portal round-robin, Portal Round-Robin
router buffers, Router Buffers
service threads, Optimizing the Number of Service Threads
with lfs ladvise, Server-Side Advice and Hinting
write performance, Understanding Why Write Performance is Better Than Read Performance
upgrading, Release Interoperability and Upgrade Requirements
2.X.y to 2.X.y (minor release), Upgrading to Lustre Software Release 2.x.y (Minor Release)
major release (2.x to 2.x), Upgrading to Lustre Software Release 2.x (Major Release)
utilities
application profiling, Application Profiling Utilities
debugging, Testing / Debugging Utilities
system config, Additional System Configuration Utilities
version
which version of Lustre am I running?, Revisions
Version-based recovery (VBR), Version-based Recovery
messages, VBR Messages
tips, Tips for Using VBR
weighted algorithm, Managing Free Space
wide striping, File and File System Limits, Upgrading to Lustre Software Release 2.x (Major Release), Lustre Striping Internals
large_xattr
ea_inode, File and File System Limits, Upgrading to Lustre Software Release 2.x (Major Release)
xattr
See wide striping, File and File System Limits