Automatic lookup of class parameters
Puppet looks up the values for class parameters in Hiera, using the fully qualified name of the parameter (myclass::parameter_one) as a lookup key.
Most classes need configuration, and you can specify them as parameters to a class as this looks up the needed data if not directly given when the class is included in a catalog. There are several ways Puppet sets values for class parameters, in this order:
If you're doing a resource-like declaration, Puppet uses parameters that are explicitly set (if explicitly setting undef, a looked up value or default is used).
Puppet uses Hiera, using
<CLASS NAME>::<PARAMETER NAME>as the lookup key. For example, it looks upntp::serversfor thentpclass's$servers parameter.If a parameter still has no value, Puppet uses the default value from the parameter's default value expression in the class's definition.
If any parameters have no value and no default, Puppet fails compilation with an error.
NTP class like this: # /etc/puppetlabs/code/production/data/nodes/web01.example.com.yaml
---
ntp::servers:
- time.example.com
- 0.pool.ntp.orgThe best way to manage this is to use the roles and profiles
method, which allows you to store a smaller amount of more meaningful data in
Hiera. lookup_options feature.The Puppet lookup function
The lookup function uses Hiera to retrieve a value for a given key.
By default, the lookup function returns the first value found and fails compilation if no values are available. You can also configure the lookup function to merge multiple values into one.
When looking up a key, Hiera searches up to four hierarchy layers of data, in the following order:
- Global hierarchy.
- The current environment's hierarchy.
- The indicated module's hierarchy, if the key is of the form
<MODULE NAME>::<SOMETHING>. - If not found and the module's hierarchy has a
default_hierarchyentry in itshiera.yaml— the lookup is repeated if steps 1-3 did not produce a value.
hiera.yaml file has been configured, Hiera defaults are used. If you do not want it to use the defaults, you can create an empty hiera.yaml file in /etc/puppetlabs/puppet/hiera.yaml.Default global hiera.yaml is installed at /etc/puppetlabs/puppet/hiera.yaml.
Arguments
You must provide the key's name. The other arguments are optional.
-
lookup( <NAME>, [<VALUE TYPE>], [<MERGE BEHAVIOR>], [<DEFAULT VALUE>] ) -
lookup( [<NAME>], <OPTIONS HASH> ) -
lookup( as above ) |$key| { <VALUE> } # lambda returns a default value
Arguments in [square brackets] are optional.
default_value at the
same time as giving a lambda means that the lambda wins. The
rationale for allowing this is that you might be using the same hash of
options multiple times, and you might want to override the production of
the default value. A default_values_hash wins over the lambda if it has a value for the looked up key.<NAME>(String or Array) - The name of the key to look up. This can also be an array of keys. If Hiera doesn't find anything for the first key, it tries with the subsequent ones, only resorting to a default value if none of them succeed.<VALUE TYPE>(data Type) - A data type that must match the retrieved value; if not, the lookup (and catalog compilation) fails. Defaults toDatawhich accepts any normal value.<MERGE BEHAVIOR>(String or Hash; see Merge behaviors) - Whether and how to combine multiple values. If present, this overrides any merge behavior specified in the data sources. Defaults to no value; Hiera uses merge behavior from the data sources if present, otherwise it does a first-found lookup.<DEFAULT VALUE>(any normal value) - If present, lookup returns this when it can't find a normal value. Default values are never merged with found values. Like a normal value, the default must match the value type. Defaults to no value; if Hiera can't find a normal value, the lookup (and compilation) fails.<OPTIONS HASH>(Hash) - Alternate way to set the arguments above, plus some less common additional options. If you pass an options hash, you can't combine it with any regular arguments (except<NAME>). An options hash can have the following keys:'name'- Same as<NAME>(argument 1). You can pass this as an argument or in the hash, but not both.'value_type'- Same as<VALUE TYPE>.'merge'- Same as<MERGE BEHAVIOR>.'default_value'- Same as<DEFAULT VALUE>.'default_values_hash'(Hash) - A hash of lookup keys and default values. If Hiera can't find a normal value, it checks this hash for the requested key before giving up. You can combine this withdefault_valueor a lambda, which is used if the key isn't present in this hash. Defaults to an empty hash.'override'(Hash) - A hash of lookup keys and override values. Puppet checks for the requested key in the overrides hash first. If found, it returns that value as the final value, ignoring merge behavior. Defaults to an empty hash.lookup- can take a lambda, which must accept a single parameter. This is yet another way to set a default value for the lookup; if no results are found, Puppet passes the requested key to the lambda and use its result as the default value.
Merge behaviors
Hiera uses a hierarchy of data sources, and a given key can have values in multiple sources. Hiera can either return the first value it finds, or continue to search and merge all the values together. When Hiera searches, it first searches the global layer, then the environment layer, and finally the module layer — where it only searches in modules that have a matching namespace. By default (unless you use one of the merge strategies) it is priority/"first found wins", in which case the search ends as soon as a value is found.
lookup_options metadata key to
request a specific merge behavior for a key. The lookup function
uses that requested behavior unless you specify one.Default values for a lookup:
hiera('some::key', 'the default value')(Recommended) lookup('some::key', undef, undef, 'the default value')lookup('ntp::service_name')A unique merge lookup of class names, then adding all of those classes to the catalog: lookup('classes', Array[String], 'unique').includeA deep hash merge lookup of user data, but letting higher priority sources remove values by prefixing them with: lookup( { 'name' => 'users',
'merge' => {
'strategy' => 'deep',
'knockout_prefix' => '--',
},
})The puppet lookup command
The puppet lookup command is the command line interface (CLI) for Puppet's lookup function.
The puppet lookup command lets you do Hiera lookups from the command line. You must run it on a node that has a copy of your Hiera data. You can log into a Puppet Server node and run puppet lookup with sudo.
The most common version of this command is:
puppet lookup <KEY> --node <NAME> --environment <ENV> --explainThe puppet lookup command searches your Hiera data and returns a value for the requested lookup key, so you can test and explore your data. It replaces the hiera command. Hiera relies on a node's facts to locate the relevant data sources. By default, puppet lookup uses facts from the node you run the command on, but you can get data for any other node with the --node NAME option. If possible, the lookup command uses the requested node's real stored facts from PuppetDB. If PuppetDB is not configured or you want to provide other fact values, pass facts from a JSON or YAML file with the --facts FILE option.
puppet lookup command replaces the hiera command.Examples
key_name using the Puppet Server node’s facts: $ puppet lookup key_nameTo look up key_name with agent.local's facts:$ puppet lookup --node agent.local key_nameTo get the first value found for key_name_one and key_name_two with agent.local's facts while merging values and knocking out the prefix 'example' while merging:puppet lookup --node agent.local --merge deep --knock-out-prefix example key_name_one key_name_twoTo lookup key_name with agent.local's facts, and return a default value of 0 if nothing is found:puppet lookup --node agent.local --default 0 key_nameTo see an explanation of how the value for key_name is found, using agent.local facts:puppet lookup --node agent.local --explain key_name Options
puppet lookup command has the following command options: --help: Print a usage message.--explain: Explain the details of how the lookup was performed and where the final value came from, or the reason no value was found. Useful when debugging Hiera data. If--explainisn't specified, lookup exits with 0 if a value was found and 1 if not. With--explain, lookup always exits with 0 unless there is a major error. You can provide multiple lookup keys to this command, but it only returns a value for the first found key, omitting the rest.--node <NODE-NAME>: Specify which node to look up data for; defaults to the node where the command is run. The purpose of Hiera is to provide different values for different nodes; use specific node facts to explore your data. If the node where you're running this command is configured to talk to PuppetDB, the command uses the requested node's most recent facts. Otherwise, override facts with the '--facts' option.--facts <FILE>: Specify a JSON or YAML file that contains key-value mappings to override the facts for this lookup. Any facts not specified in this file maintain their original value.--environment <ENV>: Specify an environment. Different environments can have different Hiera data.--merge first/unique/hash/deep: Specify the merge behavior, overriding any merge behavior from the data'slookup_options.--knock-out-prefix <PREFIX-STRING>: Used with 'deep' merge. Specifies a prefix to indicate a value should be removed from the final result.--sort-merged-arrays: Used with 'deep' merge. When this flag is used, all merged arrays are sorted.--merge-hash-arrays: Used with the 'deep' merge strategy. When this flag is used, hashes within arrays are deep-merged with their counterparts by position.--explain-options: Explain whether alookup_optionshash affects this lookup, and how that hash was assembled. (lookup_optionsis how Hiera configures merge behavior in data.)--default <VALUE>: A value to return if Hiera can't find a value in data. Useful for emulating a call to the `lookup function that includes a default.--type <TYPESTRING>: Assert that the value has the specified type. Useful for emulating a call to thelookupfunction that includes a data type.--compile: Perform a full catalog compilation prior to the lookup. If your hierarchy and data only use the$facts,$trusted, and$server_factsvariables, you don't need this option. If your Hiera configuration uses arbitrary variables set by a Puppet manifest, you need this to get accurate data. Thelookupcommand doesn't cause catalog compilation unless this flag is given.--render-as s/json/yaml/binary/msgpack: Specify the output format of the results;smeans plain text. The default when producing a value isyamland the default when producing an explanation iss.
Access hash and array elements using a key.subkey notation
Access hash and array members in Hiera using a key.subkey notation.
Interpolating variables into
hiera.yamlor a data file. Many of the most commonly used variables, for examplefactsandtrusted, are deeply nested data structures.Using the
lookupfunction or thepuppet lookupcommand. If the value oflookup('some_key')is a hash or array, look up a single member of it by usinglookup('some_key.subkey').Using interpolation functions that do Hiera lookups, for example
lookupandalias.
To access a single member of an array or hash:
.) and a subkey. If the value is an array, the subkey must be an integer, for example:
users.0returns the first entry in theusersarray.If the value is a hash, the subkey must be the name of a key in that hash, for example,
facts.os.To access values in nested data structures, you can chain subkeys together. For example, because the value of
facts.system_uptimeis a hash, you can access its hours key withfacts.system_uptime.hours.
Hiera dotted notation
The Hiera dotted notation does not support arbitrary expressions for subkeys; only literal keys are valid.
A hash can include literal dots in the text of a key. For example, the value of $trusted['extensions'] is a hash containing any certificate extensions for a node, but some of its keys can be raw OID strings like '1.3.6.1.4.1.34380.1.2.1'. You can access those values in Hiera with the key.subkey notation, but you must put quotation marks — single or double — around the affected subkey. If the entire compound key is quoted (for example, as required by the lookup interpolation function), use the other kind of quote for the subkey, and escape quotes (as needed by your data file format) to ensure that you don't prematurely terminate the whole string.
aliased_key: "%{lookup('other_key.\"dotted.subkey\"')}"
# Or:
aliased_key: "%{lookup(\"other_key.'dotted.subkey'\")}"
.) then the entire key must be enclosed within single quotes within double quotes, for example, lookup("'has.dot'").