When you want to shut down your system, the following happens: (Ward, 2014)
init asks every process to shut down
If some processes (or a process) don’t respond, init initiates a kill with a TERM signal
If some processes (or a process) don’t respond still, init initiates a kill with a KILL signal
The system makes preparations for a shutdown
The system unmounts all of the other filesystems other than root
The system remounts the root filesystem in read-only mode (meaning you can’t write, only read)
The system writes out all of the data left over in the buffers to the filesystem (this happens during the remounting process; see (“Is the root filesystem unmounted during a Linux shutdown?,” n.d.))
The kernel reboots or stops the system
My 2 cents – just know this conceptually. The only case where you will need to go deep into the details of this will be if you need to optimize something on a Linux machine (most likely you would be doing this professionally), if you need to know the details to accomplish some other task or if you are really really curious.
As we already learned, init is important because it is a part of the booting process, as well as a part of the user space startup process. Here we talk a little bit more about init.
init is the process which starts all system services. (Shotts, 2019) init always has a PID of 1. A lot of the services which init starts are called daemon programs – programs that don’t have any user interface and do their thing in the background.
A thing to review, if you forgot – when talking about processes in general, we can say that a parent process spawns a child process. That means that the programs that init starts are its child processes and init is the parent process.
That’s it about init. Nothing too fancy. It starts a lot of essential system services (which are daemons).
References
Shotts, W. (2019). The Linux Command Line, Fifth Internet Edition. Retrieved from http://linuxcommand.org/tlcl.php. Pages 134-135
Let’s talk about how the user space starts up. To remind ourselves, there is the user space, which “regular” users can access and there is the kernel (system) space, which “regular” users can’t access. If they try to, the operating system doesn’t allow them to.
Here is roughly how the user space starts up: (Ward, 2014)
init
Essential low-level services which enable managing hardware devices and system logging
Network configuration
Mid and high-level services (such as cron (used for scheduling tasks) and printing)
Login prompts, GUIs, and other high-level applications
To remind ourselves, init is the process with the PID of 1, with which it all begins. I hope you now see why this holds – because init has the PID of 1 and it is the first step here. It is also speculated that init is how the universe was made, albeit scientist are not yet sure.
Hope you learned something useful!
References
Ward, B. (2014). How Linux Works: What Every Superuser Should Know (2nd ed.). No Starch Press. Pages 111-112
The dmesg command is used to display kernel messages. (Ward, 2014) You use this command when you want to see if a kernel is giving you an error for a particular hardware device, for example.
[2344706.158833] cache: parent cpu2 should not be sleeping
[2344706.158987] CPU2 is up
…
dmesg gives a lot of output, so be prepared. You can pipe it and use less to read through it, for example, or redirect its output in a file.
Another way to look at kernel messages (besides dmesg) is by looking at the contents of a file which is located in /var/log/kern.log. (Ward, 2014) Keep in mind that catting this file will produce a lot of output.
Thank you for reading!
References
Ward, B. (2014). How Linux Works: What Every Superuser Should Know (2nd ed.). No Starch Press. Pages 94-95
Boot loader’s job is to start the kernel – that is, to load the kernel into memory and start the kernel with a set of kernel parameters. (Ward, 2014) Kernel parameters are text-based parameters that tell the kernel about how it should start. Boot loader also selects among multiple kernels, switches between sets of kernel parameters, allows users to meddle with the kernel parameters and kernel images and provides support for booting other operating systems.
One of the most popular boot loaders is GRUB, short for Grand Unified Boot Loader. So, if you ever see some errors related to GRUB, you now know: “Oh, it’s my boot loader that’s the problem”.
To be honest, I never had to deal with boot loader problems, but I imagine they must be bad. May the force of Google help you in your quest to resolve those.
Thank you for reading!
References
Ward, B. (2014). How Linux Works: What Every Superuser Should Know (2nd ed.). No Starch Press. Pages 97-98
Today we will talk about how your computer boots up (or, equivalently, how does it start up). We will look at the first steps your computer executes when you turn it on. This will be important to understand if you ever encounter a boot-time problem. Of course, you will use Google, but having context as to what is actually happening will prove really valuable.
Your computer boots up in the following sequence of steps: (Ward, 2014)
A boot loader is ran by machine’s BIOS or boot firmware
The boot loader finds the kernel image on disk, loads it into memory, and starts it
The kernel initializes the hardware devices and its drivers
The kernel mounts the root filesystem
The kernel starts a program called init; init has PID equal to 1
init starts all of the other necessary system processes
At some point at or near the end of this entire process, you get the option to log in to your system
Let’s clarify some terms here. Let’s go one by one:
What is BIOS? BIOS stands for Basic Input/Output System and it is used to check for hardware errors andrun the boot loader. (“BIOS,” n.d.) Think of BIOS as the starting point of your computer; when you turn your computer on, it checks if all the hardware is OK and if it is, it runs the boot loader. Instead of BIOS, you can have other boot firmware (such as UEFI – Unified Extensible Firmware Interface (“Unified Extensible Firmware Interface,” n.d.)), but its job remains the same – check the hardware, if that’s OK, run the boot loader.
What is the boot loader? The boot loader is a small program whose task is to find the kernel image on disk, load it into memory and start it. (Ward, 2014). We will talk more about boot loaders in another post, but they are a small, albeit a critical piece of code which loads the kernel.
To review, the kernel is the “core” of the operating system and the root filesystem is the hierarchical filesystem starting from the root folder (/).
What is init? init is a special process whose task is to start all of the other necessary system processes and init has a PID of 1. We will also talk more about init in another post (or posts).
I think we clarified all of the terms present in this article.
A caveat for the those of you who are interested in the nitty-gritty details: initramfs can be used to mount the root filesystem.When the kernel image gets loaded by the boot loader, the kernel can mount initramfs, if it exists. This is an advanced Linux detail, but I just wanted to mention it here. More information can be found in (“About initramfs,” n.d.).
Moving on, we will talk about how Linux boots up, how it shuts down and about init – the process with which it all begins. Wow, I feel like I’m watching Lord of the Rings or something.
This is good to know because if you ever encounter any issues with any one of the things during boot-time, it will be useful to know where things went wrong and to have context on it.
In this post, I will devote a few sentences to device-related topics that, in my opinion, aren’t that important. Don’t get me wrong, you could write a couple of posts on each one of these topics, but they are not that important in your everyday use. Even though you will most likely never do anything with the information presented in this post, it does paint the picture of the Linux operating system and thus I decided to write up a few sentences on each of the topics I thought warranted it. My 2 cents would be: Read through the contents of those posts once, know that these things exist and if you ever need them, use Google to find exactly what you need for your particular purpose. The references are listed in the order in which the topics appear.
Partitioning disk devices
You can partition (and re-partition) your permanent storage devices from the command line. Although I never had the need to do this (except when I was installing my operating system), you maybe might, and that’s when you can call the big ol’ Google for help. Just know that you can do this.
df and free
The df command tells you how much free space you have on your disk drive. The free command displays the amount of free memory (RAM and swap). (Shotts, 2019)
Example:
mislav@mislavovo-racunalo:~/Linux_folder$ df
Filesystem 1K-blocks Used Available Use% Mounted on
sysfs provides a uniform view for attached devices based on their actual hardware attributes. (Ward, 2014)
You can go to /sys/devices to see all the devices. It differs from the /dev directory because /dev is designed for interacting with devices, while sysfs is designed to view device information and manage the device.
lsof
The lsof command lists open files and the processes using them. By files, I mean both regular files and files that represent other non-files, such as network resources. (Ward, 2014)
udev
udev is a device manager for the Linux kernel. (“udev,” n.d.)
udev manages devices nodes in the /dev directory and also handles all user space events raised when hardware devices are added or removed from the system. Term clarification: user space is the space of the user (different from the kernel space, which only the kernel can access) and you can think of events as messages that are sent when certain actions happen on the system.
UUID
UUID, short for Universally Unique Identifier, is a type of serial number used to identify filesystems. (Ward, 2014)
Displaying a list of mounted filesystems
To display a list of mounted filesystems, use the mount command without any arguments. (Shotts, 2019)
An example:
mislav@mislavovo-racunalo:~$ mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,nosuid,relatime,size=4001344k,nr_inodes=1000336,mode=755)
…
The format of the listing is as follows: device on mount_point type filesystem_type (options) .
Repairing filesystems
In order to repair a filesystem, you will most likely use a program called fsck. fsck stands for “file system check”. If you encounter this, you are dealing with a bad problem. May the force of Google and good luck be with you in resolving it!
What the fsck?
As I said in the last post, if you ever encounter fsck, that means that you are dealing with a bad issue with your filesystem. Therefore, people sometimes utter the words: “What the fsck?” when dealing with fsck. (Shotts, 2019)
/etc/fstab
/etc/fstab lists the devices to be mounted at the time the computer starts (also known as boot time). (Shotts, 2019)
Here is my /etc/fstab file:
mislav@mislavovo-racunalo:~$ cat /etc/fstab
# /etc/fstab: static file system information.
#
# Use 'blkid' to print the universally unique identifier for a
# device; this may be used with UUID= as a more robust way to name devices
# that works even if disks are added and removed. See fstab(5).
The rows that begin with a # are comments and are to be ignored. The first column is the device (identified by its UUID), the second is the mount point, the third is the file system type, the fourth is the options, the fifth specifies if and when a filesystem is to be backed up with the dump command and the sixth is the order in which filesystems should be checked with the fsck command (they are checked at boot (computer start up) time).
md5sum – What is it used for?
Let’s talk about something that you may encounter sometime. It’s the md5sum command. md5sum is a hash function.
Hash functions are relevant because for different inputs they produce different outputs. Even a slight difference in the input will produce massively different output. You can, for example, use the md5sum command to verify that your file is the same file on the website available for download by calculating the md5sum of your file with the md5sum command and comparing it to the md5sum of the original file (available somewhere on the website where you downloaded the file). If those two match, you can be very confident that you have the same file. If those two do not match, then you have a different file than the original.
A reader suggested adding this Linux command cheatsheet in order to help everyone out. The cheatsheet contains more than just device-related commands. It could serve as a good reference to people using the Linux command line, so I put it here.
References
Shotts, W. (2019). The Linux Command Line, Fifth Internet Edition. Retrieved from http://linuxcommand.org/tlcl.php. Page 29; Pages 208-210; Page 220; Pages 206-208
The dd command is used to copy blocks of files from one location to another. (Shotts, 2019) Its syntax is as follows:
dd if=input_file of=output_file
You can do cool stuff with it, for example, burn an operating system on a USB: (“How to create a bootable Ubuntu USB flash drive from terminal?,” n.d.)
Warning: The dd command is very powerful and if you misspecify either the if or the of argument, you can do damage to your devices. Don’t use this command lightly.