qubes-doc/developer/code/coding-style.md

layout	title	permalink	redirect_from
doc	Coding Style	/doc/coding-style/	/en/doc/coding-style/ /doc/CodingStyle/ /wiki/CodingStyle/ /trac/wiki/CodingStyle/

Coding Guidelines for Qubes Developers

Rationale

Maintaining proper coding style is very important for any large software project, such as Qubes. Here's why:

• It eases maintenance tasks, such as adding new functionality or generalizing code later,
• It allows others (as well as the future you!) to easily understand fragments of code and what they were supposed to do, and thus makes it easier to later extend them with newer functionality or bug fixes,
• It allows others to easily review the code and catch various bugs,
• It provides for an aesthetically pleasing experience when one reads the code...

Often, developers, usually smart ones, undersell the value of proper coding style, thinking that it's much more important how their code works. These developers expect that if their code solves some problem using a nice and neat trick, then that's all that is really required. Such thinking shows, however, immaturity and is a signal that the developer, no matter how bright and smart, might not be a good fit for larger projects. Writing a clever exploit for a Black Hat show is one thing - writing useful software supposed to be used and maintained for years is quite a different story. If you want to show off what a smart programmer you are, then you should become a researcher and write exploits. If, on the other hand, you want to be part of a team that makes real, useful software, you should ensure your coding style is impeccable. At Qubes project, we often took shortcuts and wrote nasty code, and this has always back fired at us, sometime months, sometime years later, the net result being we had to spend time fixing code, rather than implementing new functionality.

And here's a link to the real case (one Qubes Security Bulletin) demonstrating how the lackadaisical coding style lead to a real security bug. Never assume you're smart enough to disregard clean and rigorous coding!

General typographic conventions

• Use space-expanded tabs that equal 4 spaces. Yes, we know, there are many arguments for using "real" tabs instead of space-expanded tabs, but we need to pick one convention to make the project consistent. One argument for using space-expanded tabs is that this way the programmer is in control of how the code will look like, despite how other users have configured their editors to visualize the tabs (of course, we assume any sane person uses a fixed-width font for viewing the source code). If it makes you feel any better, assume this is just an arbitrary choice made to enforce a unified style.

• Maintain max. line length of 80 characters. Even though today's monitors often are very wide and it's often not a problem to have 120 characters displayed in an editor, maintaining shorter line lengths improves readability. It also allows others to have two parallel windows open, side by side, each with different parts of the source code.

• Naming conventions for any OS other than Windows:

  • ClassName
  • some_variable, some_function, some_argument

• Naming convention for Windows OS -- exceptionally to preserve Windows conventions please use the following:

  • ClassName, FunctionName
  • pszArgumentOne, hPipe -- use Hungarian notation for argument and variables

• Maintain a decent amount of horizontal spacing, e.g. add a space after if or before { in C, and similar in other languages. Whether and where to also use spaces within expressions, such as (x*2+5) vs. (x * 2 + 5) is left to the developer's judgment. Do not put spaces immediately after or before the brackets in expressions, so avoid constructs like this: if ( condition ) and use ones like this: if (condition) instead.

• Use single new lines ('\n' aka LF) in any non-Windows source code. On Windows, exceptionally, use the CRLF line endings (--). This will allow the source code to be easily viewable in various Windows-based programs.

• Use descriptive names for variables and functions! Really, at a time when most editors have auto-completion features, there is no excuse for using short variable names.

• Comments should be indented together with the code, e.g. like this:

  for (...) {
      // The following code finds PGP private key matching the given public key in O(1)
      while (key_found) {
          (...)
      }
  }
  

File naming conventions

• All file names written with small letters, use dash to separate words, rather than underscores, e.g. qubes-dom0-update. Never use spaces!

File naming in Linux/Unix-like systems:

• User commands that operate on particular VMs (also those accessible in VMs): /usr/bin/qvm-*
• User commands that apply to the whole system (Dom0 only): /usr/bin/qubes-*
• Auxiliary executables and scripts in /usr/libexec/qubes/ (Note: previously we used /usr/lib/qubes but decided to change that)
• Helper, non-executable files in /usr/share/qubes/
• Various config files in /etc/qubes
• Qubes RPC services in /etc/qubes-rpc. Qubes RPC Policy definitions (only in Dom0) in /etc/qubes-rpc/policy/
• All VM-related configs, images, and other files in /var/lib/qubes/
• System-wide temporary files which reflect the current state of system in /var/run/qubes
• Logs: either log to the system-wide messages, or to /var/log/qubes/

File naming in Windows systems:

• All base qubes-related files in C:\Program Files\Invisible Things Lab\Qubes\ (Exceptionally spaces are allowed here to adhere to Windows naming conventions)
• Other, third-party files, not Qubes-specific, such as e.g. Xen PV drivers might be in different vendor subdirs, e.g. C:\Program Files\Xen PV Drivers

General programming style guidelines

• Do not try to impress with your coding kung-fu, do not use tricks to save 2 lines of code, always prefer readability over trickiness!

• Make sure your code compiles and builds without warnings.

• Always think first about interfaces (e.g. function arguments, or class methods) and data structures before you start writing the actual code.

• Use comments to explain non-trivial code fragments, or expected behavior of more complex functions, if it is not clear from their name.

• Do not use comments for code fragments where it is immediately clear what the code does. E.g. avoid constructs like this:

  // Return window id
  int get_window_id (...) {
      (...)
      return id;
  }
  

• Do not use comments to disable code fragments. In production code there should really be no commented or disabled code fragments. If you really, really have a good reason to retain some fragment of unused code, use #if or #ifdef to disable it, e.g.:

  #if 0
      (...)   // Some unused code here
  #endif
  

  ... and preferably use some descriptive macro instead of just 0, e.g.:

  #if USE_OLD_WINDOW_TRAVERSING
      (...)   // Some unused code here
  #endif
  

  Not sure how to do similar thing in Python... Anyone?

But generally, there is little excuse to keep old, unused code fragments in the code. One should really use the functionality provided by the source code management system, such as git, instead. E.g. create a special branch for storing the old, unused code -- this way you will always be able to merge this code into upstream in the future.

• Do not hardcode values in the code! The only three numbers that are an exception here and for which it is acceptable to hardcode them are: 0, 1 and -1, and frankly the last two are still controversial...

Source Code management (Git) guidelines

• Use git to maintain all code for Qubes project.

• Before you start using git, make sure you understand that git is a decentralized Source Code Management system, and that it doesn't behave like traditional, centralized source code management systems, such as SVN. Here's a good introductory book on git. Read it.

• Qubes code is divided into many git repositories. There are several reasons for that:

  • This creates natural boundaries between different code blocks, enforcing proper interfaces, and easing independent development to be conducted on various code parts at the same time, without the fear of running into conflicts.
  • By maintaining relatively small git repositories, it is easy for new developers to understand the code and contribute new patches, without the need to understand all the other code.
  • Code repositories represent also licensing boundaries. So, e.g. because core-agent-linux and core-agent-windows are maintained in two different repositories, it is possible to have the latter under a proprietary, non-GPL license, while keeping the former fully open source.
  • We have drastically changed the layout and naming of the code repositories shortly after Qubes OS R2 Beta 2 release. For details on the current code layout, please read this article.

Commit message guidelines

Please attempt to follow these conventions when writing your Git commit messages:

• Separate the subject line from the body with a blank line.
• Limit the subject line to approximately 50 characters.
• Capitalize the subject line.
• Do not end the subject line with a period.
• Use the imperative mood in the subject line.
• Wrap the body at 72 characters.
• Use the body to explain what and why rather than how.

For details, examples, and the rationale behind each of these conventions, please see this blog post, which is the source of this list.

Security coding guidelines

• As a general rule: untrusted input is our #1 enemy!

• Any input that comes from untrusted, or less trusted, or just differently-trusted, entity should always be considered as malicious and should always be sanitized and verified. So, if your software runs in Dom0 and processes some input from any of the VMs, this input should be considered to be malicious. Even if your software runs in a VM, and processes input from some other VM, you should also assume that the input is malicious and verify it.

• Use untrusted_ prefix for all variables that hold values read from untrusted party and which have not yet been verified to be decent, e.g.:

     read_struct(untrusted_conf);
     /* sanitize start */
     if (untrusted_conf.width > MAX_WINDOW_WIDTH)
         untrusted_conf.width = MAX_WINDOW_WIDTH;
     if (untrusted_conf.height > MAX_WINDOW_HEIGHT)
         untrusted_conf.height = MAX_WINDOW_HEIGHT;
     width = untrusted_conf.width;
     height = untrusted_conf.height;
  

• Use others variables, without the untrusted_ prefix to hold the sanitized values, as shown above.

Python-specific guidelines

• Please follow the guidelines here, unless they were in conflict with what is written on this page.

C and C++ specific guidelines

• Do not place code in *.h files.
• Use const whenever possible, e.g. in function arguments passed via pointers.
• Do not mix procedural and objective code together -- if you write in C++, use classes and objects.
• Think about classes hierarchy, before starting to implement specific methods.

Bash-specific guidelines

• Avoid writing scripts in bash whenever possible. Use python instead. Bash-scripts are Unix-specific and will not work under Windows VMs, or in Windows admin domain, or Windows gui domain.