3d_gpu/tutorial.mdwn

   1 # Tutorial on how to get into Libre-SOC development
   2
   3 This tutorial is a guide for anyone wishing, literally, to start from scratch and learn how to contribute to the Libre-SOC.  Much of this you should go through (skim and extract) the [[HDL_workflow]] document, however until you begin to participate much of that document is not fully relevant. This one is intended to get you "up to speed" with basic concepts.
   4
   5 Discussions here:
   6
   7 * <http://lists.libre-riscv.org/pipermail/libre-riscv-dev/2020-February/004166.html>
   8
   9 # Programming vs hardware.
  10
  11 We are assuming here you know some programming language.  You know that it works in sequence (unless you went to Imperial College in the 80s and have heard of [Parlog](https://en.m.wikipedia.org/wiki/Parlog)).
  12
  13 Hardware basically comprises transistor circuits. There's nothing in the universe or the laws of physics that says light and electricity have to operate sequentially, and consequently all Digital ASICs are an absolutely massive arrays of unbelievably excruciatingly tediously low level "gates", in parallel, separated occasionally by clock-synchronised "latches" that capture data from one processing section before passing it on to the next.
  14
  15 Thus, it is imperative to conceptually remind yourself, at all times, that everything that you do, even when writing your HDL code line by line, is, in fact, at the gate level, done as massively-parallel processing, **not** as sequential processing, at all.  If you want "sequential" you have to store the results of one parallel block of processing in "latches", wait for the clock to "tick", and pass it on to the next block.
  16
  17 ASIC designers avoid going completely off their heads at the level of detail involved by "compartmentalising" designs into a huge hierarchy of modular design, where the tools selected aid and assist in isolating as much of the contextually-irrelevant detail as practical, allowing the developer to think in relevant concepts without being overwhelmed.
  18
  19 Understanding this is particularly important because the level of hierarchy of design may be *one hundred* or more modules deep *just in nmigen alone*, (and that's before understanding the abstraction that nmigen itself provides); yosys goes through several layers as well, and finally, alliance / corilolis2 have their own separate layers.
  20
  21 Throughout each layer, the abstractions of a higher layer are removed and replaced with topologically-equivalent but increasingly detailed equivalents.  nmigen has the *concept* of integers (not really: it has the concept of something that, when the tool is executed, will create a representation *of* an integer), and this is passed through intact to yosys.  yosys however knows that integers need to be replaced by wires, buses and gates, so that's what it does.
  22
  23 Thus, you can think safely in terms of "integers" when designing and writing the HDL, confident that the details of converting to gates and wires is taken care of.
  24
  25 It is also critically important to remember that unlike a software environment there is no memory or stack, only if you create an actual SRAM and lay out the gates to address it with a binary to unary selector. There is no register file unless you actually create one. There is no ALU unless you make one... and so on.  And beyond that hardware, if you forget to add something that might be needed for exceptional purposes, if it's not there you simply cannot add it later like you can in software. If it's not there, it's not there and that's the end of the discussion.  Consequently a vast amount of time goes into planning and simulation (software, FPGA and SPICE) as mistakes and omissions can literally cost tens of millions of dollars to rectify.
  26
  27 # Debian
  28
  29 Sorry, ubuntu, macosx and windows lovers: start by installing debian either in actual hardware or in a VM.  A VM has the psychological disadvantage of making you feel like you are not taking things seriously (it's a toy), so consider dual booting or getting a second machine.
  30
  31 # Python
  32
  33 First: learn python.  python3 to be precise.  Start by learning the basic data types: string, int, float then dict, list and tuple.  Then move on to functions, then classes, exceptions and the "with" statement.  Along the way you will pick up imports. Do not use "import *" it will cause you a world of pain.
  34
  35 # Git
  36
  37 Git is essential.  look up git workflow: clone, pull, push, add, commit.  Create some test repos and get familiar with it. Read the [[HDL_workflow]] document.
  38
  39 # Basics of gates
  40
  41 You need to understand what gates are.  look up AND, OR, XOR, NOT, NAND, NOR, MUX, DFF, SR latch on electronics forums and wikipedia. also look up "register latches", then HALF ADDER and FULL ADDER.  If you would like a particularly amusing relevant distraction, look up the guy who built an entire functional computer out of 74 series logic chips, on breadboards.  It's now in a museum.
  42
  43 For some reason, ASIC designers call collections of gates (such as MUXers) "Cells", no matter how large they are.  There are some more complex "Cells" such as "4-input MUX" or "3-input XOR" and so on, which should be self-explanatory.  Thus you will see the words "Cell Library" used.
  44
  45 Yes you can create your own cell libraries, however you will also see Foundries refer to things called "Standard Cell Libraries" which they  expect you to use (under NDA. sigh).
  46
  47 Also look up "boolean algebra", "Karnaugh maps", truth tables and things like that.
  48
  49 From there you can begin to appreciate how deeply ridiculously low level this all is, and why we are using nmigen.  nmigen constructs "useful" concepts like "32 bit numbers", which actually do not exist at the gate level: they only exist by way of being constructed from chains of 1 bit (binary) processing!
  50
  51 So for example, a 32 bit adder is "constructed" from a batch of 32 FULL ADDERs (actually, 31 FULL and one HALF).  Even things like comparing two numbers, the simple "==" or ">=" operators, are done entirely with a bit-level cascade!
  52
  53 This would drive you nuts if you had to think at this level all the time, consequently "High" in "High Level Language" was invented. Luckily in python, you can override \_\_add\_\_ and so on in order that when you put "a + b" into a nmigen program it gives you the *impression* that two "actual" numbers are being added, whereas in fact you requested that the HDL create a massive bunch of "gates" on your behalf.
  54
  55 i.e. *behind the scenes* the HDL uses "cells" that in a massive hierarchical cascade ultimately end up at nothing more than "gates".
  56
  57 Yes you really do need to know this because those "gates" cost both power, space, and take time to switch.  So if you have too many of them in a chain, your chip is limited in its top speed.  This is the point at which you should be looking up "pipelines" and "register latches", as well as "combinatorial blocks".
  58
  59 you also want to look up the concept of a FSM (Finite State Machine) and the difference between a Mealy and a Moore FSM.
  60
  61 ## NDAs...
  62
  63 These are a nuisance.  There are around 4 levels of NDAs to bust through:
  64 Full chip designs, peripherals and other third party components, Cell
  65 Libraries, and Foundries.  Often, the Foundries supply their own Standard Cell Libraries (see above).
  66
  67 Sometimes you want to design something not under NDA (as we do), but
  68 in order to do so you still need to know the "shape" of the Cells.
  69 Occasionally, then, the licensee of those Cells will allow you to use
  70 "phantoms", which are the same shape and have the same connections.
  71 The official Industry term for these is "phantom views".  See
  72 <http://bugs.libre-riscv.org/show_bug.cgi?id=178#c106> for discussion.
  73
  74 # nmigen
  75
  76 Once you understand gates and python, nmigen starts to make sense.
  77
  78 Nmigen works by creating an in-memory "Abstract Syntax Tree" which is handed to yosys (via yosys "ILANG" format) which in turn actually generates the cells and netlists.
  79
  80 So you write code in python, using the nmigen library of classes and helper routines, to construct an AST which *represents* the actual hardware. Yosys takes care of the level *below* nmigen, and is just a tool.
  81
  82 Install nmigen (and yosys) by following [[HDL_workflow]] then follow the excellent tutorial by Robert <https://github.com/RobertBaruch/nmigen-tutorial>
  83
  84 Pay particular attention to the bits in HDL workflow about using yosys "show" command.  This is essential because the nmigen code gets turned into gates, and yosys show will bring up a graph that allows you to see that.
  85 It's also very useful to run the "proc" and "opt" command followed by
  86 a second "show top" (or show {insert module name}).  Yosys "process"
  87 and "optimise" commands transform the design into something closer to
  88 what is actually synthesised at the gate level.
  89
  90 In nmigen, pay particular attention to "comb" (combinatorial) and "sync" (synchronous).  Comb is a sequence of gates without any clock-synchronised latches.  With comb it is absolutely essential that you **do not** create a "loop" by mistake:  i.e. combinatorial output must never, under any circumstances, loop back to combinatorial input.  "comb" blocks must be DAGs (Directed Acyclic Graphs) in other words.  "sync" will *automatically* create a clock synchronised register for you.  This is how you construct pipelines.  Also, if you want to create cyclic graphs, you absolutely **must** store partial results of combinatorial blocks in registers (with sync) *before* passing those partial results back into more (or the same) combinatorial blocks.
  91
  92 * http://www.clifford.at/yosys/cmd_proc.html
  93
  94 # verilog
  95
  96 Verilog is really worth mentioning in passing.  You will see it a lot.  Verilog was designed in the 1980s, when the state of the art in computer programming was BASIC, FORTRAN, and, if you were lucky, PASCAL.
  97
  98 Object-orientated design was a buzzword in Universities.  java did not exist.  c++ did not exist.  Consequently, even just for testing of ASICs, which were still being done at the gate level, some bright spark decided to write a test suite in a high level language.
  99
 100 That language was: verilog.
 101
 102 Soon afterwards, someone realised that actual ASICs themselves could be written *in* verilog.  Unfortunately, however, with verilog being designed on 1980s state of the art programming concepts, it has hampered ASiC design ever since.
 103
 104 We use nmigen because we can do proper OO. we can do multiple inheritance, class MixIns.  proper parameterisation and much more, all of which would be absolute hell to do in verilog.  We would need some form of massive macro preprocessing system or a nonstandard version of verilog.
 105
 106 Rather than inflict that kind of pain onto both ourselves and the rest of the world, we went with nmigen. Now you know why. hurrah.
 107
 108 p.s. here's the
 109 [full discussion](http://lists.libre-riscv.org/pipermail/libre-riscv-dev/2018-November/000171.html)