This book focuses on counting processes and continuous-time Markov chains motivated by examples and applications drawn from chemical networks in systems biology. The book should serve well as a supplement for courses in probability and stochastic processes. While the material is presented in a manner most suitable for students who have studied stochastic processes up to and including martingales in continuous time, much of the necessary background material is summarized in the Appendix. Students and Researchers with a solid understanding of calculus, differential equations and elementary probability and who are well-motivated by the applications will find this book of interest. David F. Anderson is Associate Professor in the Department of Mathematics at the University of Wisconsin and Thomas G. Kurtz is Emeritus Professor in the Departments of Mathematics and Statistics at that university. Their research is focused on probability and stochastic processes with applications in biology and other areas of science and technology. These notes are based in part on lectures given by Professor Anderson at the University of Wisconsin – Madison and by Professor Kurtz at Goethe University Frankfurt.