OpenStack Hacker養成指南

                                                                              

• 希望本文能夠解開你心中縈繞已久的心結，假如是死結，請移步到 https://wiki.openstack.org/wiki/Main_Page

• 學習OpenStack其實就是學習各種Python庫的過程。

• 把OpenStack的設計原則貼在你的牆上。 https://wiki.openstack.org/wiki/BasicDesignTenets

1 OpenStack Hacker

• 態度：開放、主動、溝通

• 影響力：能說、能寫、能分享

• 四化：自動化、流程化、系統化、文檔化

2 基礎技能

Python

• 書籍:

  • 《python參考手冊》

  • 《python基礎教程》

• 教程: Codecademy

• 挑戰: Python Challenge

• 文檔: Python v2.7.3 documentation

• 高階:

  • The Hitchhiker's Guide to Python!

  • Python Module of the Week

Linux

• 書籍:

  • 鳥哥的Linux私房菜

  • 《Unix環境高級編程》

  • 《UNIX系統編程》

Git

• 書籍：

  • Pro Git

  • GotGitHub

• 教程：

  • tryGit

  • GitImmersion

• 進階：

  • visual-git-guide

  • a-successful-git-branching-model

• 最常用的git命令： Everyday GIT With 20 Commands Or So

Unittest

• 教程: python unittest

3 OpenStack 基礎

The 5-minute Overview

OpenStack is  a global collaboration of developers and cloud computing technologists  producing the ubiquitous open source cloud computing platform for public and private clouds.  The project aims to deliver solutions for all types of clouds by being  simple to implement, massively scalable, and feature rich. The  technology consists of a series of interrelated projects delivering various components for a cloud infrastructure solution. OpenStackcontrols large pools of compute, storage, and networking resources throughout  a datacenter, all managed through a dashboard that gives administrators  control while empowering their users to provision resources through a  web interface. 

OpenStack 基本概念

• 介紹： https://www.openstack.org/software/

• Compute管理員手冊(必看)：http://docs.openstack.org/trunk/openstack-compute/admin/content/ch_getting-started-with-openstack.html

• OpenStack End User Guide(必看): http://docs.openstack.org/user-guide/content/

• Network管理員手冊：http://docs.openstack.org/folsom/openstack-network/admin/content/

• Object Storage管理員手冊：http://docs.openstack.org/folsom/openstack-object-storage/admin/content/

• OpenStack文檔：http://docs.openstack.org/

• OpenStack詞彙表：http://docs.openstack.org/glossary/content/glossary.html

• 使用命令行管理openstack: http://docs.openstack.org/cli/quick-start/content/index.html

• OpenStack Wiki: https://wiki.openstack.org/wiki/Main_Page

簡單安裝 OpenStack

環境設置

爲了快速安裝OpenStack,你要設置最快的apt源(或者設置yum源)和pypi源。

• 設置apt源：http://blog.ubuntusoft.com/ubuntu-update-source.html

• 設置pypi源：http://www.v2ex.com/t/75316

你也可以搭建自己的apt源和pypi源：

• 搭建apt源：

  • http://blog.ef.net/2012/10/26/unbutu-release-upgrade-with-local-apt-mirror.html

  • http://www.cnblogs.com/kulin/archive/2012/08/08/2628400.html

• 搭建pypi源：

  • https://pypi.python.org/pypi/bandersnatch

devstack 安裝

• 使用devstack安裝 http://devstack.org

• 閱讀devstack.sh腳本 http://devstack.org

• screen的使用：http://www.9usb.net/201002/linux-screen-mingling.html

devstack使用screen管理OpenStack各個服務，所以你要用screen調試OpenStack。

packstack(RHEL,CentOS) 安裝

• git倉庫: https://github.com/stackforge/packstack

• quickstart: http://openstack.redhat.com/Quickstart

deb包安裝

• 使用VirtualBox安裝OpenStack

• 在Ubuntu 12.04上安裝OpenStack Folsom版(FlatDHCP+Multihost)

• Ubuntu12.04.2 OpenStack Grizzly 安裝（Bridge）

 

調戲 OpenStack

• pdb：

  • http://docs.python.org/2/library/pdb.html

  • http://blog.csdn.net/hackerain/article/details/8373597

  • http://www.ibm.com/developerworks/cn/linux/l-cn-pythondebugger/

Python基本庫

WSGI

• eventlet.wsgi: http://eventlet.net/doc/examples.html#wsgi-server

• webob: http://webob.org/

• pecan: http://pecanpy.org/

• wsme: http://pythonhosted.org/WSME/

• paste: http://pythonpaste.org/

• routes: http://routes.readthedocs.org/en/latest/

重要的庫

• SQLAlchemy:http://www.sqlalchemy.org/

• libvirt: http://libvirt.org/index.html

• logging: http://docs.python.org/2/howto/logging-cookbook.html

• greenlet: http://greenlet.readthedocs.org/en/latest/

• eventlet: http://eventlet.net/

• kombu: http://kombu.readthedocs.org/en/latest/

• oslo.config: https://wiki.openstack.org/wiki/Oslo#oslo.config

• stevedore: http://stevedore.readthedocs.org/en/latest/

TESTING

• PythonTestingToolsTaxonomy: http://wiki.python.org/moin/PythonTestingToolsTaxonomy (all in one)

• testtools：https://readthedocs.org/projects/testtools/

• mox：http://code.google.com/p/pymox/wiki/MoxDocumentation

• mock：http://www.voidspace.org.uk/python/mock/

• tox：http://tox.readthedocs.org/en/latest/

• fixtures：https://pypi.python.org/pypi/fixtures

• testscenarios：https://pypi.python.org/pypi/testscenarios/

• nose：https://nose.readthedocs.org/en/latest/

• testrepository：https://testrepository.readthedocs.org/en/latest/MANUAL.html

OpenStack基礎組件

在OpenStack中，有一個重要的項目叫做Oslo(原名是openstack-common),給OpenStack其他項目提供基礎組件。

• https://wiki.openstack.org/wiki/Oslo

RPC組件

• RPC組件

• http://blog.ftofficer.com/2010/03/translation-rabbitmq-python-rabbits-and-warrens/

• http://www.rabbitmq.com/tutorials/tutorial-six-python.html

• http://docs.openstack.org/developer/nova/devref/rpc.html

WSGI

• http://archimedeanco.com/wsgi-tutorial/

OpenStack 代碼規範

• Python PEP8 規範: http://www.python.org/dev/peps/pep-0008/

• OpenStack HACKING 規範: https://github.com/openstack-dev/hacking/blob/master/HACKING.rst

Python 深入學習

理解python中optparse.OptionParser類。 http://docs.python.org/library/optparse.html

理解collections.Mapping類。 http://docs.python.org/library/collections.html

分析淺拷貝，深拷貝 http://blog.csdn.net/winterttr/article/details/2590741http://longmans1985.blog.163.com/blog/static/70605475200991603624942/ http://book.51cto.com/art/200806/77233.htm

LoggerAdapter類  http://docs.python.org/howto/logging-cookbook.html#context-info中。

介紹rabbitmq http://blog.ftofficer.com/2010/03/translation-rabbitmq-python-rabbits-and-warrens/http://kombu.readthedocs.org/en/latest/introduction.html#synopsis

Python Decorators入門 http://blog.csdn.net/beckel/article/details/3585352

Python @classmethod @staticmethod的區別。http://www.libaoyin.com/2013/08/06/pyhton-staticmethod-classmethod/

五分鐘理解元類（Metaclasses）http://www.cnblogs.com/coderzh/archive/2008/12/07/1349735.html

nova中用到的python知識 http://canx.me/2011/12/%E4%B8%80%E4%BA%9Bpython/

 python中類的總結 http://ipseek.blog.51cto.com/1041109/802243

with的總結  http://effbot.org/zone/python-with-statement.htm

Pool類   http://nullege.com/codes/search/eventlet.pools.Pool

paste模塊 http://pythonpaste.org/

python魔術方法 http://pycoders-weekly-chinese.readthedocs.org/en/latest/issue6/a-guide-to-pythons-magic-methods.html

Routes模塊 http://routes.readthedocs.org/en/latest/index.html

yield學習

• http://www.pythonclub.org/python-basic/yield

• http://blog.donews.com/limodou/archive/2006/09/04/1028747.aspx

• http://www.ibm.com/developerworks/cn/opensource/os-cn-python-yield/

• http://www.jeffknupp.com/blog/2013/04/07/improve-your-python-yield-and-generators-explained/

4 OpenStack 整體架構

架構圖

必看：

• http://ken.pepple.info/openstack/2012/09/25/openstack-folsom-architecture/

• http://www.solinea.com/2013/06/15/openstack-grizzly-architecture-revisited/

• http://www.slideshare.net/mirantis/open-stack-architecture-overviewmeetup662013

工作流

Keystone Workflow

必看：

• https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_keystone_workflow_token_scoping?lang=zh

• http://docs.openstack.org/trunk/openstack-compute/admin/content/keystone-concepts.html

Nova Workflow

必看：

• https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_nova_api?lang=en

• http://ilearnstack.com/2013/04/26/request-flow-for-provisioning-instance-in-openstack/comment-page-1/

n

OpenStack 核心項目

對各個項目簡要分析：http://www.slideshare.net/randybias/state-of-the-stack-april-2013 核心項目的分析：

• Keystone：

  • http://docs.openstack.org/developer/keystone/

  • http://www.slideshare.net/openstackindia/openstack-keystone-identity-service

• Glance：

  • http://docs.openstack.org/developer/glance/

• Nova：

  • http://docs.openstack.org/developer/nova/

  • https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_nova_scheduler_and_its_algorithm27?lang=en

• Cinder：

  • http://docs.openstack.org/developer/cinder/

  • Cinder grizzly deep dive pub

• Neutron：

  • http://docs.openstack.org/developer/neutron/

  • http://www.slideshare.net/openstackindia/openstack-quantum-16710792

  • http://www.slideshare.net/lewtucker/openstack-quantum-network-service

  • http://www.slideshare.net/openstackindia/openstack-quantum-18418306

• Horizon：

  • http://docs.openstack.org/developer/horizon/

• Swift：

  • http://docs.openstack.org/developer/swift/

  • http://blog.csdn.net/alex890714/article/details/7314780

  • Swift架構與實踐

• Oslo：

通用機制的分析：

• quota: http://blog.csdn.net/hackerain/article/details/8223125

• policy: http://blog.csdn.net/hackerain/article/details/8241691

5 OpenStack 部署/管理

OpenStack 自動化部署

Puppet:

• https://wiki.openstack.org/wiki/Puppet-openstack

• https://github.com/stackforge/puppet-openstack

• https://puppetlabs.com/solutions/openstack/

Fule: Mirantis出品的部署工具，從裸機到OpenStack組件再到HA全部搞定

• https://fuel.mirantis.com/

OpenStack 監控

• OpenStack 監控: http://www.mirantis.com/blog/openstack-monitoring/

6 參與 OpenStack 社區

都在這裏:https://wiki.openstack.org/wiki/Main_Page

• 山頭： https://review.openstack.org/#/admin/groups

• 向社區提交Patch：https://wiki.openstack.org/wiki/How_To_Contribute

• gerrit的使用：https://wiki.openstack.org/wiki/Gerrit_Workflow

• Review別人的Patch：https://review.openstack.org

• 參與IRC Meeting：

  • https://wiki.openstack.org/wiki/Meetings

  • https://wiki.openstack.org/wiki/Mailing_Lists

  • https://wiki.openstack.org/wiki/People

• 參與郵件列表討論：https://wiki.openstack.org/wiki/Mailing_Lists

• 跟蹤OpenStack項目的發展：

  • http://www.openstack.org/blog/

  • http://planet.openstack.org/

  • https://wiki.openstack.org/wiki/Special:RecentChanges

  • http://github.com/openstack

  • https://github.com/stackforge/ (You will like it)

  • https://github.com/openstack-dev/

  • https://github.com/openstack-infra

• 學習CI：http://ci.openstack.org/

7 OpenStack 二次開發

• 開發Nova的擴展API：

  • https://www.ibm.com/developerworks/community/blogs/e93514d3-c4f0-4aa0-8844-497f370090f5/entry/openstack_nova_api?lang=zh

  • https://wiki.openstack.org/wiki/WritingRequestExtensions

  • http://stephanfr.com/2013/04/07/creating-an-openstack-keystone-helloworld-extension/

  • http://www.cnblogs.com/willier/archive/2013/05/22/3092961.html

• 開發Cinder的driver：

  • 新的driver必須滿足 Minimum Features,參考同類型的driver，依葫蘆畫瓢。

8 OpenStack 生態圈

• OpenStack幕後的公司：http://www.chenshake.com/behind-the-openstack-company

• State of The Stack：http://www.slideshare.net/randybias/state-of-the-stack-april-2013 (一針見血)

• OpenStack貢獻排行榜：http://stackalytics.com/

• OpenStack實踐分享：http://www.mirantis.com/blog/ (mirantis是目前最成功的OpenStack系統集成商)