morevna / builder

Created 7 months ago
Maintained by bw
Members 4
Konstantin Dmitriev committed 4 months ago

run all commands from root (as superuser)

install dependency packages:
    you need: bash sudo uuid-runtime aufs-tools fuse genisoimage mutt
    for apt based OS use command:
        apt-get install bash sudo uuid-runtime aufs-tools fuse genisoimage mutt

create and edit config file:
    use as a base:

    we use config (some_path is a fake):
        chrooter() {
            export CHROOTER_PREFIX="/some_path_to_mount"
            $BASE_DIR/chrooter/ $@
        export EMAIL_FAILED=""
        export EMAIL_SUBJECT="builder task finished"

    for emails configure ~/.muttrc, for example:
        set smtp_url=smtps://
        set from="My Mail Bot <>"
        set record=
    see "background tasks" below

download virtual environment:
    you may download our (we are Morevna Project team) os images from:

    you need two files:
    approximate 6.5Gb, place both into chrooter/images/

build virtual environment:
    if you does not want to download os images you can build it

    before begin you may configure debian mirror in files:
        env/debian-7-32bit/ into variable apt_mirror
        env/debian-7-64bit/ into variable apt_mirror

    here you still can download a base debian images from:
    approximate 500Mb, place first into env/debian-7-32bit and second into env/debian-7-64bit

    or build these images from scratch by debootstrap
    install debootstarp:
        apt-get install debootstrap
    and build base debian images
        cd env/debian-7-32bit # go to env/debian-7-32bit
        cd ../debian-7-64bit  # go to env/debian-7-64bit
        cd ../..              # go back
    after that will appear two new files:

    now when you have files debian-wheezy-XXXX.iso you can build os images for builder
    it's a long process because it will build GCC and MinGW from scratch
    run commands:
        cd env/debian-7-32bit # go to env/debian-7-32bit
        ./       # just to copy base os image into chrooter/images
        ./            # a long build process
        cd ../debian-7-64bit  # go to env/debian-7-64bit
        ./       # just to copy base os image into chrooter/images
        ./            # a long build process
        cd ../..              # go back

    build environment ready

installation done

also you may download full backets build data made by us:
approximate 20Gb compressed and 75Gb after decompress
NB: build data contains a lot of hardlinks so make sure that you unpack it properly (tar -xf)

Let's build something:

now you may build packages by macro script:
    see files ./build-*.sh

also you can add hooks to publish built packages:
    for example create file publish/ with content:
        cp "$1" /var/www/public/downloads/
    when build is done new synfigstudio packge will placed into web-site directory
    you may look file publish/ for more info

run internal builder commands in virtual environment:
    cd env
    ./ some_command

also you may use:

run build commands in native environment
    ./ some_command

build a selected package:
    cd env
    ./ env_release MEGAPROGRAM-1.0.0

take files from directory

"dry_run" option for paranoics:
    ./ dry_run with_deps unpack MEGAPROGRAM-1.0.0 

List of commands
    <action> <packet>
        do <action> for <packet>
        List of actions:
        - download
        - unpack
        - build
        - install
        - install_release
        - envdeps
        - envdeps_release
        - env
        - env_release

    dry_run <any other command>
        - simulate activity

    with_deps <command> <packet>
        - execute <command> for <packet> and all deps
          for example, you can call download for all deps without build:
       with_deps download mypacket

    clean_ACTION <packet>
        - remove all data of completed ACTION for <packet>
        ex.: clean_unpack MEGAPROGRAM-1.0.0

    clean_all_unpack <packet>
        - cleans download and unpack
        see: clean_ACTION <packet>

    clean_all_env <packet>
        - cleans install, install_release, envdeps, envdeps_release, env and env_release
        see: clean_ACTION <packet>

    clean_all_install <packet>
        - cleans all env and build
        see: clean_all_env <packet>, clean_ACTION <packet>

    clean_all <packet>
        - remove all data of all completed actions for <packet>

    set_undone_ACTION <packet>
    set_undone_all_unpack <packet>
    set_undone_all_env <packet>
    set_undone_all_install <packet>
    set_undone_all <packet>
        - mark ACTION incomplete for <packet>, but keep action data
        see: clean_* comands

    shell <packet>
        - run shell in environment of <packet>

    chain <command> chain <other_command> ...
        - run several command sequentially wihtout remounting of environment to increase speed

see also

Background tasks:
    to call task in background use: some_command
    command will run in background and result will be sent to email (see
    if you do not want to receive emai about success result (look only errors), call: -q some_command
    logs stored in log/background.log

    sometimes virtual environmens does not unmounted properly
    to clear this you need to unmount all mounts for */chrooter-*
    look mounts list by command:

    unmount by command:
        umount "/some_path/chrooter-SOME_UUID"
    or with "force" option
        umount -f "/some_path/chrooter-SOME_UUID" 
    or with "lazy" option
        umount -l "/some_path/chrooter-SOME_UUID" 
    and check againt with

    after that remove the files
    you MUST do unmount before, if some dir are still mounted you can remove some system files
    we recommend to check content of directories before remove
    option "--one-file-system" for additional protection but anyway BE CAREFULL!!
        rm -rf --one-file-system /some_path/chrooter-*