I failed the Turing Test

All posts in June 2016

pip wheel

Posted on Author vintaPosted in DevOps, PythonLeave a Reply

wheel packages Python packages (even with C extensions) into ZIP-like files: .whl, unpacks and installs them directly when using pip install --use-wheel. So you don't have to re-download and re-compile these packages every time you run pip install.

ref:
http://wheel.readthedocs.org/en/latest/
https://pip.pypa.io/en/latest/reference/pip_wheel/

$ pip install -U pip
$ pip install wheel

# archive current directory that contains a setup.py file
$ pip wheel .
$ pip install mamba_client-0.0.1-py2.py3-none-any.whl

# archive all packages in requirements.txt
$ pip wheel --wheel-dir=/tmp/wheelhouse -r requirements.txt
# or
# export PIP_WHEEL_DIR=$HOME/.cache/pip/wheels
$ pip wheel -r requirements.txt

$ pip wheel -r requirements.txt
# 之後再執行一次 pip wheel 就會出現類似這樣的訊息：
# Collecting bleach==1.2.2 (from -r requirements.txt (line 1))
#   File was already downloaded /home/travis/.cache/pip/wheels/bleach-1.2.2-py2-none-any.whl

# --no-index: Ignore package index (only looking at --find-links URLs instead).
$ pip install --use-wheel --no-index --find-links=/tmp/wheelhouse

Upload files to Amazon S3 when Travis CI builds pass

Posted on Author vintaPosted in DevOps, Python, Web DevelopmentLeave a Reply

Assume that you want to upload a xxx.whl file generated by pip wheel to Amazon S3 so that you will be able to run pip install https://url/to/s3/bucket/xxx.whl.

CAUTION! By default, only master branch's builds could trigger deployments in Travis CI.

Configuration

before_install:
  - pip install -U pip
  - pip install wheel

script:
  - python setup.py test

before_deploy:
  - pip wheel --wheel-dir=wheelhouse .

deploy:
  provider: s3
  access_key_id: "YOUR_KEY"
  secret_access_key: "YOUR_SECRET"
  bucket: YOUR_BUCKET
  acl: public_read
  local_dir: wheelhouse
  upload_dir: wheels
  skip_cleanup: true

# install from an URL directly
$ pip install https://url/to/s3/bucket/wheels/xxx.whl

ref:
https://docs.travis-ci.com/user/deployment/s3

Setup a static website on Amazon S3

Posted on Author vintaPosted in DevOps, Web DevelopmentLeave a Reply

Say that you would like to host your static site on Amazon S3 with a custom domain and, of course, HTTPS.

Create two S3 buckets

To serve requests from both root domain such as codetengu.com and subdomain such as www.codetengu.com, you must create two buckets named exactly codetengu.com and www.codetengu.com.

In this post, I assume that you want to redirect www.codetengu.com to codetengu.com.

ref:
https://docs.aws.amazon.com/AmazonS3/latest/dev/website-hosting-custom-domain-walkthrough.html

Upload your static files

$ cd /path/to/your_project_root/

$ aws s3 sync . s3://codetengu.com \
--acl "public-read" \
--exclude "*.DS_Store" \
--exclude "*.gitignore" \
--exclude ".git/*" \
--dryrun

$ aws s3 website s3://codetengu.com --index-document index.html --error-document error.html

ref:
http://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

Setup bucket policy for public accessing

In your S3 Management Console, click codetengu.com bucket > Properties > Edit bucket policy, enter:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "AddPerm",
            "Effect": "Allow",
            "Principal": "*",
            "Action": "s3:GetObject",
            "Resource": "arn:aws:s3:::codetengu.com/*"
        }
    ]
}

Setup www redirecting

In your S3 Management Console, click www.codetengu.com bucket > Properties > Static Website Hosting, choose Redirect all requests to another host name, type codetengu.com.

Now you're able to access your website via:

Configure a custom domain

In the "Setting Up a Static Website Using a Custom Domain" guide I mentioned above, it uses Amazon Route 53 to manage DNS records; In this post, I use CloudFlare as my website's DNS provider instead.

  • Create a CNAME for codetengu.com to point to codetengu.com.s3-website-ap-northeast-1.amazonaws.com
  • Create a CNAME for www.codetengu.com to point to codetengu.com.s3-website-ap-northeast-1.amazonaws.com

Yep, you CAN create a CNAME record for root domain on CloudFlare, just like your can add an "Alias" on Route 53.

Wait for the DNS records to propagate then visit https://codetengu.com/.