To distribute python code, we need to package it and host it somewhere, so that users can install and use it. If the code is public, it can be published to PyPi or any public repository, so that anyone can access it. If the code is private, we need to provide proper authentication mechanism before allowing users to access it.
In this article, we will see how to use pip to install Python packages hosted on GitLab, GitHub, Bitbucket or any other services.
To package python project, we need to create
setup.py file which is build script for setuptools. Below is a sample setup file to create a package named
import setuptools with open("README.md", "r") as fh: long_description = fh.read() setuptools.setup( name="library", version="0.0.1", author="chillaranand", author_email="email@example.com", description="A simple python package", long_description=long_description, url="https://github.com/chillaranand/library", packages=setuptools.find_packages(), classifiers=[ "Programming Language :: Python :: 3", "License :: OSI Approved :: MIT License", "Operating System :: OS Independent", ], )
Python provides detailed packaging documentation on structuring and building the package.
Once module(s) is packaged and pushed to hosting service, it can be installed with pip.
# using https $ pip install git+https://github.com/chillaranand/library.git # using ssh pip install git+ssh://firstname.lastname@example.org/chillaranand/library.git
This usually requires authentication with usersname/password or ssh key. This setup works for developement machines. To use it in CI/CD pipelines or as a dependency, we can use tokens to simplify installation.
$ export GITHUB_TOKEN=foobar $ pip install git+https://$GITHUB_TOKEN@github.com/chillaranand/library.git
In this article, we have seen how to package python code and install private packages with pip. This makes it easy to manage dependencies or install packages on multiple machines.