Setting up the SGN Development Environment¶

This document describes how to set up a development environment for the SGN family of libraries. The SGN family of libraries includes:

sgn: Base library for SGN
sgn-ts: TimeSeries utilities for SGN
sgn-ligo: LSC specific utilities for SGN
sgnl: SGN inspiraL

Overview¶

The current dev environment is setup in 3 steps:

Clone the repos
(Optional) Create a new python environment
Install the packages

Clone repos¶

The repos can be cloned using the below commands. It is recommended to clone all the repos to have the complete set of tools available, in the same directory.

Note: Git LFS and Test Data¶

The sgnl library uses git-lfs to store test data. To download the test data files, install git-lfs and run git lfs install. If you have already cloned the repos, you can run git lfs pull in the respective directories to download the test data.

Clone the Repos in Order¶

Clone the repos in the order listed below. The first two are only required for the sgn-ligo library.

# First two only required for SGNL/SGN-LIGO
git clone git@git.ligo.org:greg/strike.git
git clone git@git.ligo.org:greg/stillsuit.git

# Following are required for all
git clone git@git.ligo.org:greg/sgn.git
git clone git@git.ligo.org:greg/sgn-ts.git
git clone git@git.ligo.org:greg/sgn-ligo.git
git clone git@git.ligo.org:greg/sgnl.git

Prepare Isolated Python Environment¶

Prepare a new python environment via your preferred method. Below is an example using conda.

conda create -n sgn-env python=3.10
conda activate sgn-env

Install SGN Family of Libraries¶

Install the SGN family of libraries using the below command in each respective directory, in the order listed below. To get all development dependencies, use the [dev] tag on the sgn* packages when using the local editable pip install pip install -e .. Specific commands are given below, that assume all repositories have been cloned into a common parent directory, which is the cwd at the beginning of the below.

# Install stillsuit
cd stillsuit
pip install -e .

# Install strike
cd ../strike
pip install -e .

# Install sgn
cd ../sgn
pip install -e .[dev]

# Install sgn-event
cd ../sgn-event
pip install -e .

# Install sgn-ts
cd ../sgn-ts
pip install -e .[dev]

# Install sgn-ligo
cd ../sgn-ligo
pip install -e .[dev]

# Install sgnl
cd ../sgnl
pip install -e .[dev]

As reflected above, the general order of install should be the inverse depth-sorted order of package dependencies. The order is:

stillsuit
strike
sgn
sgn-ts
sgn-event
sgn-ligo
sgnl

Test the Installation¶

To test the installation, run the below command in the sgnl/tests directory.

cd /path/to/parent/sgnl/tests
pytest

This will run the whitenoise pipeline test.

Optional: Manual Install of External Dependencies¶

In earlier versions of the libraries, some external dependencies were not installed automatically via package dependencies. Though this is not required anymore, you can manually install the below packages if needed.

The packages are listed below in terms of pip-friendly names, (conda names in parantheses).

numpy, pandas, scipy, matplotlib
torch (pytorch), pytest
confluent-kafka "python-confluent-kafka"
lalsuite, ligo-scald, python-ligo-lw

Example installs with conda:

# Basic installs
conda install -c conda-forge numpy pandas scipy matplotlib pytorch pytest

# Service installs
conda install -c conda-forge python-confluent-kafka

# LIGO installs
conda install -c conda-forge lalsuite ligo-scald python-ligo-lw