1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
|
.. _pipeline_install:
Pipeline Releases
#################
.. note::
- A working installation of Miniconda or Anaconda is required.
- Python 2.x.x is not supported (unless noted otherwise).
- 32-bit operating systems are not supported.
Pipeline releases differ from the standard software stack and serve a different purpose. The release files described below are immutable snapshots of STScI operational software, and can be used to replicate the environment used by STScI to perform mission-specific data processing. Be aware that upgrading packages with ``conda update [pkg]`` or ``conda update --all`` is not recommended as it will likely introduce unwanted bugs and/or break the environment all together.
If you have any questions, comments, or concerns related to pipeline releases please feel free to contact help@stsci.edu
Installation
============
Pipeline release installations use the following ``conda create`` command format:
.. code-block:: sh
conda create -n [custom_env_name] --file [URL]
source activate [custom_env_name]
Example
-------
.. code-block:: sh
conda create -n demo_2016.1 \
--file http://ssb.stsci.edu/releases/hstdp/2016.1/hstdp-2016.1-linux-py35.0.txt
source activate demo_2016.1
The URL shown in this example does not necessarily reflect the latest iteration available. Please consult the :ref:`files` section to ensure you are installing the correct release.
.. _files:
File URLs
=========
Select the URL that matches your intended platform and environment.
HST Data Processing (HSTDP)
---------------------------
*HSTDP* was previously known as *OPUS*.
Instructions for installation of each delivery may be found in the respective subdirectories of the releases repository:
https://github.com/astroconda/astroconda-releases/tree/master/caldp
These deliveries are, in reverse chronological order:
.. code-block:: sh
20200323 (Note: the date here represents the initial testing iteration and not the final public release date.)
Historical deliveries using an older naming convention may be found here:
https://github.com/astroconda/astroconda-releases/tree/master/hstdp
These deliveries are, in reverse chronological order:
.. code-block:: sh
2019.3a
2019.5
2019.5.2
2019.5.1
2019.4
2019.3c
2019.3b
2019.3
2019.2
2018.3a
2018.3
2018.1
2017.3
2017.2a
2017.2
2017.1
2016.2
2016.1
Continuous Integration
======================
This example BASH function provides a starting point for users intending to execute pipeline software from within a continuous integration environment. This installation method is unsupported and your mileage may vary. Use at your own risk.
.. code-block:: sh
function get_pipeline()
{
# Do we have enough arguments?
if [[ $# < 3 ]]; then
echo "Not enough arguments."
return 1
fi
# Setup basic argument list & Example Input(s)
local conda_env="$1" # hst_env
local name="$2" # hstdp, ...
local build="$3" # 2017.2, 2016.2 ...
local python_version="$4" # py[35, 27, ...]
local iteration="$5" # final | post[0, 1, 2, ...]
# Detect platform
local _platform=$(uname -s)
local platform=""
# Convert platform string to match file naming convention
if [[ ${_platform} == Linux ]]; then
platform="linux"
elif [[ ${_platform} == Darwin ]]; then
platform="osx"
else
echo "Unsupported platform: ${_platform}"
return 1
fi
unset _platform
# Handle optional arguments.
if [[ -z ${python_version} ]]; then
# Notice the "py" prefix and condensed version here
python_version="py35"
fi
if [[ -z ${iteration} ]]; then
iteration="final"
fi
# Assemble pipeline spec file URL
local ac_root="http://ssb.stsci.edu/releases"
local ac_base="${ac_root}/${name}/${build}"
local ac_spec="${name}-${build}-${platform}-${python_version}.${iteration}.txt"
local ac_url="${ac_base}/${ac_spec}"
# Perform installation
conda create -q -n "${conda_env}" --file "${ac_url}"
return $?
}
#
# Usage example:
#
# Silently generate a pipeline environment called "hst_env"
get_pipeline hst_env hstdp 2017.2
# Enter environment
source activate hst_env
# ... do work ...
# EOF
|
