Joint Astronomy Centre
Show document only
JAC Home
JCMT
UKIRT
Contact info
JAC Divisions
OMP
Outreach
Seminars
Staff-only Wiki
Weather
Web Cameras
____________________

JCMT home
Observing at JCMT
OMP Observation Manager
Telescope
Spectral Line Observing
Continuum Observing
Schedule
Data Archive
Future Developments
Legacy Surveys
Newsletter & Publications
JCMT Software Group

Introduction

For most of the last few years the efforts of the JCMT software group have been fairly tightly focussed on the on-line control and data-acquisition systems, and particularly on development on the Vax computers. However, in the last year or so our focus has begun to widen. The installation of Unix systems, which began in 1992, is now well underway. With increased software support, we now have the ability to address other areas, such as off-line utilities and enhanced data reduction facilities. Although the basic framework for the on-line systems is now relatively stable, it's limitations are becoming more obvious, and we are starting to consider some more major design changes in order to provide a more flexible and efficient system.

Individual areas which will have specific impact on Users are described in the following articles. The purpose of this article is to give a broad overview of the main areas of work currently being undertaken by the JCMT software group, and a general indication of our plans for the future.

Main Areas of Work

The efforts of the group falls into four main areas:

* continued development of the on-line system (support for new instrumentation, support for engineering work, new observing modes).

* development of facilities for visiting astronomers, including support of utilities and `wishlist' items and on-site data reduction.

* investigations and developments of new systems (e.g. the database).

* maintenance (bug fixes, ADAM and Starlink Upgrades, etc).

The distribution of effort between these categories is such that approximately half our effort goes into continued development of the existing system, approximately 10% into utilities and wishlist items, and around 30% into new systems. The number of known bugs in the on-line system is now rather small but new ones continue to surface from time to time. These, together with the usual maintenance requirements takes the remainder of the efforts of the group.

The following sections explore the three main areas in more detail.

Continued Development of the On-line System

As noted, this continues to take the bulk of the effort of the software group. The obvious major item is preparation for new instrumentation - RxB3, RxW and SCUBA. JAC staff are working closely with each of the instrument groups to ensure that the integration of these instruments into the JCMT control system goes as smoothly as possible. An area which has grown in importance as the telescope matures is to provide computing support for new engineering projects. For example, software development has been required for the acquisition and reduction of carousel strain gauge data, and we are now working with astronomers and engineers on the new inclinometry system. Support for the instrument group has also increased in the past year or so; with projects such as improved ICL procedures to simplify the measurement of receiver efficiencies. Interferometry is another project which has required considerable software effort.

Finally, we are continuing to make significant developments to the observation control system. A prototype scheme for heterodyne rastering with the DAS is under development. We plan to make more general improvements to the DAS software (improved calibration techniques, more flexible configuration software) in the fall, in collaboration with Hans van Someren Greve, who will be visiting from Dwingeloo. We also continue to investigate methods of reducing the observing overheads. We have recently moved a Vaxstation 4000/60 to the summit, to take some of the general system overheads off MWTVAX, and we are considering replacing MWTVAX with a model 4000, if the work required to install the appropriate SCSI interfaces is not prohibitive.

Facilities for Visiting Astronomers

Apart from actually improving the software involved in the real-time data acquisition, we are also trying to improve the ancilliary service provided to visiting astronomers.

One of the most visible manifestations of this has been the provision of Unix workstations at the summit, at Hale Pohaku and in Hilo. These facilities are briefly described in a following article by Remo Tilanus. As noted by Remo, the Unix versions of SPECX and JCMTDR should be available soon; many of the most popular alternative data reduction packages are also available (with data input via FITS). Although CLASS might be the most common alternative to SPECX, we have already had visiting astronomers reduce their data with IRAF - complete with graphical displays labelled in Angstroms! Along with the introduction of the Unix systems, we have installed an improved guest account allocation procedure, which will give visiting astronomers access to a private account accessible at all sites on both Unix and VMS systems.

We are also starting to devote some time to software items which do not have a major impact on the observing system, but which make life a little bit easier or simpler for visiting astronomers - the `wishlist' and improved support for `utilities'. Wishes are simple upgrades to the on-line system which do not require a serious specification or project plan. Utilities on the other hand are generally off-line packages which have been written outside the software group (either by local support staff or other establishments) and which we are now helping to support.

As a starting point for the wishlist, we have collected all the outstanding requests from local support staff, along with input from visiting astronomers into a single document - `The software wishlist' (MTUN/154). This summarises existing requests, and their current status - either in progress, pending due to lack of effort, or rejected as being either too ambitious or not considered to be worth the effort. This latter determination has of course been made after consultation with support scientists, and we will continue to have regular meetings of the JCMT science group to assess the relative merits of proposed work. Examples of recently or almost completed `wishes' include the addition of phase and transmission data to UKT14 data-files, and the provision of spectral-line fivepoints. Users who would like to look at the current wishlist should use anonymous FTP to get the file

\tt/pub/jac\_docs/jcmt\_docs/mtun154.tex

As noted in MTUN/154, visiting astronomers are encouraged to e-mail to Mary Fuka any requests which they might have for these sorts of small improvements.

Until recently, the utilities were not supported by the software group. Although we certainly don't wish to imply that only members of the software group are competent to write software, there have been problems in the past with multiple divergent copies of the same item, and with packages being `broken' either by upgrades to the on-line system or simply the genuine passage of time (e.g. changing ephemerides). Starting with the most important items, our plan is to move the software into a single central location, identical over sites and as far as possible operating systems, and clearly identify the support scientist(s) and member of the software group who will take responsibility for continued development and correct installation.

Finally, in all of this work we hope to significantly improve the documentation available to users. We will be working closely with Henry Matthews in this area to make documentation more accessible (both physically and in terms of content). We expect to make much of this documentation available on-line via the World Wide Web, and encourage users to explore this system.

Recent and Proposed New Developments

One of the largest new developments which has come to fruition in the last year has been the installation of Unix systems in Hilo, at JACH and at the summit. Although these are currently being used mainly for data reduction and new applications such as the database, we do plan to slowly migrate the real-time systems away from the Vaxes. The first instance of this will be SCUBA, which will use the Unix version of ADAM.

The relational database management system itself is described by Remo Tilanus in an accompanying article. As well as forming the basis for the astronomical data archive, this will provide us with powerful tools to manage instrument and other engineering data.

We have in the last few months started considering some more major re-designs of the on-line systems. Although we now have a stable, relatively bug-free and reasonably flexible implementation of the observing schemes as first envisaged 5-10 years ago, as the system has matured this very process has caused it's shortcomings to become more obvious.

We are continuing to modify the observation control task (CONTROL) to provide additional observing modes and improved efficiency, but it is clear that CONTROL is nearing the end of its useful life. One of our primary goals therefore is to replace this task (and associated ICL procedures) with a more efficient and flexible system which also provides the additional features missing from the current system. An upgrade or replacement for the existing GSD data-storage system, which is also failing to meet current demands, will probably be done at the same time.

Apart from the CONTROL task, at a lower level we wish to upgrade the software associated with controlling the telescope. The actual telescope servo is closed in a PDP which is unique at the JCMT, is poorly documented and contains custom interfaces. The fact that it has performed as well as it has is a tribute to the original design, but it really needs to be replaced by a more maintainable system. At the same time, control of a lot of the the existing hard-wired analog electronics (interlock monitoring systems and so forth) could be moved into the new telescope computer. This will allow us to implement some much-requested improvements to the operator interface. Finally, we would move some of the near real-time processing currently performed by the Vax into this telescope computer.

SCUBA will be delivered as a Unix ADAM system, and will come with a user interface based on a queueing system executing pre-defined observation definitions . Although initially this system will be separate from the heterodyne system, we will be working towards providing a consistent interface to the two systems. The current JCMT instrument development programme includes the delivery of a heterodyne array receiver (initially 16 elements) and matching multiple-input DAS in 1998. This will have control requirements far in excess of the existing heterodyne equipment. Finally, we wish to generally improve the user interface, and particularly improve error reporting and logging facilities.

In performing these upgrades, we will be constrained by the requirement that any new system will have to interface to a significant amount of existing software; we are certainly not going to re-implement everything from scratch. However, we are investigating whether there are tools other than, or in addition to ADAM which it may be appropriate to use. For example, the Tcl command language, and its graphical interface Tk has become a widespread de facto standard in the scientific community. It has already been interfaced to the ADAM message system at ROE and may well be used for the SCUBA queueing system.

A second possibility that we are considering is the use of the AAO real-time system, DRAMA, for new developments to the control system. Developed at the AAO as a result of experience gained with ADAM, it is portable across operating systems, has an efficient message system, and interfaces well to modern standards such as X and Tcl/Tk. An enormous attraction of DRAMA is it's ability to interface to an existing ADAM system, both from the point of view of exchanging messages, and in terms of the similar paradigm. The possibility that the appropriate parts of DRAMA might be easily ported to run under OS/9 is something which we intend to investigate further.

Given the potential impact of Gemini and UKIRT development at the JAC, we have not ruled out the possibility of using EPICS for parts of the system. Once again, this is a package which is generating widespread interest in the astronomical community. It might be particularly attractive for the `PDP replacement' for example where it would be well suited to the monitoring of motor drive currents, antenna leg temperatures, general weather parameters, emergency stop interlocks and so on. It is not clear yet however whether the benefits of EPICS outweigh it's costs, especially when a GUI competitive to that provided by EPICS exists in TCL/Tk.

Final Remarks

The requirements for new instrumentation are rather well defined and efforts to prepare for these will be given the highest priority. Our plans for the support of utilities and wishlist items are also well in hand. The route forward on major new upgrades is somewhat less clear - for example, we are currently awaiting with interest the outcome of the ADAM Review, and are also monitoring closely the changing plans of the Gemini Controls Group. At the moment we are using the current system along with a variety of other input to provide the baseline specification for future upgrades, and are still exploring the potential of new tools such as TCL/Tk. However, we hope to start work in earnest on some of these developments in the next six months.

I hope that this article has given a flavour of where we are going. If anyone would like more information, or has any comments or suggestions they should feel free to contact me.

Richard Prestage, JAC

Contact: Antonio Chrysostomou. Updated: Tue Aug 17 17:32:12 HST 2004

Return to top ^