Contents
Update 2007-07-03: In June 2007 the Massachusetts ITD issued a new major release of the Enterprise Technical Reference Model. ETRM Version 4.0 identifies four specification changes in the "Summary of Technology Specifications" table. Newly added specifications include "WS-I Basic Security Profile v1.0" and "Ecma 376: Office Open XML Formats (Open XML)". Specification updates are listed for OpenDocument v1.1 and XPath v2.0. A new Management Domain document covers Web Services and Systems. See the news story "Major Revision of Massachusetts Enterprise Technical Reference Model (ETRM)."
Update 2005-10-04: On September 30, 2005 Sun Microsystems published a declaration of patent non-enforcement with respect to implementation of OASIS "Open Document Format for Office Applications (OpenDocument) v1.0". The declaration clarifies that the OpenDocument specification is under no restrictions from Sun. This irrevocable, blanket non-assertion covenant is being praised as a creative mechanism for patent management. It offers protection to Sun and the OpenDocument developer community, using a model that has no required patent disclosures and carries zero bureaucratic overhead. See Sun Patent Non-Assertion Covenant for OpenDocument Offers Model for Open Standards."
[September 26, 2005] The Commonwealth of Massachusetts has announced publication of its final version of the Enterprise Technical Reference Model Version 3.5, which became effective on September 21, 2005.
Most of the Reference Model remains unchanged from the draft Enterprise Technical Reference Model Version 3.0 released in March 2005. ETRM Final Version 3.5 incorporates a new Discipline for Data Formats within the Information Domain, including Open Formats. The decision of the Commonwealth's Information Technology Division (ITD) has been watched closely in recent weeks, given the expectation that other jurisdictions may follow the lead of Massachusetts in its definition of Open Format and in requiring the use of non-proprietary, open data formats for official documents and archives.
The ETRM Open Formats Technology Area "addresses open standards and specifications for the presentation of data as office documents, text, numbers, maps, graphics, video and audio. The selection of format must consider the access channel being used (Web, PDA, cell phone), the nature of the data and structure (legal requirements that address preservation of document structure), and ease of accessibility for users. The open formats identified below do not yet address all data types. Future versions of the ETRM will address open formats for map, graphics, video and audio data."
As presented in the ETRM Version 3.5 Introduction and Information Domain final documents of September 21, 2005, the Commonwealth defines open formats as "specifications for data file formats that are based on an underlying open standard, developed by an open community, affirmed and maintained by a standards body and are fully documented and publicly available. It is the policy of the Commonwealth of Massachusetts that all official records of the Commonwealth be created and saved in an acceptable format."
Three Open Format Technology Specifications are identified in ETRM Version 3.5: [1] OASIS Open Document Format For Office Applications (OpenDocument) v. 1.0; [2] Plain Text Format; [3] Hypertext Document Format v. 4.01.
The Data Interoperability Roadmap, together with the Roadmap for Data Formats as amended in ETRM version 3.5 declares that the "target state is the ubiquitous use of open formats to capture and store data within applications and in individual data files." In the earlier version of the ETRM Introduction, the Commonwealth clarified its intent to move from merely acceptable formats to "...open formats that are based on an underlying open standard, developed by an open community, and affirmed by a standards body as soon as they are ratified." Compare the 2005-01 statement of Eric Kriss: "We will increasingly rely on the promulgation of Open Standards for file formats by national and international standards bodies. The OASIS OpenOffice XML [OpenDocument] format technical community would be one example of that. As we look to the future, we will require full support of Open Formats, as well as already released Open Standards..."
According to the published Guidelines and Description, the XML-based OpenDocument format "must be used for office documents such as text documents (.odt), spreadsheets (.ods), and presentations (.odp). The OpenDocument format is currently supported by a variety of office applications including OpenOffice.org, StarOffice, KOffice, and IBM Workplace. The OASIS Open Document Format for Office Applications (OpenDocument) is a standardized XML-based file format specification suitable for office applications. It covers the features required by text, spreadsheets, charts, and graphical documents. The specification was recently approved by OASIS as an open standard. OASIS has also submitted the standard to ISO for consideration as an international standard for office document formats."
The Commonwealth's ETRM v3.5 identifies a migration plan for agencies that currently use office applications such as MS Office, Lotus Notes, and WordPerfect to "produce documents in proprietary formats," noting that the magnitude of the migration effort to this new open standard is considerable. Agencies will need to develop phased migration plans allowing them to configure existing applications to save office documents by default in the OpenDocument format with an implementation date of January 1, 2007. Any acquisition of new office applications must support the OpenDocument format natively."
Agencies should therefore "begin to evaluate office applications that support the OpenDocument specification to migrate from applications that use proprietary document formats. As of January 1, 2007 all agencies within the Executive Department will be required to: (1) Use office applications that provide conformance with the OpenDocument format, and (2) Configure the applications to save office documents in OpenDocument format by default."
Plain Text and HTML are identified as Open Formats in addition to OpenDocument format. Plain text "is the most portable format because it is supported by nearly every application on every machine; it should not be used for documents where formatting is important or is part of the official record. The use of Plain Text for formatting email messages reduces the likelihood of email client interoperability issues, and reduces download time for clients with dial-up connections." HTML hypertext document format "is the preferred format for documents that will be accessed through the Internet/Intranet or using a web browser." The Reference Model document notes that many documents created in proprietary formats can be saved as .html files, and specifies that "hypertext authoring or conversion software must support HTML version 4.01." Adobe's PDF is named as an "acceptable" format (though not an "open format technology specification") due to its complete lack of legal encumbrance and restricted field of use as a final/fixed display format.
Within the Data Interoperability Discipline, XML specifications have been identified as the key enabler: "One of the most critical SOA decisions for the Commonwealth is the adoption of XML as the primary standard for Data Interoperability. XML has become the lingua franca of application integration, facilitating application interoperability, regardless of platform or programming language. The adoption of XML is the cornerstone of the Commonwealth's Service Oriented Architecture (SOA) vision of a unified enterprise information environment. Agencies should consider the use of XML for all projects, and should implement XML, unless there are compelling business reasons not to do so. XML should always be considered when undertaking new work or when beginning a major overhaul of an existing system. Agencies should always consider the fact that an XML solution will result in greater long-term benefits for the agency and the enterprise as a whole."
The ETRM framework "borrows from the National Association of State Chief Information Officers (NASCIO) Enterprise Architecture Tool Kit as well as the work done by the federal government's Federal Enterprise Architecture Program. The Reference Model addresses standardization in five different domains: Access and Delivery; Information, Application, Integration, and Security. It uses the concepts of Domains, Disciplines, Technology Areas and Technology Specifications to define the enterprise architecture."
Development of the Enterprise Technical Reference Model is part of the Commonwealth's plan to transition from "siloed, application centric, and agency centric information technology investments to an enterprise approach where applications are designed to be flexible, to take advantage of shared and reusable components, to facilitate the sharing and reuse of data where appropriate and to make the best use of the technology infrastructure that is available. The technology specifications and standards detailed in this document are required to achieve the desired target state of a Service Oriented Architecture. Agencies are expected to migrate towards compliance with the ETRM as they consider new information technology investments or make major enhancements/replacement to existing systems."
Bibliographic Information
ETRM Version 3.5 Introduction "The Enterprise Technical Reference Model (ETRM) provides an architectural framework used to identify the standards, specifications and technologies that support the Commonwealth's computing environment. Version 3.5 of the Enterprise Technical Reference Model incorporates a new Discipline for Data Formats within the Information Domain. This Discipline addresses the acceptable formats in which data can be represented and captured. Implementation of the ETRM will result in a Service Oriented Architecture for the Commonwealth that uses open standards solutions where appropriate to construct and deliver online government services. Agencies are expected to migrate towards compliance with the ETRM as they consider new information technology investments or make major enhancements/replacement to existing systems..."
ETRM Version 3.5 Information Domain. Effective Date: September 21, 2005. Also in PDF and OpenDocument formats. [cache PDF]
"The ETRM Information Domain addresses standards and guidelines for: (1) Data Interoperability, (2) Data Management, (3) Data Formats, and Records Management. A process-independent, enterprise view of government information enables data sharing where appropriate within the bounds of security and privacy considerations. Service oriented architectures promote information and service reuse through open standards. To help the Commonwealth achieve the enormous benefits of information and service reuse, the Information Domain emphasizes standards for data interoperability among diverse internal and external platforms and applications. By promoting the ubiquitous use of XML standards, the ETRM specifications insure that all new development initiatives result in interoperable services that can be reused across the enterprise, as well as with external business partners and governments where appropriate..."
Final ETRM Version 3.5 Open Document Format Standard: Frequently Asked Questions. Also in PDF and OpenDocument formats. [cache PDF]
Note the answer to a question about MA agencies being asked (?) to deploy a single office product: The Final ETRM Version 3.5 does not require that agencies use only one office product. To the contrary, it offers agencies many choices. Agencies may choose to retain their existing MS Office licenses, as long as they use a method to save documents in Open Document Format. They may also use one of the many office tools that support OpenDocument Format in native format — OpenOffice, StarOffice, KOffice, Abiword, eZ publish, IBM Workplace, Knomos case management, Scribus DTP, TextMaker and Visioo Writer. Because the Open Document Format is an open standard, it increases the vendor pool available to state agencies by encouraging and permitting vendors not already in this field to develop products that support the standard. Adoption of the Final ETRM Version 3.5 will greatly increase competition among vendors for the sale of office applications to agencies.
Principal References
- Commonwealth of Massachusetts: Information Technology Division
- Commonwealth of Massachusetts ITD Key Initiative: Open Standards, Open Source
- Reference Page for Enterprise Technical Reference Model v.3.5. "The final version of the Enterprise Technical Reference Model v.3.5 is now published. ETRM v3.5, effective September 21, 2005 incorporates a new Discipline for Data Formats within the Information Domain. This Discipline addresses the acceptable formats in which data can be presented and captured." [pubURL]
- ETRM Version 3.5 Introduction. According to this Introduction, the Data Formats Discipline in the Information Domain corresponds to two Technology Areas: Open Formats and Other Acceptable Formats. As articulated in the ETRM Version 3.5 Information Domain document, the Commonwealth "defines open formats as specifications for data file formats that are based on an underlying open standard, developed by an open community, affirmed and maintained by a standards body and are fully documented and publicly available... Open formats for data files ensure that government records remain independent of underlying systems and applications thereby preserving their accessibility over very long periods of time." Three 'Technology Specifications' are classified as Open Formats according to the Commonwealth's definition and tabular presentation in the ETRM Version 3.5 Introduction: [1] OASIS Open Document Format for Office Applications (OpenDocument) v. 1.0; [2] Plain Text Format; [3] Hypertext Document Format v. 4.01. Open Formats are identified in the Roadmaps for Data Formats and Data Interoperability. The Data Interoperability Roadmap, for example: "The target state includes the ubiquitous use of XML for Data Interoperability in application development and content management as well as the use of open formats for displaying and storing data files."
- ITD Open Formats. Key documents related to the Final ETRM Version 3.5 Open Document Format Standard. [pubURL]
- Public Comments on the Draft Enterprise Technical Reference Model v.3.5:
- Public Comments Received: General [PDF, ODT, cache PDF, HTML longURL]
- Adobe Systems, Inc. From Shantanu Narayen (Adobe President and Chief Operating Officer). [PDF, ODT, cache PDF, HTML longURL]
- Corel Corporation. From Richard Carriere (General Manager, Office Productivity, Corel Corporation). [PDF, ODT, cache PDF, HTML longURL]
- IBM Corporation. From Dr. Robert S. Sutor (VP, Standards and Open Source, IBM Corporation). [PDF, ODT, cache PDF, HTML longURL]
- Microsoft Corporation. From Alan Yates (General Manager, Microsoft Corporation). [PDF, ODT, cache PDF, HTML longURL]
- Sun Microsystems. From Scott McNealy (Chairman and CEO, Sun Microsystems, Inc). [PDF, ODT, cache PDF, HTML longURL]
- Sam Hiser. Managing Director, Hiser & Adelstein. [PDF, ODT, cache PDF, HTML longURL]
- "Massachusetts Releases Enterprise Technical Reference Model Version 3.0."
- Open Format Meeting September 2005. Moderated by Daniel Bricklin (Software Garden). "On Friday, September 16, 2005, a meeting was held by the Mass Technology Leadership Council, an organization formed by a combination of the Massachusetts Software Council and the New England Business and Technology Association. The purpose of the meeting was to give feedback to the State of Massachusetts government on the latest draft iteration of their Enterprise Technical Reference Model, specifically the section on document formats. In attendance were Massachusetts Secretary of Administration and Finance Eric Kriss and CIO of the Commonwealth Peter Quinn, as well as representatives from a wide variety of Council member software companies..." Download MP3 [53.2MB, duration 1:56:16]
- Open Formats Summit Notes June 9, 2005. [HTML longURL]
- Statement from Peter Quinn on ETRM v.3.5 Public Review and Data Formats. Peter Quinn is Chief Information Officer (CIO) for the Commonwealth of Massachusetts and Director of the Commonwealth's Information Technology Division (ITD). ETRM v.3.5 "... identifies the newly ratified OASIS Open Document Format for Office Applications (OpenDocument) as our standard for office documents." [HTML longURL]
- Press and Commentary:
- "Microsoft: 'We Were Railroaded in Massachusetts on ODF'." By David Berlind. From ZDNet News (October 14, 2005).
- "U.S. State Finalizes Plans to Phase Out Office." By Elizabeth Montalbano. From InfoWorld (September 23, 2005).
- "Massachusetts Moves Ahead Sans Microsoft." By Martin LaMonica. From CNET News.com (September 23, 2005).
- "Massachusetts Verdict: MS Office Formats Out." By DesktopLinux.com Staff. From eWEEK (September 24, 2005).
- "FUD and the Lost Argument." By Simon Phipps. SunMink Blog (September 27, 2005).
- "Massachusetts Makes Smart Move Official." By Steven J. Vaughan-Nichols. From eWEEK (September 26, 2005).
- "Massachusetts Chooses OpenDocument Format." By Jay Savage. The Open Source Weblog (September 25, 2005).
- "Policy Deals Blow to Microsoft. State Adopting a New Format for Documents." By Hiawatha Bray. From Boston Globe (September 23, 2005).
- Why OpenDocument Won (and Microsoft Office Open XML Didn't)." By David A. Wheeler. September 15, 2005.
- Open Letter to Alan Yates of Microsoft KDE Project News. Referenced from Bob Sutor's Blog.
- "WordPerfect Will Support OpenDocument — Someday." By Steven J. Vaughan-Nichols. From eWEEK (September 28, 2005).
- "Microsoft, Massachusetts and a Standards Primer." Stephen Walli (former Microsoft exececutive). Blog. September 15, 2005.
- "Massachusetts Back-Room." Tim Bray. ongoing blog (September 10, 2005).
- "What Has Microsoft Done for Massachusetts Lately? [Government and Regulatory]." By Sam Hiser. From NewsForge (September 22, 2005).
- "Massachusetts and Microsoft." By Nicholas Carr (Harvard Business School). Blog entry, roughtype.com (September 19, 2005).
- "Official IBM response to the Massachusetts Enterprise Technical Reference Model v.3.5 - Public Review Draft." September 07, 2005. [original w/ typo]
- Bob Sutor (IBM): Blog on "Open standards, open source, open minds, open opportunities":
- Breaking News: Massachusetts Mandated Use of OpenDocument is FINAL
- More from the Boston Globe on OpenDocument: Talking about OpenDocument and Customer Choice
- Berlind on the Massachusetts OpenDocument Meeting
- Letter to the Editor of the Boston Globe
- eWeek Editorial Board on Massachusetts
- Stephen R. Walli on Microsoft, Standards, Massachusetts
- Nicholas Carr on Massachusetts, via David Berlind
- Microsoft strikes back at Massachusetts
- Tim Bray dissection of typical negative responses to Massachusett's draft proposal on use of the OASIS OpenDocument Format
- UN Document on Open Standards
- From the Bay State to Down Under
- Massachusetts Entry of the Day
- InformationWeek on Massachusetts and OpenDocument
- More links on the Massachusetts OpenDocument Draft Decision
- The Financial Times on the Massachusetts OpenDocument Draft Decision
- OASIS Open Office (OpenDocument) XML Format TC:
- Earlier OpenDocument news stories:
- "European Commission's IDA TAC Publishes Recommendations on Open Document Formats."
- "OASIS Open Office XML Format TC Approves Committee Draft Specification."
- "OpenOffice.org Releases Free, Open Source, Cross Platform Office Productivity Suite."
- "OpenOffice.org Releases Version 1.1 Beta for Open Source Office Productivity Suite."
- "Sun Microsystems Contributes OpenOffice.org XML File Format Specification to TC."
- "OASIS Technical Committee for Open Office XML File Format."
- General reference documents: