File Processing and Quality Control

Title: Monthly electric utility sales & revenue report with state distributions [electronic resource]

Original diskette files: All diskettes were mounted on a 5 1/4" drive of a Windows 98 PC and the diskette files were copied to the PC hard drive. To preserve the original file content, all files were transferred to a UNIX server in binary format and retain their original time and date stamps.

Processed documentation file: PDF documentation (record layouts) for all of the monthly data files was obtained from the UCLA Library.

Processed data files: The non-delimited rectangular DOS ASCII monthly data files and associated utility codes and names files were translated to ASCII CSV format with Windows DBMS/COPY using the specifications in the record layout documentation file. DBMS/COPY translation logs were checked for data translation error messages. No comparisons were made on the translated data values. Variable labels were added to the output. The input and output DBMS/COPY data dictionary statements follow:

MONTHLY DATA INPUT DATA DICTIONARY:
dictionary
extension=TXT
missing=
numeric=n
fixed=y
dictionary=dct
date=mm/dd/yyyy
variables
     1     10 c UTILITY IDENTIFICATION CODE
    11      2 c UTILITY STATE PART
    13      2 c REPORTING MONTH
    15      2 c REPORTING YEAR
    17     10 l RESIDENTIAL REVENUE (1000$)
    27     10 l RESIDENTIAL SALES (MKWH)
    37     10 l COMMERCIAL REVENUE (1000$)
    47     10 l COMMERCIAL SALES (MKWH)
    57     10 l INDUSTRIAL REVENUE (1000$)
    67     10 l INDUSTRIAL SALES (MKWH)
    77     10 l OTHER REVENUE (1000$)
    87     10 l OTHER SALES (MKWH)
    97     10 l TOTAL REVENUE (1000$)
   107     10 l TOTAL SALES
   117      1 c FILLER
endvars

MONTHLY OUTPUT DATA DICTIONARY:
dictionary
names=y
separator=,
mustsurround=n
surroundchar="
quotechar='
extension=CSV
missing=
numeric=n
fixed=n
dictionary=dct
date=mm/dd/yyyy
variables
     1     10 c UTILITY IDENTIFICATION CODE
    12      2 c UTILITY STATE PART
    15      2 c REPORTING MONTH
    18      2 c REPORTING YEAR
    21     11 l RESIDENTIAL REVENUE (1000$)
    33     11 l RESIDENTIAL SALES (MKWH)
    45     11 l COMMERCIAL REVENUE (1000$)
    57     11 l COMMERCIAL SALES (MKWH)
    69     11 l INDUSTRIAL REVENUE (1000$)
    81     11 l INDUSTRIAL SALES (MKWH)
    93     11 l OTHER REVENUE (1000$)
   105     11 l OTHER SALES (MKWH)
   117     11 l TOTAL REVENUE (1000$)
   129     11 l TOTAL SALES
   141      1 c FILLER
endvars

UTILITY CODES AND NAMES INPUT DATA DICTIONARY 1991-1992:
dictionary
extension=TXT
missing=
numeric=n
fixed=y
dictionary=dct
date=mm/dd/yyyy
variables
     1     10 c UTILITY IDENTIFICATION CODE
    11     40 c UTILITY NAME
endvars

UTILITY CODES AND NAMES OUTPUT DATA DICTIONARY 1991-1992:
dictionary
names=y
separator=,
mustsurround=n
surroundchar="
quotechar='
extension=CSV
missing=
numeric=n
fixed=n
dictionary=dct
date=mm/dd/yyyy
variables
     1     10 c UTILITY IDENTIFICATION CODE
    12     40 c UTILITY NAME
endvars

UTILITY CODES AND NAMES INPUT DATA DICTIONARY 1993-1994:
dictionary
extension=TXT
missing=
numeric=n
fixed=y
dictionary=dct
date=mm/dd/yyyy
variables
     1      7 c UTILITY IDENTIFICATION CODE
     8     36 c UTILITY NAME
    44      2 c UTILITY STATE PART
endvars

UTILITY CODES AND NAMES OUTPUT DATA DICTIONARY 1993-1994:
dictionary
names=y
separator=,
mustsurround=n
surroundchar="
quotechar='
extension=CSV
missing=
numeric=n
fixed=n
dictionary=dct
date=mm/dd/yyyy
variables
     1      7 c UTILITY IDENTIFICATION CODE
     9     36 c UTILITY NAME
    46      2 c UTILITY STATE PART
endvars