MPAS-JEDI
StatisticsDatabase.StatsDB Class Reference

Public Member Functions

def __init__ (self, conf)
 
def read (self, np=1)
 
def initAttributes (self)
 
def appendDF (self, newDiagDF)
 
def loc (self, locDict, var=None)
 
def __init__ (self, conf)
 
def read (self, np=1)
 
def initAttributes (self)
 
def appendDF (self, newDiagDF)
 
def loc (self, locDict, var=None)
 

Public Attributes

 DiagSpaceGrp
 Convert dsDict to DataFrame. More...
 
 dfw
 
 varNames
 diagnostics (currently unused) self.containedDiagNames = self.dfw.levels('diagName') More...
 
 chlist
 
 varUnitss
 extract units for each varName from varUnits DF column More...
 
 allBinVals
 bin values --> combination of numerical and string, all stored as strings More...
 
 binNumVals
 
 binNumVals2DasStr
 

Static Public Attributes

 available
 Examples of directory structures from which this container can extract statistics. More...
 
 DiagSpaceName = File[len(FILEPREFIX0):-len('.nc')]
 
 logger
 
 firstCycleDTime = conf['firstCycleDTime']
 
 lastCycleDTime = conf['lastCycleDTime']
 
 cyTimeInc = conf['cyTimeInc']
 
 fcTDeltaFirst = conf['fcTDeltaFirst']
 
 fcTDeltaLast = conf['fcTDeltaLast']
 
 fcTimeInc = conf['fcTimeInc']
 
 expDirectory
 
 expLongNames
 
 expNames
 
 cntrlExpIndex
 
 cntrlExpName
 
 noncntrlExpNames
 
 DAMethods
 
 diagnosticConfigs
 
 statsFileSubDirs
 
 fcDirFormats = conf['fcDirFormats']
 
 fcTDeltas
 
 fcTDeltas_dir
 
 fcTDeltas_totmin
 
 dumTimeDelta = fcTDeltaFirst
 
 hasFCLenDir
 
 cyDTimes_dir
 
 cyDTimes
 
 dumDateTime = firstCycleDTime
 
string cy_date_str = "{:04d}".format(dumDateTime.year) \
 
list expsDiagSpaceNames = []
 
 dateDir = self.cyDTimes_dir[0]
 
string dateDir = dateDir+'/'+self.fcTDeltas_dir[expName][0]
 
string FILEPREFIX0 = self.expDirectory+'/'+expLongName +'/'+dateDir+'/' \
 
list DiagSpaceNames = []
 
 availDiagSpaceNames
 

Detailed Description

A container class for a pandas DataFrame of
   statistics from multiple cycle and/or forecast times.

Definition at line 82 of file StatisticsDatabase.py.

Constructor & Destructor Documentation

◆ __init__() [1/2]

def StatisticsDatabase.StatsDB.__init__ (   self,
  conf 
)

Definition at line 86 of file StatisticsDatabase.py.

Here is the caller graph for this function:

◆ __init__() [2/2]

def StatisticsDatabase.StatsDB.__init__ (   self,
  conf 
)

Definition at line 86 of file StatisticsDatabase.py.

Here is the call graph for this function:

Member Function Documentation

◆ appendDF() [1/2]

def StatisticsDatabase.StatsDB.appendDF (   self,
  newDiagDF 
)

Definition at line 344 of file StatisticsDatabase.py.

Here is the call graph for this function:
Here is the caller graph for this function:

◆ appendDF() [2/2]

def StatisticsDatabase.StatsDB.appendDF (   self,
  newDiagDF 
)

Definition at line 344 of file StatisticsDatabase.py.

Here is the call graph for this function:

◆ initAttributes() [1/2]

def StatisticsDatabase.StatsDB.initAttributes (   self)

Definition at line 288 of file StatisticsDatabase.py.

Here is the caller graph for this function:

◆ initAttributes() [2/2]

def StatisticsDatabase.StatsDB.initAttributes (   self)

Definition at line 288 of file StatisticsDatabase.py.

Here is the call graph for this function:
Here is the caller graph for this function:

◆ loc() [1/2]

def StatisticsDatabase.StatsDB.loc (   self,
  locDict,
  var = None 
)

Definition at line 348 of file StatisticsDatabase.py.

Here is the caller graph for this function:

◆ loc() [2/2]

def StatisticsDatabase.StatsDB.loc (   self,
  locDict,
  var = None 
)

Definition at line 348 of file StatisticsDatabase.py.

Here is the call graph for this function:
Here is the caller graph for this function:

◆ read() [1/2]

def StatisticsDatabase.StatsDB.read (   self,
  np = 1 
)

Definition at line 211 of file StatisticsDatabase.py.

Here is the caller graph for this function:

◆ read() [2/2]

def StatisticsDatabase.StatsDB.read (   self,
  np = 1 
)

Definition at line 211 of file StatisticsDatabase.py.

Here is the call graph for this function:

Member Data Documentation

◆ allBinVals

StatisticsDatabase.StatsDB.allBinVals

bin values --> combination of numerical and string, all stored as strings

Definition at line 329 of file StatisticsDatabase.py.

◆ available

StatisticsDatabase.StatsDB.available
static

Examples of directory structures from which this container can extract statistics.

The stats*.nc files are produced by writediagstats_obsspace.py during cycling experiments. ASCII statistics file examples for cycling runs (on cheyenne): (hasFCLenDir == True or self.fcTDeltas[-1] > self.fcTDeltas[0]): statFile = '/glade/scratch/user/pandac/FC/3dvar/2018041500/{fcDirFormats}/diagnostic_stats/stats_omb_amsua_n19.nc' | | | | | | | | | ^ ^ ^ ^ ^ ^ ^ ^ expDirectory expLongName cyDTime fcTDelta statsFileSubDir statsFilePrefix DAMethod DiagSpaceName

Definition at line 102 of file StatisticsDatabase.py.

◆ availDiagSpaceNames

StatisticsDatabase.StatsDB.availDiagSpaceNames
static

Definition at line 194 of file StatisticsDatabase.py.

◆ binNumVals

StatisticsDatabase.StatsDB.binNumVals

Definition at line 332 of file StatisticsDatabase.py.

◆ binNumVals2DasStr

StatisticsDatabase.StatsDB.binNumVals2DasStr

Definition at line 333 of file StatisticsDatabase.py.

◆ chlist

StatisticsDatabase.StatsDB.chlist

Definition at line 311 of file StatisticsDatabase.py.

◆ cntrlExpIndex

StatisticsDatabase.StatsDB.cntrlExpIndex
static

Definition at line 124 of file StatisticsDatabase.py.

◆ cntrlExpName

StatisticsDatabase.StatsDB.cntrlExpName
static

Definition at line 125 of file StatisticsDatabase.py.

◆ cy_date_str

string StatisticsDatabase.StatsDB.cy_date_str = "{:04d}".format(dumDateTime.year) \
static

Definition at line 159 of file StatisticsDatabase.py.

◆ cyDTimes

StatisticsDatabase.StatsDB.cyDTimes
static

Definition at line 156 of file StatisticsDatabase.py.

◆ cyDTimes_dir

StatisticsDatabase.StatsDB.cyDTimes_dir
static

Definition at line 155 of file StatisticsDatabase.py.

◆ cyTimeInc

StatisticsDatabase.StatsDB.cyTimeInc = conf['cyTimeInc']
static

Definition at line 111 of file StatisticsDatabase.py.

◆ DAMethods

StatisticsDatabase.StatsDB.DAMethods
static

Definition at line 130 of file StatisticsDatabase.py.

◆ dateDir [1/2]

string StatisticsDatabase.StatsDB.dateDir = self.cyDTimes_dir[0]
static

Definition at line 178 of file StatisticsDatabase.py.

◆ dateDir [2/2]

string StatisticsDatabase.StatsDB.dateDir = dateDir+'/'+self.fcTDeltas_dir[expName][0]
static

Definition at line 180 of file StatisticsDatabase.py.

◆ dfw

StatisticsDatabase.StatsDB.dfw

Definition at line 281 of file StatisticsDatabase.py.

◆ diagnosticConfigs

StatisticsDatabase.StatsDB.diagnosticConfigs
static

Definition at line 132 of file StatisticsDatabase.py.

◆ DiagSpaceGrp

StatisticsDatabase.StatsDB.DiagSpaceGrp

Convert dsDict to DataFrame.

diagspace group

Definition at line 276 of file StatisticsDatabase.py.

◆ DiagSpaceName

StatisticsDatabase.StatsDB.DiagSpaceName = File[len(FILEPREFIX0):-len('.nc')]
static

Definition at line 105 of file StatisticsDatabase.py.

◆ DiagSpaceNames

list StatisticsDatabase.StatsDB.DiagSpaceNames = []
static

Definition at line 186 of file StatisticsDatabase.py.

◆ dumDateTime

StatisticsDatabase.StatsDB.dumDateTime = firstCycleDTime
static

Definition at line 157 of file StatisticsDatabase.py.

◆ dumTimeDelta

StatisticsDatabase.StatsDB.dumTimeDelta = fcTDeltaFirst
static

Definition at line 141 of file StatisticsDatabase.py.

◆ expDirectory

StatisticsDatabase.StatsDB.expDirectory
static

Definition at line 121 of file StatisticsDatabase.py.

◆ expLongNames

StatisticsDatabase.StatsDB.expLongNames
static

Definition at line 122 of file StatisticsDatabase.py.

◆ expNames

StatisticsDatabase.StatsDB.expNames
static

Definition at line 123 of file StatisticsDatabase.py.

◆ expsDiagSpaceNames

list StatisticsDatabase.StatsDB.expsDiagSpaceNames = []
static

Definition at line 175 of file StatisticsDatabase.py.

◆ fcDirFormats

StatisticsDatabase.StatsDB.fcDirFormats = conf['fcDirFormats']
static

Definition at line 136 of file StatisticsDatabase.py.

◆ fcTDeltaFirst

StatisticsDatabase.StatsDB.fcTDeltaFirst = conf['fcTDeltaFirst']
static

Definition at line 115 of file StatisticsDatabase.py.

◆ fcTDeltaLast

StatisticsDatabase.StatsDB.fcTDeltaLast = conf['fcTDeltaLast']
static

Definition at line 116 of file StatisticsDatabase.py.

◆ fcTDeltas

StatisticsDatabase.StatsDB.fcTDeltas
static

Definition at line 138 of file StatisticsDatabase.py.

◆ fcTDeltas_dir

StatisticsDatabase.StatsDB.fcTDeltas_dir
static

Definition at line 139 of file StatisticsDatabase.py.

◆ fcTDeltas_totmin

StatisticsDatabase.StatsDB.fcTDeltas_totmin
static

Definition at line 140 of file StatisticsDatabase.py.

◆ fcTimeInc

StatisticsDatabase.StatsDB.fcTimeInc = conf['fcTimeInc']
static

Definition at line 117 of file StatisticsDatabase.py.

◆ FILEPREFIX0

string StatisticsDatabase.StatsDB.FILEPREFIX0 = self.expDirectory+'/'+expLongName +'/'+dateDir+'/' \
static

Definition at line 182 of file StatisticsDatabase.py.

◆ firstCycleDTime

StatisticsDatabase.StatsDB.firstCycleDTime = conf['firstCycleDTime']
static

Definition at line 109 of file StatisticsDatabase.py.

◆ hasFCLenDir

StatisticsDatabase.StatsDB.hasFCLenDir
static

Definition at line 152 of file StatisticsDatabase.py.

◆ lastCycleDTime

StatisticsDatabase.StatsDB.lastCycleDTime = conf['lastCycleDTime']
static

Definition at line 110 of file StatisticsDatabase.py.

◆ logger

StatisticsDatabase.StatsDB.logger
static

Definition at line 106 of file StatisticsDatabase.py.

◆ noncntrlExpNames

StatisticsDatabase.StatsDB.noncntrlExpNames
static

Definition at line 126 of file StatisticsDatabase.py.

◆ statsFileSubDirs

StatisticsDatabase.StatsDB.statsFileSubDirs
static

Definition at line 134 of file StatisticsDatabase.py.

◆ varNames

StatisticsDatabase.StatsDB.varNames

diagnostics (currently unused) self.containedDiagNames = self.dfw.levels('diagName')

variables get varNames and sort alphabetically

Definition at line 310 of file StatisticsDatabase.py.

◆ varUnitss

StatisticsDatabase.StatsDB.varUnitss

extract units for each varName from varUnits DF column

Definition at line 314 of file StatisticsDatabase.py.


The documentation for this class was generated from the following file: