out_ferc714__georeferenced_respondents

package: pudl

Annual summary of demand and other information about FERC-714 respondents.

Most-recent data:

2024

Processing:

Data has been expanded into a wide/denormalized format, with IDs and codes accompanied by human-readable names and descriptions.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report

Primary key:

respondent_id_ferc714, report_date

Usage Warnings

  • Contains information from multiple raw inputs.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Additional Details

This table differs from out_ferc714__summarized_demand in that it also includes a geometry column describing the respondent's service territory in each year. These service territories are based on the counties that the corresponding EIA-861 respondent reported serving in that year. There is sometimes ambiguity as to whether a FERC-714 respondent should be interpreted as an individual utility or a balancing authority. The respodent_type column indicates which type of entity has been assumed in determining the service territory from EIA-861 data.

Columns
report_date

Date reported.

respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

geometry

Geospatial representation of the feature.

eia_code

EIA utility or balancing area authority ID associated with this FERC Form 714 respondent. Note that many utilities are also balancing authorities and in many cases EIA uses the same integer ID to identify a utility in its role as a balancing authority AND as a utility, but there is no requirement that these IDs be the same, and in a number of cases they are different.

respondent_type

Whether a respondent to the FERC form 714 is a utility or a balancing authority.

respondent_name_ferc714

Name of the utility, balancing area authority, or planning authority responding to FERC Form 714.

balancing_authority_id_eia

EIA balancing authority ID. This is often (but not always!) the same as the utility ID associated with the same legal entity.

balancing_authority_code_eia

EIA short code identifying a balancing authority. May include Canadian and Mexican BAs.

balancing_authority_name_eia

Name of the balancing authority.

utility_id_eia

The EIA Utility Identification number.

utility_name_eia

The name of the utility.

population

County population, sourced from Census DP1 data.

area_km2

County area in km2.

demand_annual_mwh

Annual electricity demand in a given report year.

out_ferc714__respondents_with_fips

package: pudl

Annual respondents with the county FIPS IDs for their service territories.

Most-recent data:

2024

Processing:

Data has been expanded into a wide/denormalized format, with IDs and codes accompanied by human-readable names and descriptions.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report

Primary key:

This table has no primary key. Note that the state and county FIPS columns can be null. Otherwise the natural primary key would be: ['respondent_id_ferc714', 'report_date', 'county_id_fips']. The state FIPS code is not part of the primary key because the first two digits of the county FIPS code indicate the state.

Usage Warnings

  • Contains information from multiple raw inputs.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Columns
eia_code

EIA utility or balancing area authority ID associated with this FERC Form 714 respondent. Note that many utilities are also balancing authorities and in many cases EIA uses the same integer ID to identify a utility in its role as a balancing authority AND as a utility, but there is no requirement that these IDs be the same, and in a number of cases they are different.

respondent_type

Whether a respondent to the FERC form 714 is a utility or a balancing authority.

respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

respondent_name_ferc714

Name of the utility, balancing area authority, or planning authority responding to FERC Form 714.

report_date

Date reported.

balancing_authority_id_eia

EIA balancing authority ID. This is often (but not always!) the same as the utility ID associated with the same legal entity.

balancing_authority_code_eia

EIA short code identifying a balancing authority. May include Canadian and Mexican BAs.

balancing_authority_name_eia

Name of the balancing authority.

utility_id_eia

The EIA Utility Identification number.

utility_name_eia

The name of the utility.

state

Two letter US state abbreviation.

county

County name.

state_id_fips

Two digit state FIPS code.

county_id_fips

County ID from the Federal Information Processing Standard Publication 6-4.

out_ferc714__summarized_demand

package: pudl

Summarized demand statistics and FERC-714 respondent attributes by respondent-year.

Most-recent data:

2024

Processing:

Data has been expanded into a wide/denormalized format, with IDs and codes accompanied by human-readable names and descriptions.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report

Primary key:

respondent_id_ferc714, report_date

Usage Warnings

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Columns
report_date

Date reported.

respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

demand_annual_mwh

Annual electricity demand in a given report year.

population

County population, sourced from Census DP1 data.

area_km2

County area in km2.

population_density_km2

Average population per sq. km area of a service territory.

demand_annual_per_capita_mwh

Per-capita annual demand, averaged using Census county-level population estimates.

demand_density_mwh_km2

Annual demand per km2 of a given service territory.

eia_code

EIA utility or balancing area authority ID associated with this FERC Form 714 respondent. Note that many utilities are also balancing authorities and in many cases EIA uses the same integer ID to identify a utility in its role as a balancing authority AND as a utility, but there is no requirement that these IDs be the same, and in a number of cases they are different.

respondent_type

Whether a respondent to the FERC form 714 is a utility or a balancing authority.

respondent_name_ferc714

Name of the utility, balancing area authority, or planning authority responding to FERC Form 714.

balancing_authority_id_eia

EIA balancing authority ID. This is often (but not always!) the same as the utility ID associated with the same legal entity.

balancing_authority_code_eia

EIA short code identifying a balancing authority. May include Canadian and Mexican BAs.

balancing_authority_name_eia

Name of the balancing authority.

utility_id_eia

The EIA Utility Identification number.

utility_name_eia

The name of the utility.

out_ferc714__hourly_estimated_state_demand

package: pudl

Hourly time series of estimated electricity demand for each state, scaled such that it matches the total electricity sales by state reported in EIA 861.

Most-recent data:

2024

Processing:

Data is ready for use in analyses, but for practical reasons has not been denormalized and remains in narrow format.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report

Primary key:

state_id_fips, datetime_utc

Usage Warnings

  • Contains estimated values.

  • Contains information from multiple raw inputs.

  • Large table; do not attempt to open with Excel.

  • Contains information from multiple raw inputs.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Additional Details

This table uses hourly electricity demand and information about service territories to estimate the total hourly electricity demand for each US state. Hourly demand is drawn from the FERC 714, which reports at the balancing authority and utility level. Service territories for utilities and balancing authorities are inferred from information in the EIA 861, including the counties served by each utility and the utilities that make up each balancing authority.

This table uses the total electricity sales by state reported in the EIA 861 as a scaling factor to ensure that the magnitude of electricity sales is roughly correct, and obtains the shape of the demand curve from the hourly planning area demand reported in the FERC 714.

This table includes the state FIPS codes - see out_censusdp1tract__states for additional information about FIPS state codes.

Columns
state_id_fips

Two digit state FIPS code.

datetime_utc

Date and time converted to Coordinated Universal Time (UTC).

demand_mwh

Electricity demand (energy) within a given timeframe.

scaled_demand_mwh

Estimated electricity demand scaled by the total sales within a state.

out_ferc714__hourly_planning_area_demand

package: pudl

Hourly time series of electricity demand by planning area.

Most-recent data:

2024

Processing:

Data is ready for use in analyses, but for practical reasons has not been denormalized and remains in narrow format.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report (Part III, Schedule 2a)

Primary key:

respondent_id_ferc714, datetime_utc

Usage Warnings

  • Contains rows where missing values were imputed.

  • The datetime_utc timestamps have been cleaned due to inconsistent datetime reporting. See core_ferc714__hourly_planning_area_demand for additional details.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Additional Details

This table is based on core_ferc714__hourly_planning_area_demand, but adds imputed demand values where the original data was missing or anomalous. Codes explaining why values have been imputed can be found in the core_pudl__codes_imputation_reasons table.

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

respondent_id_ferc714_csv

FERC Form 714 respondent ID from CSV reported data - published from years: 2006-2020. This ID is linked to the newer years of reported XBRL data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as respondent_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

respondent_id_ferc714_xbrl

FERC Form 714 respondent ID from XBRL reported data - published from years: 2021-present. This ID is linked to the older years of reported CSV data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as entity_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

report_date

Date reported.

datetime_utc

Date and time converted to Coordinated Universal Time (UTC).

timezone

IANA timezone name

demand_reported_mwh

Originally reported electricity demand, calculated by taking the net generation within the BA and subtracting the interchange with adjacent BAs.

demand_imputed_pudl_mwh

Electricity demand calculated by subtracting BA interchange from net generation, with outliers and missing values imputed in PUDL.

demand_imputed_pudl_mwh_imputation_code

Code describing why a demand value was flagged for imputation.

core_ferc714__respondent_id

package: pudl

Respondent identification.

Most-recent data:

2024

Processing:

Data has been cleaned and organized into well-modeled tables that serve as building blocks for downstream wide tables and analyses.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report (Part I, Schedule 1)

Primary key:

respondent_id_ferc714

Usage Warnings

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

respondent_id_ferc714_csv

FERC Form 714 respondent ID from CSV reported data - published from years: 2006-2020. This ID is linked to the newer years of reported XBRL data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as respondent_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

respondent_id_ferc714_xbrl

FERC Form 714 respondent ID from XBRL reported data - published from years: 2021-present. This ID is linked to the older years of reported CSV data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as entity_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

respondent_name_ferc714

Name of the utility, balancing area authority, or planning authority responding to FERC Form 714.

eia_code

EIA utility or balancing area authority ID associated with this FERC Form 714 respondent. Note that many utilities are also balancing authorities and in many cases EIA uses the same integer ID to identify a utility in its role as a balancing authority AND as a utility, but there is no requirement that these IDs be the same, and in a number of cases they are different.

core_ferc714__hourly_planning_area_demand

package: pudl

Hourly time series of electricity demand by planning area.

Most-recent data:

2024

Processing:

Data has been cleaned and organized into well-modeled tables that serve as building blocks for downstream wide tables and analyses.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report (Part III, Schedule 2a)

Primary key:

respondent_id_ferc714, datetime_utc

Usage Warnings

  • The datetime_utc timestamps have been cleaned due to inconsistent datetime reporting. See below for additional details.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Additional Details

This table includes data from the pre-2021 CSV raw source as well as the newer 2021 through present XBRL raw source.

This table includes three respondent ID columns: one from the CSV raw source, one from the XBRL raw source and another that is PUDL-derived that links those two source ID's together. This table has filled in source IDs for all records so you can select the full timeseries for a given respondent from any of these three IDs.

An important caveat to note is that there was some cleaning done to the datetime_utc timestamps. The Form 714 includes sparse documentation for respondents for how to interpret timestamps - the form asks respondents to provide 24 instances of hourly demand for each day. The form is labeled with hour 1-24. There is no indication if hour 1 begins at midnight.

The XBRL data contained several formats of timestamps. Most records corresponding to hour 1 of the Form have a timestamp with hour 1 as T1. About two thirds of the records in the hour 24 location of the form have a timestamp with an hour reported as T24 while the remaining third report this as T00 of the next day. T24 is not a valid format for the hour of a datetime, so we convert these T24 hours into T00 of the next day. A smaller subset of the respondents reports the 24th hour as the last second of the day - we also convert these records to the T00 of the next day.

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

respondent_id_ferc714_csv

FERC Form 714 respondent ID from CSV reported data - published from years: 2006-2020. This ID is linked to the newer years of reported XBRL data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as respondent_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

respondent_id_ferc714_xbrl

FERC Form 714 respondent ID from XBRL reported data - published from years: 2021-present. This ID is linked to the older years of reported CSV data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as entity_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

report_date

Date reported.

datetime_utc

Date and time converted to Coordinated Universal Time (UTC).

timezone

IANA timezone name

demand_mwh

Electricity demand (energy) within a given timeframe.

core_pudl__assn_ferc714_pudl_respondents

package: pudl

Entity table containing static information about PUDL-derived FERC 714 respondent IDs.

Processing:

Data has been cleaned and organized into well-modeled tables that serve as building blocks for downstream wide tables and analyses.

Source:

The Public Utility Data Liberation (PUDL) Project

Primary key:

respondent_id_ferc714

Usage Warnings

  • Contains information from multiple raw inputs.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Additional Details

These IDs are used to connect older CSV data which uses different respondent IDs than the newer XBRL entity IDs. These IDs are manually assigned when new FERC 714 data is integrated, and any newly found utilities are added to the list with a new ID. This table is read in from a CSV stored in the PUDL repository: src/pudl/package_data/glue/respondent_id_ferc714.xlsx

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

core_ferc714__yearly_planning_area_demand_forecast

package: pudl

Annual time series of 10-year forecasted summer and winter peak demand and annual net energy per planning area.

Most-recent data:

2024

Processing:

Data has been cleaned and organized into well-modeled tables that serve as building blocks for downstream wide tables and analyses.

Source:

FERC Form 714 -- Annual Electric Balancing Authority Area and Planning Area Report (Part III, Schedule 2b)

Primary key:

respondent_id_ferc714, report_year, forecast_year

Usage Warnings

  • This table includes data from the pre-2021 CSV raw source as well as the newer 2021 through present XBRL raw source. We created the respondent_id_ferc714 field to blend disparate IDs from the CSV and XBRL data over time. See the core_ferc714__respondent_id table for links to the original source IDs.

  • There is a small handful of respondents (~11) that report more than 10 years and an even smaller handful that report less than 10 (~9).

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Additional Details

This table contains forecasted net demand (MWh) as well as summer and winter peak demand (MW) for the next ten years after after the report_year.

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

report_year

Four-digit year in which the data was reported.

forecast_year

Four-digit year that applies to a particular forecasted value.

summer_peak_demand_forecast_mw

The maximum forecasted hourly sumemr load (for the months of June through September).

winter_peak_demand_forecast_mw

The maximum forecasted hourly winter load (for the months of January through March).

net_demand_forecast_mwh

Net forecasted electricity demand for the specific period in megawatt-hours (MWh).

core_pudl__assn_ferc714_csv_pudl_respondents

package: pudl

Association table providing connections between PUDL-assigned FERC714 respondent IDs and native FERC714 CSV respondent IDs originally reported as respondent_id.

Processing:

Data has been cleaned and organized into well-modeled tables that serve as building blocks for downstream wide tables and analyses.

Source:

The Public Utility Data Liberation (PUDL) Project

Primary key:

respondent_id_ferc714, respondent_id_ferc714_csv

Usage Warnings

  • Contains information from multiple raw inputs.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

respondent_id_ferc714_csv

FERC Form 714 respondent ID from CSV reported data - published from years: 2006-2020. This ID is linked to the newer years of reported XBRL data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as respondent_id. Note that this ID does not correspond to FERC respondent IDs from other forms.

core_pudl__assn_ferc714_xbrl_pudl_respondents

package: pudl

Association table providing connections between PUDL-assigned FERC714 respondent IDs and native FERC714 XBRL respondent IDs originally reported as entity_id.

Processing:

Data has been cleaned and organized into well-modeled tables that serve as building blocks for downstream wide tables and analyses.

Source:

The Public Utility Data Liberation (PUDL) Project

Primary key:

respondent_id_ferc714, respondent_id_ferc714_xbrl

Usage Warnings

  • Contains information from multiple raw inputs.

  • FERC data is notoriously difficult to extract cleanly, and often contains free-form strings, non-labeled total rows and lack of IDs. See Notable Irregularities for details.

Columns
respondent_id_ferc714

PUDL-assigned identifying a respondent to FERC Form 714. This ID associates natively reported respondent IDs from the original CSV and XBRL data sources.

respondent_id_ferc714_xbrl

FERC Form 714 respondent ID from XBRL reported data - published from years: 2021-present. This ID is linked to the older years of reported CSV data through the PUDL-assigned respondent_id_ferc714 ID. This ID was originally reported as entity_id. Note that this ID does not correspond to FERC respondent IDs from other forms.