yardline_100as an input to both win probability models (not having it included was an oversight)
force_rebuildof the function
update_db()is now of hybrid type. It can rebuild the play by play data table either for the whole nflfastR era (with
force_rebuild = TRUE) or just for specified seasons (e.g.
force_rebuild = 2019:2020). The latter is intended to be used for running seasons because the NFL fixes bugs in the play by play data during the week and we recommend to rebuild the current season every Thursday.
update_db()disconnected the connection to a database provided by the argument
update_db()didn’t build a fresh database without providing the argument
update_db()no longer removes the complete data table when a numeric argument
force_rebuildis passed but only removes the rows within the table (#109)
fixed_drivewhich was not incrementing properly on drives that began following a timeout
FALSE) to the function
decode_player_ids()to activate the high efficient C++ decoder of the package
source = "old"to
fast_scraper()to enable scraping of old source. This is mostly useless as it doesn’t work for 2020 and provides less info
update_db()to allow advanced users to use other DBI drivers, such as
odbc::odbc()(please see dbplyr for more information)
clean_pbp()now fixes some bugs in jersey numbers
add_xyac()can now handle empty data frames
fast_scraper()to fail (affects multiple games of the 2020 season)
fixed_drivethat counted PAT after defensive TD as its own drive
add_xyac()breaking with some old packages
add_qb_epa()calculations being wrong for some failed 4th downs
vignette("examples")with the new
fixed_drive_resultto the output of
fast_scraper()because the NFL-provided drive info is extremely buggy
clean_pbp()now adds 4 new variables
jersey_number. These can be used to join rosters.
fumble_recovery_1_teamfor JAX games from 2011-2015
fixed_driveand corrections to
add_xyac()which adds the following columns associated with expected yards after the catch (xYAC):
series_successcaused by bad
driveinformation provided by NFL
old_game_idcolumn (useful for merging to external data that still uses this ID: format is YYYYMMDDxx)
clean_pbp()function now adds an
teams_colors_logosfor the interim name of the ‘Washington Football Team’ and the corresponding logo urls.
tidyselectversion to be >= 1.1.0
clean_pbp()now standardizes player IDs across the old (1999-2010) and new (2011+) data sources. Player IDs once again uniquely identify players, and each unique player has one unique ID (as they did before the NFL data source change):
clean_pbp()now removes all variables it is about to create to make sure nothing unexpected can happen
Added minimum version requirements to some package dependencies because installation broke for some users with outdated packages
Made a minor bug fix to catch more out-of-order plays and fixed a bug where some plays were being incorrectly dropped in older seasons
Standardized team names (e.g.
LAC) in some columns we had missed
weekfrom Expected Points models along with an update of
drive_real_start_timepre and post 2011
game_ids were overwritten during the play by play parsing
fast_scraper()now loads the raw game data from a separate raw data repo
.datafrom the rlang package (this is a major code change that takes some getting used to but we need it in preparation of a future release)
yards_gainedmore precisely defined
vignette("examples")to demonstrate Expected Points calculator
fast_scraper()for not yet played games
xgboost(>= 1.1) as the recent
xgboostupdate caused a breaking change leading to failure in adding model results to data
Added new models for Expected Points, Win Probability and Completion Probability and removed
nflscrapR dependency. This is a major change as we are stepping away from the well established
nflscrapR models. But we believe it is a good step forward. See
data-raw/MODEL-README.md for detailed model information.
Added internal functions for
Added new function
calculate_expected_points() usable for the enduser.
fast_scraper() to make it work with the NFL’s new server backend. The option
source is still available but will be deprecated since there is only one source now. There are some changes in the output as well (please see below).
fast_scraper() now adds game data to the play by play data set courtesy of Lee Sharpe. Game data include: away_score, home_score, location, result, total, spread_line, total_line, div_game, roof, surface, temp, wind, home_coach, away_coach, stadium, stadium_id, gameday
fastcraper_schedules() now incorporates Lee Sharpe’s
fast_scraper_roster() are deactivated due to the missing data source. They might be reactivated or completely dropped in future versions.
fix_fumbles() has been renamed to
add_qb_epa() as the new name much better describes what the function is actually doing.
Added progress information using the
progressrpackage and removed the
furrr progress bars.
clean_pbp() now adds the column
ìd which is the id of the player in the column
name. Because we have to piece together different data to cover the full span of years, player IDs are not consistent between the early (1999-2010) and recent (2011 onward) periods.
NEWS.md file to track changes to the package.
Fixed several bugs inhereted from
nflscrapR, including one where EPA was missing when a play was followed by two timeouts (for example, a two-minute warning followed by a timeout), and another where
play_type was incorrect on plays with declined penalties.
Fixed a bug, where
receiver didn’t name the correct players on plays with lateral passes.
The output has changed a little bit.
|game_key||RS feed game identifier.|
|game_time_local||Kickoff time in local time zone.|
|iso_time||Kickoff time according ISO 8601.|
|game_type||One of ‘REG’, ‘WC’, ‘DIV’, ‘CON’, ‘SB’ indicating if a game was a regular season game or one of the playoff rounds.|
|site_id||RS feed id for game site.|
|site_city||Game site city.|
|site_state||Game site state.|
|drive_possession_team_abbr||Abbreviation of the possession team in a given drive.|
|scoring_team_abbr||Abbreviation of the scoring team if the play was a scoring play.|
|scoring_type||String indicating the scoring type. One of ‘FG’, ‘TD’, ‘PAT’, ‘SFTY’, ‘PAT2’.|
|alert_play_type||String describing the play type of a play the NFL has listed as alert play. For most of those plays there are highlight clips available through fast_scraper_clips.|
|time_of_day||Local time at the beginning of the play.|
|yards||Analogue yards_gained but with the kicking team being the possession team (which means that there are many yards gained through kickoffs and punts).|
|end_yardline_number||Yardline number within the above given side at the end of the given play.|
|end_yardline_side||String indicating the side of the field at the end of the given play.|
|game_time_eastern -> start_time||Kickoff time in eastern time zone.|
|site_fullname -> stadium||Game site name.|
|drive_how_started -> drive_start_transition||String indicating how the offense got the ball.|
|drive_how_ended -> drive_end_transition||String indicating how the offense lost the ball.|
|drive_start_time -> drive_game_clock_start||Game time at the beginning of a given drive.|
|drive_end_time -> drive_game_clock_end||Game time at the end of a given drive.|
|drive_start_yardline -> drive_start_yard_line||String indicating where a given drive started consisting of team half and yard line number.|
|drive_end_yardline -> drive_end_yard_line||String indicating where a given drive ended consisting of team half and yard line number.|
|roof_type -> roof||One of ‘dome’, ‘outdoors’, ‘closed’, ‘open’ indicating indicating the roof status of the stadium the game was played in. (Source: Pro-Football-Reference)|
|vegas_wp||Estimated win probabiity for the posteam given the current situation at the start of the given play, incorporating pre-game Vegas line.|
|vegas_home_wp||Estimated win probability for the home team incorporating pre-game Vegas line.|
|weather||String describing the weather including temperature, humidity and wind (direction and speed). Doesn’t change during the game!|
|nfl_api_id||UUID of the game in the new NFL API.|
|play_clock||Time on the playclock when the ball was snapped.|
|play_deleted||Binary indicator for deleted plays.|
|end_clock_time||Game time at the end of a given play.|
|end_yard_line||String indicating the yardline at the end of the given play consisting of team half and yard line number.|
|drive_real_start_time||Local day time when the drive started (currently not used by the NFL and therefore mostly ‘NA’).|
|drive_ended_with_score||Binary indicator the drive ended with a score.|
|drive_quarter_start||Numeric value indicating in which quarter the given drive has started.|
|drive_quarter_end||Numeric value indicating in which quarter the given drive has ended.|
|drive_play_id_started||Play_id of the first play in the given drive.|
|drive_play_id_ended||Play_id of the last play in the given drive.|
|away_score||Total points scored by the away team.|
|home_score||Total points scored by the home team.|
|location||Either ‘Home’ o ‘Neutral’ indicating if the home team played at home or at a neutral site.|
|result||Equals home_score - away_score and means the game outcome from the perspective of the home team.|
|total||Equals home_score + away_score and means the total points scored in the given game.|
|spread_line||The closing spread line for the game. A positive number means the home team was favored by that many points, a negative number means the away team was favored by that many points. (Source: Pro-Football-Reference)|
|total_line||The closing total line for the game. (Source: Pro-Football-Reference)|
|div_game||Binary indicator for if the given game was a division game.|
|roof||One of ‘dome’, ‘outdoors’, ‘closed’, ‘open’ indicating indicating the roof status of the stadium the game was played in. (Source: Pro-Football-Reference)|
|surface||What type of ground the game was played on. (Source: Pro-Football-Reference)|
|temp||The temperature at the stadium only for ‘roof’ = ‘outdoors’ or ‘open’.(Source: Pro-Football-Reference)|
|wind||The speed of the wind in miles/hour only for ‘roof’ = ‘outdoors’ or ‘open’. (Source: Pro-Football-Reference)|
|home_coach||First and last name of the home team coach. (Source: Pro-Football-Reference)|
|away_coach||First and last name of the away team coach. (Source: Pro-Football-Reference)|
|stadium_id||ID of the stadium the game was played in. (Source: Pro-Football-Reference)|
|game_stadium||Name of the stadium the game was played in. (Source: Pro-Football-Reference)|