a 8j'@sdZddlZddlZddlmZddlmZmZddlmZddl m Z m Z m Z ddl ZddlmZmZdd lmZmZmZmZed Zd ZGd d d eZdS) z'Scraper for https://www.sofascore.com/.N)Iterable)datetimetimezone)Path)CallableOptionalUnion)BaseRequestsReader make_game_id)DATA_DIRNOCACHENOSTORETEAMNAME_REPLACEMENTS Sofascorez!https://api.sofascore.com/api/v1/c seZdZdZdddeeefeee e e feee e e ee e ffeee e e e ge ffeeedfdd ZejdddZejdd d Zdeejd d dZdeejd ddZZS)ra Provides pd.DataFrames from data available at http://www.sofascore.com. Data will be downloaded as necessary and cached locally in ``~/soccerdata/data/Sofascore``. Parameters ---------- leagues : string or iterable, optional IDs of Leagues to include. seasons : string, int or list, optional Seasons to include. Supports multiple formats. Examples: '16-17'; 2016; '2016-17'; [14, 15, 16] proxy : 'tor' or or dict or list(dict) or callable, optional Use a proxy to hide your IP address. Valid options are: - "tor": Uses the Tor network. Tor should be running in the background on port 9050. - str: The address of the proxy server to use. - list(str): A list of proxies to choose from. A different proxy will be selected from this list after failed requests, allowing rotating proxies. - callable: A function that returns a valid proxy. This function will be called after failed requests, allowing rotating proxies. no_cache : bool If True, will not use cached data. no_store : bool If True, will not store downloaded data. data_dir : Path Path to directory where data will be cached. N)leaguesseasonsproxyno_cacheno_storedata_dircsbtj|||||d||_|js^|jdjddd|jdjddd|jdjddddS)z Initialize the Sofascore reader.)rrrrrrT)parentsexist_okrmatchesN)super__init__rrrmkdir)selfrrrrrr __class__:E:\soccer\ml_env\Lib\site-packages\soccerdata/sofascore.pyr2s zSofascore.__init__)returncCstd}|jd}|||}t|}g}|dD]}||d|ddq4t||j j ddd  d j |j }||j|jS) zqRetrieve the selected leagues from the datasource. Returns ------- pd.DataFrame z-config/default-unique-tournaments/EN/footballz leagues.jsonZuniqueTournamentsidname) league_idleaguecSs|djdjdS)Nr&-r)strsplit)xr r r!_z(Sofascore.read_leagues..)regionr&) SOFASCORE_APIrgetjsonloadappendpd DataFramepipeZ_translate_leagueZassign set_indexlocZ_selected_leagueskeys sort_indexindexisinr)rurlfilepathreaderdatarkdfr r r! read_leaguesIs,     zSofascore.read_leaguesc Csd}g}|}|D]r\}}td}|j||}|||j|}t|d} | D]*} | ||j | d|j| ddq^qt |ddg} | j| jtt|j|jS) zvRetrieve the selected seasons for the selected leagues. Returns ------- pd.DataFrame zleagues/{}.jsonzunique-tournament/{}/seasonsryearr#)r&seasonr% season_idr&rD)rBiterrowsr.rformatr/r%r0r1r2Z _season_codeparser3r4r6r9r7r:r;list itertoolsproductrr) rfilemaskrZ df_leagueslkeyr&r<r=r>r?rDrAr r r! read_seasonsfs$zSofascore.read_seasonsF) force_cacher"cCsd}td}ddg}gd}|}g}|D]\\}} } |j||| } || j| j} |||  } |j| | | o|| d}t |}|ddd D]V}| || |d d |d |d |d|d|d|d|d|d|dd qt ||d ti|}q0|S)a;Retrieve the league table for the selected leagues. Parameters ---------- force_cache : bool By default no cached data is used for the current season. If True, will force the use of cached data anyway. Returns ------- pd.DataFrame zseasons/{}_{}.htmlz.unique-tournament/{}/season/{}/standings/totalr&rD) teamMPWDLGFGAGDPtsrZ standingsrrowsrPr$rZwinsZdrawsZlossesZ scoresForZ scoresAgainstZpoints) r&rDrPrQrRrSrTrUrVrWrX)r.rNrFrrGr%rE _is_completer/r0r1r2r3r4r6replacerr9)rrOrLZurlmaskidxcolsrZ mult_tablesrMskeyrDr=r<current_seasonr> season_datarowrAr r r!read_league_tablesH    zSofascore.read_league_tablecCstd}td}d}d}gd}|}g}|D]\\} } } |j|| | } || d| d} || |  }|j| | |o| d}t|}|d }|D]}|j|| | |d }|| d| d|d }|j|||o| d}t|}|d D]}|d d dks*|d d dkr|d d dkr^t |dd}t |dd}nt d}t d}| | | |d |dd t j |dtjd|dd|dd|||dd qqq4t|ttd}|jtdd|d<|gd |S)!aHRetrieve the game schedule for the selected leagues and seasons. Parameters ---------- force_cache : bool By default no cached data is used for the current season. If True, will force the use of cached data anyway. Returns ------- pd.DataFrame z%unique-tournament/{}/season/{}/roundsz.unique-tournament/{}/season/{}/events/round/{}zmatches/rounds_{}_{}.jsonz#matches/round_matches_{}_{}_{}.json)roundweekdate home_team away_team home_score away_scoregame_idr%rErYroundsrdeventsstatuscodedrZ homeScorecurrentZ awayScorenanZ roundInfoZstartTimestamp)tzZhomeTeamr$ZawayTeamr#) r&rDrdrerfrgrhrirjrk)rgrhr )Zaxisgame)r&rDrt)r.rNrFrrGr[r/r0r1intfloatr2r fromtimestamprutcr3r4r\rapplyr r6r9)rrOZurlmask1Zurlmask2Z filemask1Z filemask2r^Z df_seasonsZ all_schedulesrMr_rDZ filepath1url1r`Zreader1rarlrdZ filepath2url2Zreader2Z match_dataZ_matchrirjrAr r r! read_schedules`      $      zSofascore.read_schedule)F)F)__name__ __module__ __qualname____doc__r rSOFASCORE_DATADIRrrr(rIrurrboolrrr3r4rBrNrcr| __classcell__r r rr!rs& 4)rrJr0collections.abcrrrpathlibrtypingrrrZpandasr3_commonr r _configr r rrrr.rr r r r!s