How to calculate PET, SPI, SPEI and Palmer drought indices in Python? | Jalal | Research Society

Подписаться 8 тыс.

Просмотров 15 тыс.

50% 1

Please subscribe to my channel:
/ @drjalal90
Data download link:
www.drought.gov/data-maps-too...
Alternative link: github.com/monocongo/climate_...
Documentation for indices calculation:
climate-indices.readthedocs.i...
How to install Python in Anaconda:
• How to install Anacond...
Command line:
#PET monthly
process_climate_indices --index pet --periodicity monthly --netcdf_temp ./nclimgrid_lowres_tavg.nc --var_name_temp tavg --output_file_base ../results/nclimgrid_lowres --calibration_start_year 1951 --calibration_end_year 2010
#SPI daily
process_climate_indices --index spi --periodicity daily --netcdf_precip ./cmorph_lowres_daily_conus_prcp.nc --var_name_precip prcp --output_file_base ../results/cmorph_lowres_daily_conus --scales 30 90 --calibration_start_year 1998 --calibration_end_year 2016
#SPI monthly
process_climate_indices --index spi --periodicity monthly --netcdf_precip ./nclimgrid_lowres_prcp.nc --var_name_precip prcp --output_file_base ../results/nclimgrid_lowres --scales 6 12 --calibration_start_year 1951 --calibration_end_year 2010
#SPEI monthly
process_climate_indices --index spei --periodicity monthly --netcdf_precip ./nclimgrid_lowres_prcp.nc --var_name_precip prcp --netcdf_pet ./nclimgrid_lowres_pet.nc --var_name_pet pet --output_file_base ../results/nclimgrid_lowres --scales 9 18 --calibration_start_year 1951 --calibration_end_year 2010
#Palmers monthly
process_climate_indices --index palmers --periodicity monthly --netcdf_precip ./nclimgrid_lowres_prcp.nc --var_name_precip prcp --netcdf_pet ./nclimgrid_lowres_pet.nc --var_name_pet pet --netcdf_awc ./nclimgrid_lowres_soil.nc --var_name_awc awc --output_file_base ../results/nclimgrid_lowres --calibration_start_year 1951 --calibration_end_year 2010
My profile: researchsociety20.org/founder...
ResearchGate profile: www.researchgate.net/profile/...
Activities of Research Society: researchsociety20.org/our-act...
English Corner of Research Society: researchsociety20.org/documen...
Training Material Of Research Society: researchsociety20.org/trainin...
My Facebook page: / researcherjalal
The following important videos are recommended to watch:
1. Data analysis and plotting with NCL: • Data analysis and plot...
2. Data analysis and plotting in Matlab: • MATLAB
3. How to write a scientific paper: • Scientific Paper writing
4. Please visit the playlist to find more resources: / mdjalaluddindmjalal90

Опубликовано:

1 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 130

@DrJalal90 2 года назад

Data download link: www.drought.gov/data-maps-tools/climate-and-drought-indices-python-spi-spei-pet Alternative link: github.com/monocongo/climate_indices

@khairullahkhairullah205 2 года назад

Thank you very much Jalal for the video. It's useful for me.

@agirl3517 Год назад

Hey did your command run?

@supercomedy86 8 месяцев назад

thank you and much appreciated Dr.Lal

@DrJalal90 6 месяцев назад

Thanks

@muhammadasyrofialkindy8066 2 года назад

Thank you sir

@Hydroclim Год назад

Thank you Dr. Jalal for the great video. I was just wondering about the calibration start year and calibration end year. Could you please provide a bit more insight on them? As an example, I want to calculate spei for 1970-2010 dataset. So my calibration start and end year would be 1970 and 2010. I wonder if it would be needed to use some of this data for calibration, such as 1970-1980.

@lankz2050 3 года назад

Thank you sir...👌

@DrJalal90 3 года назад

Welcome

@DrJalal90 3 года назад

Python free online training for international participants The training will start on 20 September 2021. Deadline for registration: 15 September 2021 Registration link: researchsociety20.org/registration/ Download link for training outline: www.dropbox.com/s/aybmuw0rrxu7zjb/Outline_python_International.png?dl=0 Event link: fb.me/e/XMyJYOwn Please share the event with your friends or colleagues.

@agirl3517 Год назад

Hello sir, can we open this output in ArcMap and if yes, how will it look in spatial format, since we can open netcdf in ArcMap

@yahayaibrahim6790 2 года назад

Hi, Mr Jalal can u please show us how to calculate PET,SPEI using penman monteith method. Tnx

@travelwonder 4 месяца назад

Hi Dr. Jalal, The link provided for data have been obsolete. Can you provide a new link where the data for tutorial can be found? Thanks

@christophergama1588 5 месяцев назад

The dataset containing precipitation values should it be only in txt file format.? or other format can also work such as CSV file etc

@mohd.sayeedulhasan8902 3 года назад

great

@DrJalal90 3 года назад

Thank you.

@DrJalal90 3 года назад

@olgasolvas7751 Год назад

Hello! Thank you for sharing this video. I found it really informative and I appreciate the effort you put into creating it. However, I wanted to let you know that the links you have provided in the video description do not seem to be working properly. When I clicked on the links, they did not download the same file as the one you mentioned in the video, and they did not work as expected. I hope you share the source file, as I am really interested in accessing the resources you mentioned. Thank you again for sharing your expertise with us.

@DrJalal90 Год назад

climate-indices.readthedocs.io/en/latest/

@user-cz9nr8cu3n 9 месяцев назад

Hello Dr. Jalal.Thank you for this great tutorial.Can you make a video how to claculate sri in netcdf.

@DrJalal90 9 месяцев назад

Thanks. I will try.

@user-cz9nr8cu3n 9 месяцев назад

Thank you! Looking forward to your update, and thank you very much for your video@@DrJalal90

@pawansoyam6702 2 года назад

Please make video on extraction and export into csv of MODIS level 2 AOD data in Python

@riezkymaisyar4038 Год назад

hallo sir, i have question, how i change the dimention my file nc using nco on windows? because my data have parameter like precip(time, lat, lon) instead like precip(lat, lon, time), how i can change the order? thank you

@arkchannel7830 3 года назад

please continue this video and done SPEI calculation for us

@DrJalal90 3 года назад

Everything is there. Please follow the instructions.

@arkchannel7830 3 года назад

@@DrJalal90 thank you very much

@DrJalal90 3 года назад

@mahsabozorgi 3 месяца назад

Thank you very much for the useful video and channel. I have a question. In command line I put the full address of input and output data. I faced this error "--output_file_base: command not found" Do you know the solution?Thanks

@agirl3517 Год назад

Sir thankyou for the package and video. I am getting this error, process_climate_indices is not recognised, please sir help me with this problem I have tried changing path. But it is still showing same error

@mohammedkareem6476 3 года назад

thanks

@DrJalal90 3 года назад

Welcome

@DrJalal90 3 года назад

@mohammedkareem6476 3 года назад

@@DrJalal90 thanks

@tugbaozturk1664 3 года назад

Thank you very much for the video. What about calculating PET by using Hargreaves equation?

@DrJalal90 3 года назад

Sorry, I am not familiar with Hargreaves equation.

@DrJalal90 3 года назад

@shammunulislam4235 2 года назад

If you use R, you can use CDT package to calculate PET using Hargreaves equation

@SANTHOSHKUMAR-rx3eo Год назад

Sir the zip file is not showing in that link, it was removed

@valeriabedoyapineda7574 2 года назад

Hello, thank you very much for the explanation. I have a problem I get the error "ValueError: Unable to calculate Pearson Type III parameters due to invalid L-moments", do you know how to solve it?

@DrJalal90 2 года назад

Sorry, I don’t know.

@cherryleheu3985 2 года назад

Hello! Do you know of any Python packages that takes a .csv file as an input and calculates SPI using a calibration period?

@DrJalal90 2 года назад

The following video might help you. How to calculate drought index SPI | Jalal | Research Society ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-WTlqwq1K29c.html

@samirahasani9508 2 года назад

hi jalal, when i use the given example data the code work, but when i use my own precipitation data (cmip6) i face with error. moreover cdo doesn't know the structure of given precip data in example, would you pls explain?

@DrJalal90 2 года назад

Please send me the screenshot of CDO.

@ibrahimerkol4511 2 года назад

Thanks again for the video, I tried to run the code but I get "FileNotFoundError: [Errno 2] No such file or directory" type of an error. Could you please help me solve the problem dear professor. I already changed directory for the file in which the NC file is located. Thanks in advance

@DrJalal90 2 года назад

You need to check the working directory carefully.

@travelwonder 3 месяца назад

Hi Mr Jalal, can you again check if this code is working fine. I am using the procedure for CHIRPS netcdf data and code is reading data and starting calculation but then giving error messages. I have checked the data carefully and netcdf data is all fine. I will be thankful if you could check again and guide me. Thanks

@user-lq6uc9bo6k Год назад

hi can I ask why I get the error? UserWarning: resource_tracker: There appear to be 8 leaked semaphore objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d '

@DrJalal90 Год назад

Hello dear, I have no idea.

@Chandramani106 3 года назад

Please make of video calculating the same parameters using Jupyter notebok platform

@DrJalal90 3 года назад

I will try.

@DrJalal90 3 года назад

@mayanktyagi9022 9 месяцев назад

Respected sir, Sir I want to calculate the SPEI of a basin . Should it be necessary to calculate the grided SPEI of that basin, or any another method of calculation of the SPEI.

@DrJalal90 9 месяцев назад

You may use station data. Here is a software so called climpact2: climpact-sci.org/assets/climpact2-user-guide.pdf

@rosscherin7051 3 года назад

Hi Jalal! Thank you for this great tutorial. However, I am getting an error while calculating the SPI at the end. "File "c:\users\dell\anaconda3\lib\site-packages\xarray\core\variable.py", line 1068, in chunk data = da.from_array(data, chunks, name=name, lock=lock, **kwargs) TypeError: from_array() got an unexpected keyword argument 'meta'" Can you please suggest to me what I should do to fix it?

@DrJalal90 3 года назад

Please check the following link. www.gitmemory.com/issue/monocongo/climate_indices/435/866770257

@yahayaibrahim6790 2 года назад

Is very helpful and educative, The link you put to download the indices_python_beta_v1.2.zip is not responding? Any other alternative. Tnx

@DrJalal90 2 года назад

Yes, please check the highlighted comment.

@Chandramani106 3 года назад

What does the 'scale 30 90' or 'scales 6 12' signify? Does it signify the spatial grid or the time scale?

@DrJalal90 3 года назад

30-day and 90-day timescales climate-indices.readthedocs.io/en/latest/#spi-monthly

@Chandramani106 3 года назад

@@DrJalal90 thank you bhai

@tadessemosissa7226 2 года назад

I am very interested ur video. could send me the codes used for the process climate indices calculation in your video.

@DrJalal90 2 года назад

Please check the video description.

@ibrahimerkol4511 2 года назад

Thanks for the video, it's super helpful. Yet, I couldn't reach out to the zip file. The link you provided for data download in the description says page or link not found. Could anyone please share with the zip file? I couldn't find it anywhere at all. Thanks in advance

@DrJalal90 2 года назад

github.com/monocongo/climate_indices

@ibrahimerkol4511 2 года назад

Thank you so much for your return, yet the files in the link do not match with yours in the video :(((

@DrJalal90 2 года назад

climate-indices.readthedocs.io/en/latest/

@musafirgabut8053 Год назад

@@DrJalal90 @Dr. Jalal Sorry mr Jalal, i couldn't reach out the zip file from your current link. Please share again. Thanks a lot.

@jorgearmandohernandezlopez8080 3 года назад

Thank Jalal's, I have information monthly in file Raster but i dont know convertion in nc. Can you help me?. I work in arcgis but i cant transformation file. Thank

@DrJalal90 3 года назад

In ArcGIS, there is an option to save raster to netcdf file.

@DrJalal90 3 года назад

@songtanglei7539 2 года назад

great video，but when my nc file not the same as that in the example，error occurs，anyone can tell how can i change the attributes in my pre data。

@DrJalal90 2 года назад

No ideas.

@Hydroclim 2 года назад

I have faced the same issue. Please let me know if you found a solution.

@Hydroclim 2 года назад

I managed to process by changing attributes of my netcdf file (chirps monthly precipitation) using jupyter notebook. #open and slice your netcdf file pr_month = xr.open_dataset('/Precipitation/chirps-v2.0.monthly.nc') pr_month = pr_month['precip'] pr_month = pr_month.sel(longitude=slice(71,73),latitude=slice(31,33),time=slice('1981-01-01','2010-01-01')) #changing attributes pr_month = pr_month.rename({'latitude':'lat','longitude':'lon','time':'time'}) pr_month.attrs["units"]='millimeter' preferred_dims = ('lat', 'lon', 'time') pr_month = pr_month.transpose(*preferred_dims) #save update netcdf file pr_month.to_netcdf('Precipitation/processed_pr_monthly.nc')

@agirl3517 Год назад

In your " A comprehensive statistical assessment of drought indices to monitor drought status in Bangladesh" u have used spei using R . Why didn't you use it using this python software when it was spei was available? Also I am unable to download this python software for spi and spei by NIDIS now, has it been removed or is the link change? Please help me with this

@DrJalal90 Год назад

www.drought.gov/data-maps-tools/climate-and-drought-indices-python-spi-spei-pet

@DrJalal90 Год назад

github.com/monocongo/climate_indices

@chandrakantkadam1953 3 года назад

if SPI calculator in Excel format is available? Pls, share just to understand the calculations.

@DrJalal90 3 года назад

I will inform you if I find it.

@DrJalal90 3 года назад

@local9692 3 года назад

I keep getting this error. ImportError: DLL load failed while importing _arpack: The specified procedure could not be found.

@DrJalal90 3 года назад

What was your command?

@local9692 3 года назад

@@DrJalal90 $ process_climate_indices --index palmers --periodicity monthly --netcdf_precip ./nclimgrid_lowres_prcp.nc --var_name_precip prcp --netcdf_pet ./nclimgrid_lowres_pet.nc --var_name_pet pet --netcdf_awc ./nclimgrid_lowres_soil.nc --var_name_awc awc --output_file_base ../results/nclimgrid_lowres --calibration_start_year 1951 --calibration_end_year 2010 Traceback (most recent call last): File "c:\users\bikra\anaconda3\lib unpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "c:\users\bikra\anaconda3\lib unpy.py", line 87, in _run_code exec(code, run_globals) File "C:\Users\bikra\anaconda3\Scripts\process_climate_indices.exe\__main__.py", line 4, in File "c:\users\bikra\anaconda3\lib\site-packages\climate_indices\__main__.py", line 14, in from climate_indices import compute, indices, utils File "c:\users\bikra\anaconda3\lib\site-packages\climate_indices\compute.py", line 9, in import scipy.stats File "c:\users\bikra\anaconda3\lib\site-packages\scipy\stats\__init__.py", line 388, in from .stats import * File "c:\users\bikra\anaconda3\lib\site-packages\scipy\stats\stats.py", line 180, in from . import distributions File "c:\users\bikra\anaconda3\lib\site-packages\scipy\stats\distributions.py", line 8, in from ._distn_infrastructure import (entropy, rv_discrete, rv_continuous, File "c:\users\bikra\anaconda3\lib\site-packages\scipy\stats\_distn_infrastructure.py", line 23, in from scipy import optimize File "c:\users\bikra\anaconda3\lib\site-packages\scipy\optimize\__init__.py", line 387, in from .optimize import * File "c:\users\bikra\anaconda3\lib\site-packages\scipy\optimize\optimize.py", line 36, in from ._numdiff import approx_derivative File "c:\users\bikra\anaconda3\lib\site-packages\scipy\optimize\_numdiff.py", line 6, in from scipy.sparse.linalg import LinearOperator File "c:\users\bikra\anaconda3\lib\site-packages\scipy\sparse\linalg\__init__.py", line 114, in from .eigen import * File "c:\users\bikra\anaconda3\lib\site-packages\scipy\sparse\linalg\eigen\__init__.py", line 9, in from .arpack import * File "c:\users\bikra\anaconda3\lib\site-packages\scipy\sparse\linalg\eigen\arpack\__init__.py", line 20, in from .arpack import * File "c:\users\bikra\anaconda3\lib\site-packages\scipy\sparse\linalg\eigen\arpack\arpack.py", line 43, in from . import _arpack ImportError: DLL load failed while importing _arpack: The specified procedure could not be found.

@Mr.Goetia 3 года назад

The (Data Download Link) is not working! The page is not available.

@DrJalal90 3 года назад

github.com/monocongo/climate_indices

@Mr.Goetia 3 года назад

@@DrJalal90 Thank you very much!

@DrJalal90 3 года назад

@rohitprasadshaw1032 Год назад

Sir can I calculate ARIDITY INDEX using python ? help me plz🙏🙏 from INDIA

@DrJalal90 Год назад

I have no idea.

@hilmaniipaya258 3 года назад

How do I convert my timeseries from a csv file to a netcdf file?

@DrJalal90 3 года назад

stackoverflow.com/questions/56293164/convert-time-series-data-from-csv-to-netcdf-python

@DrJalal90 3 года назад

You can do it in NCL. www.ncl.ucar.edu/Training/Workshops/KState/Scripts/CSV_Files/

@DrJalal90 3 года назад

@sin168gh 2 года назад

sir can you please explain what are times scales 1,3,6,12 months..please solve my problem

@DrJalal90 2 года назад

doi.org/10.1175/2009JCLI2909.1

@DrJalal90 2 года назад

Please read the paper carefully.

@DrJalal90 2 года назад

Do you understand Bengali?

@DrJalal90 2 года назад

মডেল ভিত্তিক Drought গবেষণা এবং দক্ষিন এশিয়ার উপর এর ভবিষ্যত ক্ষতিকর প্রভাব ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-tHs77O4s9vE.html

@sin168gh 2 года назад

@@DrJalal90no sir I don't understand Bengali

@jeromeloukou8059 3 года назад

allo I have one problem with my precipitation data can you help me

@DrJalal90 3 года назад

What is your problem?

@DrJalal90 3 года назад

@kipishism 3 года назад

This is really dope! Unfortunately the zip file has been removed.......is there a way you can share the file you downloaded?

@DrJalal90 3 года назад

github.com/monocongo/climate_indices

@kipishism 3 года назад

@@DrJalal90 thanks dude!

@kipishism 3 года назад

Unfortunately I am only able to find data on the notebooks directory, this does not conform to the example you shared.....I am at a loss ;(

@DrJalal90 3 года назад

@ibrahimerkol4511 2 года назад

@@DrJalal90 could you please share the zip file with us?

@agumasekindie7672 3 года назад

Dear i can not get indices_python-v1.2-beta.zip. how i can get it ?

@DrJalal90 3 года назад

github.com/monocongo/climate_indices

@agumasekindie7672 3 года назад

@@DrJalal90 thank you so much, i can't get exactly 'indices_python--beta_v1.2zip ' . climate indices found in 'github.com/monocongo/climate_indices' is not similar to what you have shown in your video.i kindly ask you to share 'indices_python--beta_v1.2zip,

@DrJalal90 3 года назад

@Mr.2-3 Год назад

Mr, what you have shown here?? you just run some codes and showing result as a file. where is the plot, how to visualize, what are the values in results, how it distributed, how to show these results in a map???? there are many unanswered questions in your video. without all of these, how it become helpful for a researcher or student to learn about climate indices?????

@agumasekindie7672 3 года назад

how i can solve it, i am using Get bash in window 10 Traceback (most recent call last): File "process_grid.py", line 10, in from climate_indices import indices, utils File "C:\Users\TOSHIBA\anaconda3\lib\site-packages\climate_indices\indices.py", line 8, in from climate_indices import compute, eto, palmer, utils File "C:\Users\TOSHIBA\anaconda3\lib\site-packages\climate_indices\compute.py", line 8, in import scipy.special File "C:\Users\TOSHIBA\anaconda3\lib\site-packages\scipy\special\__init__.py", line 633, in from . import _ufuncs ImportError: DLL load failed while importing _ufuncs: The specified module could not be found.

@DrJalal90 3 года назад

Please check the following link. github.com/marcelotduarte/cx_Freeze/issues/355

@user-jg3yn4yr6m Год назад

Hello, I tried this easy way to calculate spi, but y received this error: "File "/home/usuario/anaconda3/envs/chirps/lib/python3.11/site-packages/xarray/core/utils.py", line 281, in either_dict_or_kwargs raise ValueError(f"the first argument to .{func_name} must be a dictionary") ValueError: the first argument to .drop_sel must be a dictionary". Someone can tell me what is wrong? Thank you!

@cmontes Год назад

does anyone have this error trying to run for SPEI? File "/var/folders/d6/m2bgqkw971v4qb3h1cq2tmmm0000gn/T/ipykernel_8047/4073413229.py", line 1 process_climate_indices --index spei --periodicity monthly --netcdf_precip ./data/nclimgrid_lowres_prcp.nc --var_name_precip prcp --netcdf_pet ./data/nclimgrid_lowres_pet.nc --var_name_pet pet --output_file_base ./output/nclimgrid_lowres --scales 9 18 --calibration_start_year 1951 --calibration_end_year 2010 ^ SyntaxError: invalid syntax

@DrJalal90 Год назад

@changliu6799 Год назад

Hi! Thanks for sharing this video. Can you tell me what wrong is with my code? Thanks! 2022-11-02 19:28:59 INFO Start time: 2022-11-02 19:28:59.991679 Error in calling operator ncpdq with: >>> D:\anaconda3\envs\indices_env\Library\bin cpdq -a lat,lon,time -O --output=C:\Users\Chang\AppData\Local\Temp cpdq_pr_Amon_FGOALS-f3-L_ssp370_r1i1p1f1_gr_201901-205012_china.ncveh08oxy.tmp pr_Amon_FGOALS-f3-L_ssp370_r1i1p1f1_gr_201901-205012_china.nc

@DrJalal90 Год назад

I have no idea.