Schedule (Tentative)

Date Phase
02.10 v21.0 Released
02.29 v22 Data Submission Starts
06.22 v22 Release
For details, see Release Schedule.
See also Notification Services.

Updating Population, GDP, Literacy

Load WorldBank

Go to the following location
(http://ddp-ext.worldbank.org/ext/DDPQQ/member.do?method=getMembers&userid=1&queryId=135)
It may not be stable, so here is how you get to it
  1. worldbank.org
  2. Data & Research at top
  3. Data, Key Statistics, Data by country
  4. Quick Query
Once you are there, generate a file by using the following steps.
  1. Countries
    1. Select All countries
    1. Next>>
  2. Series
    1. GNI, PPP; Select
    2. Population, total; Select
    1. Next>>
  3. Time
    1. 2008..2000; Select
      • Note: if 2008 is not the latest year, get the latest year, but then also update AddPopulationData.java to add the latest years to WBLine.
    2. Next>>
  4. Export; CVS; Select DATA

You will get a file of the form:
Afghanistan    AFG    GNI, PPP (current international $)    NY.GNP.MKTP.PP.CD    22092804549    23943938506    ..
Afghanistan    AFG    Population, total    SP.POP.TOTL    ..    ..    ..
...
with a strange name like 157c367b-420b-4449-ac1e-37d355b5b1d8.cvs

Rename it to world_bank_data.csv and and save in data/external/

Then diff.

Load UN Literacy Data

  1. Goto http://unstats.un.org/unsd/demographic/products/socind/literacy.htm
  2. Download data - save as temporary file
  3. Open in Excel - save as data/external/un_literacy.csv (Windows Comma Separated)
  4. Diff

Load CIA Factbook

The site isn't very stable, so you might have to alter the following to work. Try under Country Comparisons...

  • https://www.cia.gov/library/publications/the-world-factbook/
  • https://www.cia.gov/library/publications/the-world-factbook/rankorder/rankorderguide.html

Download the following files into data/external/

The first two are from the following main pages

  • https://www.cia.gov/library/publications/the-world-factbook/rankorder/2119rank.html
  • https://www.cia.gov/library/publications/the-world-factbook/rankorder/2001rank.html
Then diff.

Convert the data

  1. If you saw any different country names above, you'll need to edit external/alternate_country_names.txt to add them.
  2. Once done, then run the ConvertLanguageData tool as on Update Language Script Info
  3. Once everything looks ok, check everything in.