Page 1 of 8 12345 ... LastLast
Results 1 to 10 of 74

Thread: CWGC WW2 Air Forces Database (120633+ / 98.5% Done!) Just 1800 (< 1.5%) to go!

  1. #1
    Join Date
    Jan 2008
    Location
    Delaware, USA
    Posts
    1,609
    Thanks
    837
    Thanked 330 Times in 208 Posts

    Default CWGC WW2 Air Forces Database (120633+ / 98.5% Done!) Just 1800 (< 1.5%) to go!

    Since the CWGC site allows one to 'download' all the data - I have decided to build my very own tool that is easy to use to query.. Please give this a try and provide feedback..

    http://www.rafcommands.com/database/wardead/

    It does not give all the data that CWGC has - eg Additional data of next of kin, or grave location or the documents.. etc For that you still need to go to the CWGC Site and run the query engine..

    but its very useful to narrow down search based on names, year of death, unit or cemetery/memorial location. The tool supports multiple "AND" queries to progressively narrow down the search
    Last edited by Jagan; 12th November 2019 at 05:04. Reason: Thread renamed from CWGC WW2 Air Forces Query DB (now with serials, AIR81, Unaccounted airmen data)

  2. #2
    Join Date
    Jan 2008
    Location
    Delaware, USA
    Posts
    1,609
    Thanks
    837
    Thanked 330 Times in 208 Posts

    Default

    Couple of enhancements made to the tool.

    1. Clicking on next to a name will Google Search that name, rank, unit, location etc - hopefully even find you the CWGC page on the CWGC Site.
    2. The Date, Unit, Country and Cemetery appear as link. clicking on a link in a record will apply that as a "drill down" query.. to the rest of the results set.
    3. Bottom of the page has a section that makes it easy to copy the 'link address' for that query page.

  3. #3
    Join Date
    Aug 2011
    Posts
    2,049
    Thanks
    5
    Thanked 32 Times in 29 Posts

    Default

    Jagan

    An interesting project.

    One question, which stems from a problem that I have when I pull out CWGC information for my History of No 35 Squadron project using the CWGC search facility, are you able to pick up the "trade" field?

    Regards

    Pete
    Main areas of research:

    - CA Butler and the loss of Lancaster ME334 (http://rafww2butler.wordpress.com/ )
    - Aircrew Training (Basic / Trade / Operational / Continuation / Conversion)
    - The History of No. 35 Squadron (1916 - 1982) (https://35squadron.wordpress.com/)

    [Always looking for copies of original documents / photographs etc relating to these subjects]

  4. #4
    Join Date
    Nov 2007
    Location
    Bewdley, UK
    Posts
    3,066
    Thanks
    2
    Thanked 164 Times in 138 Posts

    Default

    Hi Pete,

    I had a play with this using Google a few years back.

    All very rough and ready and needs a bit of variant cycling to get over the various ways the same info is stored in the CWGC databases

    For example A/Gs

    Fire up google and put the following into the search box

    "Air Gunner" "35 Sqdn" site:http://www.cwgc.org/find-war-dead/casualty

    "Air Gnr" "35 Sqdn" site:http://www.cwgc.org/find-war-dead/casualty

    etc

    same problem for Navigator - filed under Nav, Nav., Navigator, Nav/Bomber, Nav./Bomber

    In fact all the fields you want to search on all have variants and include mis scan characters of ?, /, . etc

    I thought the only way was to buildup a lexicon for search terms which would cycle through the possible combinations then filter for duplicates.

    Ross

    Ross
    The Intellectual Property contained in this message has been assigned specifically to this web site.
    Copyright Ross McNeill 2015 to 2023 - All rights reserved.

  5. #5
    Join Date
    Aug 2011
    Posts
    2,049
    Thanks
    5
    Thanked 32 Times in 29 Posts

    Default

    Thanks Ross

    Based on your feedback, as a non techie, I can understand that a reliable search facility on the "trade" field may be quite complicated but I was wondering if it would be practical for Jagan to list the "trade" field content as part of the download record for each airman?

    This is a useful field which CWGC does not include in its download for some reason

    Regards

    Pete
    Main areas of research:

    - CA Butler and the loss of Lancaster ME334 (http://rafww2butler.wordpress.com/ )
    - Aircrew Training (Basic / Trade / Operational / Continuation / Conversion)
    - The History of No. 35 Squadron (1916 - 1982) (https://35squadron.wordpress.com/)

    [Always looking for copies of original documents / photographs etc relating to these subjects]

  6. #6
    Join Date
    Jan 2008
    Location
    Delaware, USA
    Posts
    1,609
    Thanks
    837
    Thanked 330 Times in 208 Posts

    Default

    Hi Pete, unfortunately they haven't provided the "Trade" in the download file - thus it didnt make it into the data.

    The workaround would be to write an automation script that would search the CWGC site against each individual record (of the 124000) and fetch the trade data (so that it can be added to this). Very likely that is against the terms of usage for the CWGC site and they will probably block me!

  7. #7
    Join Date
    Aug 2011
    Posts
    2,049
    Thanks
    5
    Thanked 32 Times in 29 Posts

    Default

    Jagan

    I have contacted CWGC to see if "trade" can be included in its download facility.

    Regards

    Pete
    Main areas of research:

    - CA Butler and the loss of Lancaster ME334 (http://rafww2butler.wordpress.com/ )
    - Aircrew Training (Basic / Trade / Operational / Continuation / Conversion)
    - The History of No. 35 Squadron (1916 - 1982) (https://35squadron.wordpress.com/)

    [Always looking for copies of original documents / photographs etc relating to these subjects]

  8. #8
    Join Date
    Aug 2011
    Posts
    2,049
    Thanks
    5
    Thanked 32 Times in 29 Posts

    Default

    UPDATE:

    I received the following response from the CWGC today:

    "The inclusion of trades within data exports from the CWGC website is due to be implemented when the website is next enhanced. Unfortunately, our web manager cannot give a definite timescale on this but it is hoped to be within the next month or so"

    Regards

    Pete
    Main areas of research:

    - CA Butler and the loss of Lancaster ME334 (http://rafww2butler.wordpress.com/ )
    - Aircrew Training (Basic / Trade / Operational / Continuation / Conversion)
    - The History of No. 35 Squadron (1916 - 1982) (https://35squadron.wordpress.com/)

    [Always looking for copies of original documents / photographs etc relating to these subjects]

  9. #9
    Join Date
    Jan 2008
    Location
    Delaware, USA
    Posts
    1,609
    Thanks
    837
    Thanked 330 Times in 208 Posts

    Default

    Excellent Feedback Pete.

    Look forward to them implementing it.

  10. #10
    Join Date
    Jan 2008
    Location
    Delaware, USA
    Posts
    1,609
    Thanks
    837
    Thanked 330 Times in 208 Posts

    Default

    A minor modification to the tool - searching for the tool will also show up a "CWGC" button next to it. eg:

    Pilot Officer Maxtone Eric Gibson MAILER (42246) 1939-12-12 92 Sqdn United Kingdom Ayr Cemetery, Ayrshire

    Clicking it takes you the CWGC Site and shows a link to the final page.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •