Fact-check the NCAA

A little over a year ago at the NCAA convention, a proposal to make all of the NCAA’s data public was defeated. Enough peer pressure was put on and, in our opinion, misinformation spread, that the proposal was eventually withdrawn.

A compromise, it was said, would be to make public the data in a handful of sports, through posting PDF files, rather than issuing each school a login to a system that already exists for members of regional ranking committees to use.

We know full well the embarrassment of incorrect data and how D3sports.com people must now check every sport’s championship handbook on its release to make sure that the right number of Pool B and Pool C teams are being awarded. This year, in fact, the women’s basketball committee again had to revise their handbook, having promised twice as many Pool B bids as the numbers actually provided for.

So while they won’t open all of their data, they have opened women’s basketball up for us to look at. We always figure the more eyes on data, the better. That’s why our data has always been open and public, and corrections come in throughout the season. That’s because our system, like the NCAA’s, is reliant on schools entering schedules and results, and sometimes typos occur, or sometimes schools just don’t understand what defines a regional game.

At the bottom of this week’s women’s basketball release on the NCAA Web site there are links to PDF files for each of the eight regions which contain the numbers for each team. What we’re concerned with is the first number: the regional win-loss record. That’s the basis for every other number when calculating strength of schedule.

Compare those numbers to the regional record listed with our strength of schedule numbers. This file is currently through the same day, Sunday, Feb. 7. While we continually audit our own database to make sure no errors occur, we have not been able to audit theirs until now.

8 thoughts on “Fact-check the NCAA

  1. In contrast, the men have provided little/no information about their data. We only have the regional rankings to look at. Here’s what I sent to the NCAA about men’s basketball, and it was all in the Mid-Atlantic region. Through Sunday’s games:

    Albright: We have 15-4; NCAA has 14-3. Every game on Albright’s schedule
    should be in-region except for Berkeley. Nazareth is an administrative
    region game, TCNJ and Richard Stockton are under 200 miles.

    Lycoming: We have 12-4; NCAA has 13-4. Perhaps Shenandoah or New Jersey
    City are the culprits. It’s 202 miles from Lyco to New Jersey City and 212
    from Lyco to Shenandoah. Also out of region: Franciscan, Penn
    State-Hazelton and Penn College.

    St.Mary’s (Md.): We have 15-3; NCAA has 14-3. Possible culprits include
    Hampden-Sydney (175 miles) or Christopher Newport (179 miles).

    York (Pa.): We have 15-4; NCAA has 14-4. The only non-regional games for
    York are against Penn State-York and Penn State-Abington. Perhaps
    first-year MBB program Rosemont isn’t being marked correctly? Rosemont is
    a full NCAA Division III member. Mount Aloysius is also possible.

  2. My frustration is that D-III is the ideal place to open the data to all willing volunteers who will do plenty of the tedious “scut-work” for the love of the game.

    A simple change in attitude in the NCAA would make these tasks so much better and the database that results would be more accurate and more valuable to all who follow D-III.

    Please check the Handbooks of the various sports. Almost every D-III school has at least one coach or administrator on a committee. We know these people who are doing the “heavy lifting” to conduct a well-run championship. Ihave felt badly when a coach or AD whom I know to run a “tight ship” gets faulty data from the NCAA upon which to make decisions.

    Thanks, Pat. Hopefully they can get it right.

  3. Here’s what I sent the NCAA.

    As part of our schedule auditing procedures, I compared our regional records to the NCAA’s regional records as listed for the regionally ranked teams, through Sunday’s games. Here are the discrepancies that cropped up:

    Moravian: We have them at 18-2; NCAA has them at 17-2. Every game for Moravian should be in-region. If I had to pick a game that might be in conflict I would suggest it’s St. Vincent: St. Vincent is a third- or fourth-year provisional member and their games count as in-region. TCNJ is a 200-mile game.

    Washington and Jefferson: We have them at 18-2; NCAA has them at 17-2. Every game should be in-region for W&J except for the game against Wis.-River Falls. Perhaps SUNY-Purchase is the one in doubt, being a second game in an in-season tournament? W&J has played four games against third/fourth-year provisionals Geneva and St. Vincent, so perhaps one of those is at issue.

    CCNY: We have them at 9-13; NCAA has them at 8-13. All of the games played so far should be regional games. If I had to pick a win for CCNY that might be miscategorized, I’d suggest St. Joseph (Conn.), which is a 200-mile game, or Mitchell.

    Frostburg State: We have 14-5; NCAA has 13-3. Every game for Frostburg should be in-region except for Guilford. They are either conference games, 200-mile games. One game I can think of that could be incorrect is the Franciscan game. Franciscan is a conference team playing a full AMCC schedule and is a third-year provisional. They are also within 200 miles of Frostburg State.

    Gallaudet: We have 8-8; NCAA has 8-7. We already agree, I believe, on Hollins, Christendom and Penn State-York being out of region. Penn State-Altoona is a 200-mile game and should be in-region. The rest of Gallaudet’s losses are in conference.

    Medgar Evers: We have 6-14; NCAA has 6-13. FDU-Florham is a 200-mile game. Everything else seems to be an Atlantic Region opponent except for the win against Mass-Boston.

    Merchant Marine: We have 7-13; NCAA has 7-14. Merchant Marine has a 200-mile loss to St. Joseph (Conn.). Every game is in-region for Merchant Marine except for Apprentice School.

    SUNY-Purchase: We have 10-0; NCAA has 10-9. See Washington and Jefferson above for likely culprit.

    Ramapo: We have 8-13; NCAA has 7-13. Every game for Ramapo should be in-region except for Army. Manhattanville and Cedar Crest are 200-mile games.

    Rowan: We have 14-7; NCAA has 14-6. Every Rowan game should be in-region. Likely culprits: Ursinus (200-mile); Penn State-Berks (200-mile); Wesley (200-mile).

    Rutgers-Camden: We have 1-16; NCAA has 0-16. Rutgers-Camden’s win against Keystone is a 200-mile game.

    St. Elizabeth: We have 9-8; NCAA has 7-5. As a member of the NEAC, all games against NEAC opponents should be in-region. The only out of region games for St. Elizabeth should be against SUNY-Cobleskill (second-year provisional) and Penn State-Abington (first-year provisional).

    TCNJ: We have 12-10; NCAA has 11-10. All of TCNJ’s games should be in-region. Possible culprits include Alvernia (200-mile), Norwich (administrative region), Haverford (200-mile), Swarthmore (200-mile) or York, Pa. (200-mile).

    Elmhurst: We have 11-6; NCAA has 11-7. The only loss unaccounted for is Calvin, which is 202 miles from Elmhurst heading northbound, 198 miles heading southbound. When the game is at a neutral site (this was played at Olivet), how do you determine who is the home team, and therefore, which direction to run the TES mileage calculation?

    MacMurray: We have 7-9; NCAA has 6-9. MacMurray has only won two non-conference games, against Grinnell and Mount Mary. They’ve also beaten Spalding (second-year provisional) and Lincoln Christian (non-Division III member)

    Mount Mary: We have 0-12; NCAA has 0-11. Hard to isolate a particular game, but perhaps MacMurray is possible.

    Spalding: We have 0-0; NCAA has 10-5. Spalding is a second-year provisional member and therefore all games are non-region.
    http://www.ncaa.org/wps/portal/ncaahome?WCM_GLOBAL_CONTEXT=/ncaa/ncaa/ncaa+news/ncaa+news+online/2009/division+iii/four+schools+achieve+active+diii+membership+for+2009-10_08_10_09_ncaa_news

    Cazenovia: We have 6-9; NCAA has 5-9. Perhaps St. Elizabeth.

    SUNY Cobleskill: We have 0-0; NCAA has 10-3. Cobleskill is a second-year provisional member and therefore all games are non-region.
    http://www.ncaa.org/wps/portal/ncaahome?WCM_GLOBAL_CONTEXT=/ncaa/ncaa/ncaa+news/ncaa+news+online/2009/division+iii/four+schools+achieve+active+diii+membership+for+2009-10_08_10_09_ncaa_news

    Morrisville State: We have 2-12; NCAA has 2-11. Perhaps St. Elizabeth.

    RPI: We have 10-7; NCAA has 9-6. The following are 200-mile games for RPI: Salem State, Amherst, Trinity (Conn.); Williams, Wheaton (Mass.), Colby-Sawyer.

    SUNYIT: We have 8-6; NCAA has 7-5. SUNYIT has split with St. Elizabeth.

    Union: We have 5-14; NCAA has 5-13. These are the 200-mile games for Union: Worcester Tech, Western New England, William Paterson, Massachusetts College.

    Bluffton: We have 7-11; NCAA has 7-10. There are four non-region losses: Wheaton (Ill.), Trinity (Texas), Mary Hardin-Baylor and non-Division III Goshen. Wheaton is more than 200 miles.

    Calvin: We have 12-2; NCAA has 13-2. See Elmhurst.

    Capital: We have 14-5; NCAA has 14-4. All of Capital’s losses are regional games, except for the game against Simpson. Washington and Lee is a likely culprit. That’s an administrative region game.

    Alvernia: We have 10-7; NCAA has 10-5. Not sure which of the losses on Alvernia’s schedule could be missing. Penn State-Schuylkill is the only non-region game — everyone else is within 200 miles or in the state of Pennsylvania.

    Arcadia: We have 5-15, NCAA has 3-14. Every game for Arcadia should be in-region, including 200-mile opponents TCNJ, Rowan and Trinity (D.C.); and provisionals Lancaster Bible and Penn State-Harrisburg.

    Bryn Mawr: We have 0-19, NCAA has 1-18. Neither of Bryn Mawr’s wins this year are in-region: Penn State-Brandywine is a non-Division III member and Penn State-Abington is a first-year provisional. All of their losses are in-region.

    Centenary: We have 10-8, NCAA has 11-8. The two non-region games on Centenary’s schedule are Ohio Wesleyan and Penn State-Hazelton. Vassar is under 200 miles, Lasell is in the administrative region.

    Eastern: We have 3-14, NCAA has 3-13. Everything for Eastern is in-region except for Penn State-Hazelton and Penn State-Brandywine.

    Elizabethtown: We have 6-14, NCAA has 6-13. Perhaps Shenandoah is the issue — that is a 200-mile game.

    FDU-Florham: We have 10-11; NCAA has 10-0. We have every game for FDU-Florham in-region, including Amherst (administrative region) and 200-mile games Medgar Evers, Rutgers-Newark, Staten Island, New Jersey City, William Paterson, Ramapo, NYU and Brooklyn.

    Franklin and Marshall: We have 9-11; NCAA has 9-10. The loss that might be at issue could be Montclair State — a 200-mile game.

    Immaculata: We have 9-8, NCAA has 9-7. The non-conference, in-region losses are Albright, Delaware Valley and Elizabethtown. Penn State-Abington, Brandywine and Virgin Islands are non-region.

    Keystone: We have 4-13; NCAA has 2-13. Catholic is the only non-regional game on Keystone’s schedule. St. Elizabeth is 200-mile and St. Joseph’s is administrative region.

    Lycoming: We have 6-12; NCAA has 6-10. Penn College, Wesley and Bucknell are the only non-regional games. St. Lawrence is administrative region, Kean is 200-mile.

    Manhattanville: We have 13-7; NCAA has 13-6. Eastern Connecticut is a 200-mile game. William Paterson is 200-mile. Juniata is administrative region.

    Marywood: We have 12-4; NCAA has 13-4. Three non-region games for Marywood — Nyack, Penn State-Hazleton, Penn State-Schuylkill.

    Neumann: We have 15-5; NCAA has 14-5. Everything for Neumann should be in-region, including Clarkson (administrative region).

    Penn State-Abington: We have 0-0; NCAA has 2-7. Penn State-Abington is a first-year provisional and by definition cannot play in-region games.

    Penn State-Altoona: We have 16-5; NCAA has 15-5. Perhaps the Gallaudet game mentioned above.

    Penn State-Harrisburg: We have 5-7; NCAA has 5-9. St. Elizabeth was mentioned earlier. Albright, Lancaster Bible and Rowan are non-conference in-region losses.

    Philadelphia Biblical: We have 1-13; NCAA has 1-14. We have non-region games as New England College, MIT, Davis, Ky. Christian, Ohio Christian and Valley Forge Christian.

    Ursinus: We have 9-11; NCAA has 9-12. Norwich should be out of region but everything else is an in-region game.

    Widener: We have 11-9; NCAA has 10-8. Everything should be in-region except for Roanoke. Rutgers-Camden, St. Mary’s, Rowan, Kean, Wesley and William Paterson are 200-mile opponents.

    Albertus Magnus: We have 9-12; NCAA has 9-11. Losses to 200-mile opponents are York (N.Y.) and Brooklyn.

    Johnson and Wales: We have 9-11; NCAA has 8-11. CCNY is the probable culprit — under 200 miles.

    Norwich: We have 13-5; NCAA has 13-6. Norwich has only five overall losses through Feb. 7 as far as I can tell. What’s on our site matches what’s on Norwich’s site’s schedule.

    Salem State: We have 13-6; NCAA has 12-6. RPI should be a regional game — 195 miles.

    Berry: We have 0-0; NCAA has 4-0. Berry is a first-year provisional member.

    Birmingham-Southern: We have 10-9; NCAA has 10-8. Not sure which loss would be misclassified. Other than Berry, all losses are in-region.

    Centre: We have 12-7; NCAA has 11-7. Perhaps Marietta is the game in question — this is an administrative region game. Everything other than St. Catharine is in-region.

    Covenant: We have 0-0; NCAA has 5-3. Covenant is a first-year provisional member.

    University of Dallas: We have 9-9; NCAA has 8-9. Perhaps UC Santa Cruz is the one miscategorized, though Colorado College is also possible.

    Howard Payne: We have 17-4; NCAA has 16-4. All of their games are in-region — the likely culprits are Cal Lutheran and UC Santa Cruz, which are administrative region games.

    Texas-Tyler: We have 8-10; NCAA has 6-9. Non-region games are Dallas Christian, Jarvis Christian and Loyola of New Orleans.

    Washington and Lee: We have 11-7; NCAA has 10-7. Capital is an administrative region game.

    Colorado College: We have 9-9; NCAA has 8-8. Everything should be in-region except for Piedmont, Siox Falls and Johnson and Wales (Colo.). Perhaps Augustana, Milwaukee Engineering and/or University of Dallas.

    La Sierra: We have 0-15; NCAA has 0-12. Everything should be in-region except Holy Names, The Master’s, St. Joseph’s-Brooklyn, Emerson and Southwestern (Ariz.)
    Considering how hard it’s been for us to get info out of La Sierra, perhaps scores are missing?
    http://www.d3hoops.com/school/LSRR/w/2010

    Menlo: We have 0-0; NCAA has 2-0. I was told that if a school declares for the NAIA championship, their games are considered non-region.

    North Central: We have 2-10; NCAA has 1-7. Obviously a lot of games on the North Central (Minn.) schedule are non-region. Here’s the regional games: wins against Crown and Presentation, losses to Scholastica, Northwestern Marian, Northland, St. Scholastica, Bethany Lutheran, Minn.-Morris, Northwestern, Martin Luther, Presentation and Martin Luther.

    Northwestern (Minn.): We have 11-9; NCAA has 12-7. Finlandia is the only non-region game that I can see here.

    Presentation: We have 4-8; NCAA has 4-7. Perhaps North Central? Lot of non-region games for Presentation.

    St. Scholastica: We have 8-12; NCAA has 8-11. The only non-region games are Sewanee and Finlandia.

    UC Santa Cruz: We have 1-11; NCAA has 1-10. Howard Payne or University of Dallas are possible candidates.

  4. Started the men’s records tonight.

    Centenary: We have 9-11; NCAA has 8-10. John Carroll seems to be the only non-regional game. Bard, Montclair State and TCNJ are 200-mile games.

    Gwynedd-Mercy: We have 10-8; NCAA has 9-8. The game in question could be St. Lawrence, which is an administrative region game. Rutgers-Camden also possible, a 200-mile game.

    La Roche: We have 10-11; NCAA has 10-10. Every game should be in-region. Perhaps third-year provisional Geneva is the issue.

    Marywood: We have 4-13; NCAA has 3-12. Non-region games are Penn St.-Wilkes-Barre, Hazelton and Scranton. Non-conference regional games would be Misericordia and Wilkes. If Rosemont is an issue, Marywood plays them twice.

    Neumann: We have 8-8; NCAA has 9-8. Penn State-Abington is probably the issue.

    Penn State-Abington. We have 0-0; NCAA has 0-7. As a first-year provisional member, Abington’s games cannot be regional.

    Penn State-Harrisburg. We have 9-4; NCAA has 10-5. Abington is probably part of the equation. Non-region games are Penn State-Schuylkill, Valley Forge Christian, SUNY-Cobleskill; Abington, Penn State-York, Abington again. (And Cobleskill Feb. 14.)

    Pitt-Bradford: We have 12-8; NCAA has 11-8. Aside from Marietta, every game is regional. Buff State and Nazareth are in the same administrative region and Franciscan is a regional game because they’re in the same conference. (If the rules are different for Franciscan, let me know and I’ll change on our end.)

    Salisbury: We have 8-8; NCAA has 8-7. Christopher Newport and Virginia Wesleyan are 200-mile games. Goucher, St. Mary’s and Johns Hopkins to open the season are all administrative region games.

    Scranton: We have 10-7; NCAA has 9-7. Perhaps Bard (administrative region), either Kean game (200 miles).

    CCNY: We have 6-14; NCAA has 6-13. The only non-region games for CCNY are Berkeley and Gallaudet. Perhaps St. Joseph’s Brooklyn. Other non-Atlantic teams that are in-region games were Mitchell, Buffalo State.

    New York City Tech: We have 2-19; NCAA has 2-18. Perhaps St. Lawrence, Trinity (Conn.), Lebanon Valley, Franklin and Marshall.

    John Jay: We have 1-19; NCAA has 1-18. Manhattanville, Connecticut College (twice), King’s and Wilkes are non-Atlantic Region 200-mile opponents.

    Lehman: We have 7-14; NCAA has 6-14. Only win I see that could be confused is St. Joseph’s-Brooklyn.

    New Jersey City: We have 10-8; NCAA has 10-9. It’s 202 miles from Lycoming to New Jersey City. (I know it’s less than 200 miles in the other direction according to TES. I’ve been told to run the mileage in the direction the road team traveled. Still the case?)

    Richard Stockton: We have 14-5; NCAA has 15-5. Penn State-Abington is a likely discrepancy.

    Rowan: We have 11-6; NCAA has 12-6. Penn State-Abington is a likely discrepancy.

    St. Joseph’s (Bklyn.): We have 2-10; NCAA has 2-9. Perhaps Trinity (Conn.) or Lancaster Bible. Widener also possible.

    Staten Island: We have 9-11; NCAA has 9-10. This could also be Lycoming — exactly at 200 miles, should be a regional game. Can’t see any other losses that would be in question, though Stevens is also a 200-mile game.

    Alfred: We have 6-10; NCAA has 7-10. Penn State-Abington is a likely discrepancy.

    Cobleskill: We have 0-0; NCAA has 2-2. Cobleskill is a second-year provisional and unable to play regional games.

    Hilbert: We have 2-18; NCAA has 2-19. The Penn State-Du Bois game is the only non-regional game.

    Keuka: We have 3-11; NCAA has 3-10. Not sure which game might be at issue. Perhaps one of the Jan. 15-16 tournament games didn’t get marked right.

    Morrisville State: We have 3-9; NCAA has 3-8. The regional losses: Medgar Evers, Clarkson, Keuka, SUNYIT, Penn St.-Harrisburg, Penn St.-Berks, Penn St.-Harrisburg, Keuka, Oswego State.

    Plattsburgh State: We have 12-6; NCAA has 11-6. Lyndon State and Norwich are 200-mile games.

    SUNYIT: We have 12-4; NCAA has 11-4. The in-region wins: Utica, New Paltz, Hamilton, PS-Harrisburg, Morrisville, Keuka, Cazenovia, Utica, PS-Berks, Cazenovia, Wells, Keuka.

    Skidmore: We have 11-8; NCAA has 8-6. Skidmore crosses over with a bunch of 200-mile New England region teams: Southern Vermont, Johnson State, Trinity (Conn.), Castleton State, Norwich and Middlebury.

    Union: We have 10-8; NCAA has 10-7. Union also crosses over with New England teams, including losses to Western Connecticut, Middlebury, Western New England.

    Vassar: We have 1-17; NCAA has 0-15. The win is probably Newbury: 198 miles each direction. Richard Stockton is a 200-mile game, as is Brandeis, Williams, Amherst and Ramapo.

    This is East, Atlantic and Mid-Atlantic.

  5. And isn’t it possible that a school could lose out on a Pool C bid to the NCAA tournament because of these mistakes. It’s bad enough teams have to survive upsets on the court; if I was a coach or player I’d be pretty UPSET if my chance to dance was taken from me because the NCAA can’t get their facts straight.

  6. Pingback: D3hoops.com Daily Dose » Blog Archive » 2010 Regional Rankings, Week 3

  7. Hello. This is deiscanton posting under my modified d3blogs.com name of desicanton1– my e-mail changed some months back and my old handle didn’t match my current e-mail address.

    The purpose of my writing here today is to ask the NCAA to check the Brandeis men’s reported in-region results vs regionally ranked opponents. I have Brandeis at 1-2 vs regionally ranked opponents while the NCAA reports it at 2-3.

    As of week 2, Wash U and NYU were the other UAA teams ranked regionally by the NCAA. Through Sunday, Brandeis’s record vs Wash U and NYU is 1-2 (It was 1-1 when UMass-Dartmouth was still regionally ranked, but UMass-Dartmouth has since dropped out of the regional rankings for week 3.)

    Currently, none of Brandeis’s non-conference opponents are regionally ranked by the NCAA. Brandeis played in non-conference Lasell, Emerson, UMass-Dartmouth, Vassar, Clark, Framingham State, Salem State, Tufts, Curry, Bates, and Amherst. Out of those 11– only UMass-Dartmouth had gotten a regional ranking, but is no longer regionally ranked.

    That means that the only regionally ranked teams that Brandeis played this season are the UAA opponents currently regionally ranked, and Brandeis is now 1-2 vs Wash U and NYU– with one more chance at a currently regionally ranked opponent when NYU comes to Brandeis on Feb. 27.

    Brandeis’s regional percentage and strength of schedule numbers are correct– which is the crucial thing. Perhaps the NCAA confused the Salem State women with the Salem State men and gave the Brandeis men an extra win?

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.