More buggerising around with MySchool numbers

After reading that SMH story yesterday on school results and funding, I thought I'd delve into the numbers to cross-check what the author Bernie Shepherd had to say. I did it the hard way - I went to the MySchool website and extracted the numbers for all secondary schools in the postcodes of 2000 to 2100. I looked at 62 secondary schools in those areas, and then excluded those with no NAPLAN results and the special schools.

I also exluded combined primary and secondary schools, as they don't separate out the per student funding data for them. I created a "NAPLAN index" using the same method as Bernie Shepherd (or so I assume) - I added up the 5 NAPLAN test scores for year 7 in 2010, then divided by 5. ie, something like (631+570+617+667+675)/5 = 632.

The first graph shows the NAPLAN index score for all the schools in this sample plotted against funding per student. Now I know that a lot of teachers and principals in the state school system have a really big problem with how those "funding per student" numbers were calculated - and so do I. But it's all we've got to go on. What this graph tells me is that most secondary schools (state and non-state) are clustered around a certain funding range, with a few expensive outliers - state and non-state. I wasn't aware that there are two state schools in NSW funded to the tune of nearly $25,000 per student - they're selective schools of a certain type. (If you click on any of these graphs, they will embiggen hugely and allow you to see all the data properly).

Here's the same graph with the left axis truncated to a minimum of 400 to give a better view of the data. Notice the little circle of 6 schools in the top left hand corner? They're all state selective schools. Their NAPLAN results are almost off the charts.

The graphs above and below show the state and non-state schools split out. With non-state schools, there appears to be some relationship between funding per head and NAPLAN results - the more funding, the better the results. The r-squared is 0.55.

With non-state schools, there is no relationship between funding and NAPLAN scores. The R-squared is 0.012. Then again, the sample might be too small.

This graph shows the outlying selective schools. They really are a class above the rest.

For this graph, I've removed the selective schools and shown all other schools - state and non-state. I should have removed the two at the bottom, as I have just discovered that those schools cater for kids with drug problems etc. Even then, there's not much relationship in the state system between funding per head and NAPLAN scores.

Here's where you really do get a relationship - when you plot the ICSEA scores against NAPLAN performance. ICSEA is a measure of wealth. The higher the ICSEA score, the higher the NAPLAN scores. The R-squared here is 0.577.

The relationship is slightly weaker with non-state schools, with the R-squared being 0.52.

Here's the two groups of schools plotted together.

And here are both plots with both trend lines - you can see that the slope of both lines is almost exactly the same, and they almost overlap each other.

As far as funding goes, when I removed the two most expensive state schools in this sample, average funding per head was $12,040. When I removed the most expensive non-state school, their average was $13,766 - a different of $1,726. I don't know how Bernie Shepherd calculated that the average income for a state school was $8,200 and the average for non-state was about $19,000. The state school with the lowest funding in this sample received $9,773 last year.

--------------

One might ask how Bernie got his hands on the data for 8200 schools from the MySchools website. Was he given the entire dataset by the government, or has he screen scraped a sample like I have?

One might also wonder how Bernie got an article published in the SMH - so I did a bit of Googling.

Bernie will be speaking at a conference later this month for the Australian College of Educators.

The Hon Catherine Branson QC, President of the Australian Human Rights Commission and Human Rights Commissioner, will speak on "Strengthening human rights in the Australian National Curriculum"

Ok, a complete leftie.

Maxine McKew will host the MySchool and Equity brown bag lunch at 12pm on Friday 15th July with presentations from Dr Brian Croke, Chris Bonner and Bernie Shepherd.

Maxine McKew - ex-ABC and Labor MP. Chris Bonner writes for the Drum occasionally, and is a contributing author for the leftie think tank, the Centre for Policy Development. "Chris is co-author with Jane Caro of The Stupid Country – How Australia is dismantling public education" - I guess that gives you an idea of where he is coming from.

David McRae will host a panel presentation with Dr Amanda Tattersall, James Whelan and Eric Sidoti on "Making Change Happen"

Dr Amanda Tattersall is union connected another leftie.


I'm not sure if this is her or not:


Amanda Tattersall is a Ph.D. candidate at the University of Sydney, Australia. Her dissertation looks at community unionism—which occurs when trade unions campaign with community organisations and social movements on issues beyond wages and condition—and involves a comparative study of industrial relations and social movement practice in Australia, Canada and the United States.


Amanda Tattersall is also a special projects officer with the Labor Council of New South Wales.

Or if this is her either:


Amanda Tattersall is an elected official at Unions NSW (central Labor council in Sydney) with a background in union and community organising.


She was the president of the National Union of Students (NSW) in 1999 and co-founder of Labor for Refugees in 2001 (a partner in a wider movement for immigration and refugee rights).


She is the chair and co-founder of GetUp.org.au (a sister organisation to MoveOn.org, with 370,000 members) and now the founder and director of the Sydney Alliance, a broad-based coalition of 28 religious organisations, unions and community organisations.

James Whelan - also from the left-leaning Centre for Policy Development and a Director at the Change Agency.

James Whelan lives in Newcastle in the Worimi nation. His commitment to community action for social and environmental justice has drawn him to work in the community sector and in research and higher education. As a community educator and activist, James has worked with non government and grassroots community and environment groups. 

Eric Sidoti is a Director of the Whitlam Institute. I doubt he leans to the left at all...


Director has been actively engaged in public policy development, strategic planning and communications throughout his career. For over a decade, prior to his appointment at the Whitlam Institute, Eric has managed Strategic options, his own small consultancy. This enabled him to develop long-term relationships with a small number of clients, principally the Dusseldorp Skills Forum and the Australian Red Cross in addition to the Enterprise and Careers Education Foundation, Greening Australia and Job Futures. He has been engaged in projects across a broad range of policy fields (education, training and employment; human rights; development; Indigenous land rights and education; humanitarian law and conflict; and welfare issues).
Eric was the Executive Director of the Human Rights Council of Australia (HRCA) 1992 - 1995, Communications Director of Amnesty International Australia 1987 – 1992 and National Secretary of the Catholic Commission for Justice and Peace 1985-1987.


"Mary Ann O'Loughlin and Jenny Donovan will lead a panel discussion -  Case Study on Smarter Schools National Partnerships - Cooperative federalism for equity in action? What are the learnings for schools, for governments?"


Mary Ann O'Loughlin - Ms Mary Ann O’Loughlin is Executive Councillor and Head of the Secretariat of the COAG Reform Council. She is also currently a member of the National Health and Hospital Reform Commission established by the Prime Minister and Minister for Health and Ageing.


Between 2000 and 2008, Ms O’Loughlin was a Director of the Allen Consulting Group, a leading economics and public policy consulting firm. Before joining Allen Consulting, she was Senior Adviser (Social Policy) to the then Prime Minister, the Hon Paul Keating MP


So she worked for Keating and was a Rudd appointment. 


----------


So now we know the company that Bernie keeps. Interesting.

How to compare apples with oranges

The Silly is at it again - this time fluffing the results of state schools.

THEY receive more than twice the funding of their public school counterparts but students from independent schools perform no better on literacy and numeracy tests, a new analysis reveals.

A retired high school principal and education consultant, Bernie Shepherd, examined data from the federal government's MySchool website for the NSW Secondary Principals' Council.

He looked at NAPLAN results, financing and students' social background for more than 8200 primary and secondary schools, scrutinising the relationship between funding and results.

I'm glad he got his hands on all the stats, because I sure as hell  haven't been able to get the whole lot in one go.

Here comes the apples and oranges:

Independent schools at the top end of the advantage scale were found to have an average annual income of more than $19,000 per student, compared with an income of about $8200 for each student at a government school.

There are a lot of Independent schools in Australia. There are over 900 in NSW. Only the top 43 charge anything like $19,000 per student (in fact PLC charges $21,492). Notice how he's compared the top independent schools (the top 5%) with the average of all state schools. It would be fairer to compare the most lavishly funded state schools with that top 5%, or all independent schools with all state schools.

Because I've had to extract my numbers laboriously by hand from the MySchool website, my sample is 1/100th the size of Bernie Shepherd's. My sample only has 7 independent schools, but their average fees amount to $12,400. The average of 24 Catholic schools is $9,079. The average of 52 state schools is $9,273.

But when their NAPLAN scores were averaged and converted into a scaled index, government schools on 567 edged out independent schools on 566.

Ha ha - he's done exactly what I did back in March. There are 5 NAPLAN scores - I simply added them together to give a total. His "averaged and scaled index" is simply my total divided by 5.

As I said before, I don't have access to the full range of data, but in my sample of primary schools only, the Micks had an index score of 448 and the state schools 420 - and these are schools from the same geographic areas. I didn't have enough independent schools to give a meaningful result.

The independent schools attracted about $3300 in state and federal government funding, with the bulk of their remaining income provided by fees paid by parents. Ninety per cent of the public schools' funding came from government.

90% of the public schools' funding came from government? Is he looking at the same data as me? A state school that raises more than 5% of its funds from fees, charges and parent contributions is doing pretty well.

The most advantaged Catholic schools received an average annual income of about $13,000 a student - more than $6000 of it from government - and recorded a NAPLAN index of 565.

Again, he's looking at the "most advantaged" and not the average. As I mentioned earlier, the average is down around $9,000 - and it's actually lower than what state schools get on average. It's amazing what results you can get when you cherry pick the data.

The schools in the sample had an Index of Community Socio-Educational Advantage (ICSEA) range of about 1200.

1200! My sample includes the leafy (and expensive) lower north shore. I have only two schools in my sample with an ICSEA over 1200. In order to get an ICSEA of 1200, you're talking about a very small number of very expensive suburbs. Mosman has an ICSEA of 1206. Cranbrook, one of Australia's most expensive schools is located in Bellevue Hill - it has an ICSEA of 1200. The Scots College is also there - it has an ICSEA of 1188.

''In terms of the cost benefit, if we were looking strictly at educational outcomes as measured by NAPLAN, you would have to think government schools were better value for money,'' he said.

Well, on that note, I'll leave you with this graph showing how much it costs to achieve each point of a NAPLAN score. Schools on the left provide a cost effective education. Schools on the right provide an expensive (and often ineffective) education.

I'll use this matrix again - if Bernie Shepherd is right, then you'd expect to find expensive Independent and Catholic schools over in the right hand quadrants. But funnily enough, you don't. The worst performing schools from both a cost and results perspective (the bottom right hand quadrant) and all state schools.

Frankly, I'd love to get my hands on the full data set for MySchool to see if the results hold true when all the numbers are crunched. I think Bernie's analysis is interesting, but he's engaged in cherry picking and comparing like with not-like.

NAPLAN vs school funding

I have lost count of the number of times I've been told that the key to improving the education of the "disadvantaged" is more money. I wonder about that - can more money convince feckless parents to read to their kids before bedtime? Can more money convince useless parents to force their kids to do their homework and do some study every night?

Now that I have more data, I've updated my graphs on school funding vs NAPLAN scores in grades 3 and 5. The R-squared results are low 0.32 to 0.35, so there's stuff all correlation between NAPLAN results in those years and how much money is stuffed into a school.

Notice that the line slopes down though - the less funding a school gets, the better its NAPLAN score tends to be. That shows that schools with low NAPLAN numbers are getting more money - the big question is whether they are putting it to good use. What's the point of giving them more money if all they do is piss it up against the wall? By that, I really mean the parents pissing it up against the wall. A school and its teachers can only do so much. Parents have to do their bit too. A good school will always have a tough time producing results if the parents don't provide any support and direction to their kids.

Just how are things going in Wilcannia?

See that red oval out on its own? That's the NAPLAN results for Wilcannia, a state school with 109 students - 96% Aboriginal. It's out in the middle of nowhere.

The NAPLAN results suggest that by year 9, the kids in that school are at about the same level as city kids are in year 3. And we're talking about city kids from the arse end of town. They're well behind the city kids in year 3 that go to state schools in posh suburbs.

Six years behind. Fucking helski.

MySchool - just how far behind can a school fall?

I've extracted some more data from the Chatswood and Fairfield areas regarding high schools, and applied it to my favourite graph - the one showing how the NAPLAN scores of schools improve over time. The problem with this data is that it's not continuous - you have kids going from primary school to high school, so there is a break in the data between years 5 and 7. On top of that, NAPLAN testing hasn't been going long enough to follow the same set of kids from grade 3 all the way to grade 9. The results for years 3 and 5 are from a different set of kids from years 7 and 9.

No matter - we just have to work with what we have.

The bottom axis is the ICSEA score - a measure of wealth. Poor areas to the left, rich areas to the right. The blue data points are the NAPLAN scores in year 3, the brown ones are the scores in year 5 etc etc. You can see how the NAPLAN results climb over time.

What surprised me is that the rich schools pull away in high school - particularly the state schools. There are a lot of very expensive independent schools on the North Shore, and the elite state schools leave them in the shade. More on that another time.

Have a look at the results of the school in the red circle. What you're looking at there is the NAPLAN score for a Fairfield school for its year 9 students. The long red line shows where it sits in relation to state schools in a rich area. By my reckoning, kids in year 9 at that poor school are at about the same level as kids in year 4 at the schools in the rich area. That's the difference between a state school in a good area and one in a bad area.

More MySchool - just to annoy Cav

The theme for this evening is - chuck around a few hypotheses and see what sticks. I was always useless at defining a null hypothesis way back in my school days, so I'm not even going to try to do that now. I always buggered it up. I've spent the afternoon pulling down more stats and combining them to see what falls out.

Big caveat up front - this covers a limited number of primary schools in NSW. This is interesting stuff, but I'd need access to lots more data before staking my life on the results.

First idea - is there a relationship between the ratio of teachers to students and the amount of funding per student?

Answer seems to be "yes". I would expect that to be true since teacher's salaries are the biggest cost for schools. The R-squared is 0.688, making it a good fit. Part of the remaining variation could be explained by variations in mix of teacher salaries across schools - that is, one school might have 10 newbie teachers on $50k, and another might have 10 old farts on $80k. If they have the same number of students, the teacher/student ratio will be the same, but the second school will require funding 60% higher.

Just remember this - with state schools, over 80% of the bills are paid centrally. The schools never see much money - head office pays the staff, pays the maintenance bills, buys the computers etc etc. The numbers that have been released by ACARA are the result of the head office bureaucrats at the DET taking about $9 billion worth of expenditure and then trying to work out how to divvy it up between a few thousand schools.

I then split the stats for Catholic and state schools. Both show a very strong relationship between funding per head and student/teacher ratios.

However, we have to be careful when interpreting this - which is driving what? Remember, funding for schools is producer driven, not consumer driven. It's a chicken and egg question - does a school have a lower student/teacher ratio because it gets more funding, or does it get more funding because historically it had a low student/teacher ratio? Budget setting in the public sector is a strange beast - the amount of money you get can be based on the most illogical reasoning's at times.

Moving on - is there a relationship between the size of the school (number of students) and the NAPLAN scores? Is a small school better than a big school?

The graph above suggests that it makes no difference whatsoever. Big or small - doesn't matter. It might make a difference to the range of subjects you can study, but for NAPLAN results - zip.

However, I have coloured the data points to differentiate rich areas from poor areas. Blue are wealthy, brown are poor. There's a pretty clear split - the wealth and educational background of the parents counts an awful lot more.

Why do bureaucrats like big schools? Because it makes their life easier when dealing with a small number of big entities rather than a large number of small entities. They'll claim of course that bigness brings the benefits of scale, but the only things that I have ever seen scale well in a bureaucracy are stupidity, ineptness and bloodymindedness.

I then took the NAPLAN scores for a bunch of schools and looked at the performance of their grade 3 cohorts in 2008 and those same cohorts in grade 5 in 2010. I wanted to see how their scores improved over that period across a range of schools. Chatswood is a wealthy area - the average NAPLAN total went up 425 points. Why did some schools jump further than others? Has money anything to do with it?

Just to show you what I'm doing, here are 5 schools from Chatswood. The rhomboid at the bottom is their grade 3, 2008 NAPLAN score. The square up above is the NAPLAN score for that same class when it was tested in grade 5 in 2010. Along the bottom axis is funding per student. Did having more money produce a bigger jump in grades? It did for one school, but not the rest.

Here's the same schools, but with the data presented a different way. I've shown the student/teacher ratio on the bottom axis this time. The further a school is to the left, the better the student/teacher ratio (ie, supposedly smaller classes). The school with the biggest jump (in purple) had a low ratio (small classes) - however, the 2nd biggest jump was the blue school, which had a higher ratio. The rest were all the same - didn't matter if they had smaller classes or bigger classes, the improvement was the same.

The green school and the purple school both started at low NAPLAN scores, and both had small class sizes. The purple school leapfrogged ahead of two of the others with larger class sizes, but the green school didn't. Small class sizes might be beneficial - or they might not. Anyway - you need to crunch lots more than five schools to get an answer.

Which is what I did. I looked at how much the NAPLAN score went up for 70 schools, and then compared that to the student/teacher ratio. According to the R-squared, there is no relationship whatsoever. It's a paltry 0.03.

If you look at the percentage increase in NAPLAN scores vs the student/teacher ratio, you get a slightly better R-squared of 0.15, but this still means there is next to no relationship there at all.

I then split out the Catholics and the state schools, just to see if there was any difference. With the Micks, it's next to nothing.

State schools gets a slightly improved relationship, but an R-squared of 0.23 still means that there is two thirds of bugger all correlation.

Here's where things could get interesting. The blue dots are the grade 3 NAPLAN scores from 2008 for schools in a rich area and a poor area. Along the bottom axis is the ICSEA score - the measure of family wealth. There's a pretty clear pattern - schools in poor areas get much lower NAPLAN scores than schools in wealthy areas. The difference between the worst performing school and the best is 682 points - 1783 vs 2465. The schools in wealthy areas start out with an advantage of up to 38%. The difference between the averages across the two groups is about 14%.

The brown data points are the grade 5 NAPLAN scores two years later for those same schools. The same pattern appears - the rich schools stay ahead, but the average gap shrinks to 9%. Shockingly though, the lead of the best school over the worst stays at around 36%.

I've circled the lowest performing school from 2008.

Have a look at where its students get to by grade 5. Compare it to the schools in rich areas circled in green on the right. That green circle is the rich school scores from grade 3. For the grade 5 kids in the worst school in the poor area, when they hit grade 5, they are performing at the level of the worst performing rich area schools - from grade 3! Not only are they two years behind, but they're even at the back of that pack!

PS - remember, these are all state schools and low fee Catholic schools. What you're mainly seeing here is the difference in performance between a set of state schools in a rich area and a set of state schools in a poor area. In case you are wondering about funding, the poor state schools got an average of $9,498 each and the rich state schools got an average of $8,480 each - about a thousand bucks less (or the poor schools got 12% more). The best funded poor school got $10,894 - the lowest funded rich school got $7,057 (or the best funded poor school got 50% more than the worst funded rich school).

That rich school with the least money - only two schools out of this entire group got higher NAPLAN scores. The school with the highest NAPLAN score (in a rich area naturally) actually got the second lowest funding allocation out of all of them.

Anyway, that's just a taste of the sort of number crunching that can be done with these stats. ACARA, being a bunch of bastards, have made it as difficult as humanly possible to extract the numbers to do this sort of analysis, so it's both time consuming and shallow.

More posts on MySchool:

Number 6

Number 5

Number 4

Number 3

Number 2

Number 1

Damn, stuffed up teh numbering.

Number 0.

MySchool - why is it so?

Arguments regarding the amount of funding that different schools are getting are likely to rage on for the next 10 years. One statement that I read today was along the lines of, "State schools get less money per student because they are larger, and thus more cost effective". I thought I'd put that to the test by looking at the data from the Chatswood area - you make up your own mind.

First graph - size of school vs funding per student. The R-squared is 0.4 - not that crash hot. However, it does appear that larger schools get less funding per head - there is some relationship there. Just remember that correlation does not mean causation.

I decided to just look at State Schools alone - the R-squared drops dramatically to 0.28 - which means almost no correlation. This needs to be tested against a bigger data set, but so far, that idea is not looking good - at least in the state system. It could turn out to be an urban myth. Or more data might prove it.

But do we just care about cost, or is performance more important? I therefore decided to look at the NAPLAN scores for grade 3 vs the size of the school. When Catholic and State Schools are mixed there is almost no correlation whatsoever.

However, when you split them out, look at the difference. For Catholic schools, it appears that smaller schools deliver better NAPLAN results - the R-squared is 0.45, which is sort of reasonable but definitely not great. There is a weak correlation there.

But look at the state schools! The bigger the school, the better the results - and the R-squared is 0.7, which is pretty damned good.

Just remember one thing - this is looking at bugger all data. It's late, and I'm going to bed. I will crunch more numbers tomorrow and over the weekend.

1735099 - what's your opinion on this?

Sorry, Cav

I didn't get any good photos of bikes today, so it's back to crunching numbers from MySchool again. Yes, I must be weird - I find doing a spot of number crunching to be quite soothing and engaging.

Tonight's exercise was to pick another area of Sydney and to bring in another 15 school's worth of data. I chose the Auburn-Granville area, which is probably best known as being the home of a bloody big mosque. Most of the suburbs in the area are on the poor side, so pulling them in just added another slab of green dots to the graph above.

However, one dot appeared up the top - I had a look into it, and found that I had included the state school at Newington. This is one of those new suburbs that popped up after the Olympics on the old Naval armoury near Homebush. It's a very nice, middle class area. Brand new, very shiny. It's no surprise then that it sticks out like a sore thumb compared to Auburn, and has results on par with rich areas like the lower north shore and the inner west.

I've stuck in three purple markers though - these are middle income suburbs, but their results are crap. I went back and had a look at the data - these places are probably well known to most Sydneysiders as the home of drive-by shootings and Muslim gangsters. So the residents there are doing OK economically, but living in a crime infested neighbourhood in the midst of lots of gangsters is not that great for the school results. As 1735099 commented, values and community has a lot to do with it.

So next time someone starts raving that public education needs wads more money, ask them if more money will buy a better set of values. If not, tell them to keep their filthy hands out of your pockets.

MySchool - education bang for your buck

OK, just to keep Cav sane, this is the last post with numbers and graphs and things for tonight. Normal bike bum service will resume tomorrow.

I have made up a new index - the number of funding dollars per student required to produce one NAPLAN point.

That is, if a school gets $8,000 in funding per student, and the NAPLAN score is 2,000, then it takes $4 to produce each NAPLAN point. The lower the number, the more effective a school is at turning our money into education (or at least the ability to do NAPLAN tests - the two are not necessarily the same). But just go with me for a minute.....

I then decided to compare the "BOAB index of educational efficiency" with the ICSEA score for each school. The ICSEA score tells you how wealthy the area is. Let's see how things went....

For starters, there's a pretty wide spread in scores, and the trend line gives us an R-squared of 0.55. Here's how I interpret this graph - the poorer the area, the more money it takes to provide an education. If you compare a rich area with a poor area, it can take nearly double the amount of money to provide the same outcome in the poor area.

Here's the same graph, with the axes set to zero. I don't want you thinking that I'm manipulating things by playing with the axes.

I then separated out the Catholic schools. The R-squared here is 0.0398 - in other words, there's bugger all correlation between the two variables. In Catholic-land, the wealth of an area has almost no impact on how much it costs the Micks to bash knowledge into poor kids and rich kids.

With state schools, it's an entirely different picture. The R-squared here is 0.69 - pretty bloody good in my books. You can also see a clear split between two sets of schools - an upper shoal and a lower shoal.

I've then colour coded the two groups. The red dots are all state schools in rich areas; the green dots are state schools in a poor area. Wow - the difference really stands out.

I've then broken the numbers out for the state schools and divided them into rich and poor zones. The R-squared for the poor group is 0.088 - it's rooted. However, a 5 order polynomial gets up to 0.6.

However, for the rich group, the R-squared is 0.59. By stuffing around with a 5 order polynomial, I got that up to 0.77.

But what does all this tell us?

When it comes to State Schools, it's clearly a two speed system (although I'll have to delve into some other areas that are middle income to see how they fare). There is a massive divide in performance and cost between the state schools in rich areas and the state schools in poor areas. And it has to be remembered that all that extra money in the poor areas isn't buying results - the state schools in rich areas clearly outperform the state schools in poor areas.

I've taken that graph again and coloured in the Catholic schools in orange. A strange colour for Catholics, I know. However, what it shows is that there isn't the same divide as you get in the state system.

What cracks me up about this is that the haters of non-state education love to say that private education creates a gulf between rich and poor. Well, perhaps it does - but the state system is no better. If anything, it might be worse. If you want to prove me wrong, go away and crunch the numbers and see what you can come up with. I went into this exercise with an open mind - I just wanted to throw some numbers around to see what came up. I have to say that I'm quite shocked at the results.

MySchool - and now we examine Chatswood

This is the fourth in a quick series based on the MySchool website. If you've just arrived, scroll down a few posts and start at the beginning. This post is based on Chatswood, a wealthy area on Sydney's north shore. It has been so effectively colonised by successful Chinese immigrants from places like Hong Kong that a former staff member of mine (who was born and raised in HK) called it "Chatswoo", as in "it is full of people called Woo". The Chinese are notoriously pushy when it comes to education. Chatswood Public for instance has 83% of its students coming from LBOTE (Language Background Other Than English) - but it has the 2nd highest NAPLAN score out of all the schools in this sample. Just goes to show that a LBOTE background doesn't necessarily mean a lousy school performance.

The state school and Catholic ICSEA scores for 17 schools in the area are equal on 1189. By comparison, that's about 80 points higher than where I live (the higher the score, the wealthier the area).

The income quartiles paint a very nice picture of the area - there is almost no one in the Chatswood area in the lowest income quartile. The top quartile is packed for both state and Catholic schools.

The amount of funding that the schools get per head doesn't vary that dramatically in this area. Even the Independent school doesn't charge outrageous fees.

The ICSEA scores are also clustered together pretty closely - the scale on the left makes it appear that there is quite a difference, but as I've said before, in a wealthy area like this, the difference in scores is like comparing a family with a 5 series BMW to a 7 series BMW - and then comparing them to the people out in Fairfield in the 3rd hand Corolla.

There is a reasonable spread of NAPLAN results too, with the Catholics doing well up the top. However, all these scores are excellent. Looking at this table is like looking at the Gold, Silver and Bronze winners at the Olympics - the person that took away bronze is still an awesome athlete.

The above graph shows the total NAPLAN scores for Grade 3 compared to school funding per head. Again, this is pretty arbitrary for this area - those scores are all very good, and compared to a poor area like Fairfield, the amount of funding per head is low. In other words, all these schools provide good results at a reasonable cost.

This is where things get funky - this graph shows the results from three areas - a low income area and two high income areas. For this graph, I've increased the size of the markers for the Chatswood schools. What sticks out to start with is that all the Chatswood area schools on the top side of the NAPLAN scores. All of them. Same goes for the Five Dock schools - every one of them is on the top side of the line. With Fairfield, every state school is below that line - only the Catholic schools from that area are performing on par with the state schools and Catholic schools from the richer areas.

The second thing that struck me is that in terms of value for money (or scores for bucks), almost all the Catholic and state schools in the Chatswood area are good value. Most are in the top left hand quadrant - the "stars" quadrant. The four that don't make it are reasonably close to the line.

Here's the big challenge for policy makers - the problem schools are those below the line. In other words, in our sample, every single school in the poor area. They're either low cost and poor performance or high cost and poor performance. How do you improve their performance?

There are those that repeat endlessly that the problem is a lack of resources - that state schools need more resources. Well, I think I have just shown that not all state schools need more resources - those in rich areas are doing fantastically, and they're doing it with the same or less money than the state schools in poor areas.

Let's take the schools in the "sink" quadrant - low cost, low performance. Let's assume we throw more money at them - they can move in two directions. The preferred direction is to move towards "A", which is into the more expensive, but high performance quadrant. The worst possible result is for their results to flatline, but their costs to increase dramatically (option "B"). It would be interesting to look at the finances and results of these schools over time. For instance, were those schools in the bottom right hand quadrant in the bottom left hand quadrant a few years ago? Have they been showered with money, but done nothing useful with it? (Makes you wonder what impact all that BER spending is going to have).

What gets me about the above graph is that we are more likely to follow option "B" rather than option "A". Option A is not about throwing more money at the problem - it is about qualitative improvements in the school. It is about turning around the culture of these schools - something that's probably dreadfully difficult. It really is so much easier to just take more money from the taxpayer and talk loudly about throwing it their way, rather than doing the hard yards of micro reform.

The best possible result of course is to wind back the spending on the expensive under-performers whilst improving their results. Now that would certainly be a challenge - but this is the sort of thing that happens in business on a regular basis. Because if not, the business goes bankrupt. If you're a business and you're in that corner, basically you're fucked. It's time to turn around or liquidate.

Another option is to just accept that perhaps there isn't much that the schools can do for these kids, regardless of how much money we throw at them. What counts more highly is the background and culture of their families, and how much support and encouragement they give their kids. In that case, we do two things - we stop dreaming that all kids can be super stars, and we do our damnedest to identify the smart and capable kids in those areas and we yank them out as early as possible and send them to a good school in a good area, where they are surrounded by kids that support academic achievement. Or we give them a top-up voucher to send them to the local Catholic school if they are too poor to afford the extra fees.