<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title> &#187; Jose Ferreira</title>
	<atom:link href="http://www.knewton.com/blog/author/jose/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.knewton.com</link>
	<description></description>
	<lastBuildDate>Fri, 03 Feb 2012 14:32:00 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
		<item>
		<title>Greece&#039;s Pieces</title>
		<link>http://www.knewton.com/blog/knewton/from-jose/2010/05/20/greeces-pieces/</link>
		<comments>http://www.knewton.com/blog/knewton/from-jose/2010/05/20/greeces-pieces/#comments</comments>
		<pubDate>Thu, 20 May 2010 15:39:32 +0000</pubDate>
		<dc:creator>Jose Ferreira</dc:creator>
				<category><![CDATA[From Jose]]></category>
		<category><![CDATA[Knewton]]></category>
		<category><![CDATA[Greece]]></category>

		<guid isPermaLink="false">http://blog.knewton.com/?p=3153</guid>
		<description><![CDATA[Jose Ferreira is the Founder and CEO of Knewton When the EU formed in 1998, I was the crazy guy in the corner of the pub ranting to all my friends that it would one day come a cropper. Since there seems to be little appetite in Europe to fully ...<div class="readmore"><a href="http://www.knewton.com/blog/knewton/from-jose/2010/05/20/greeces-pieces/">Read this article &#8250;</a></div>]]></description>
			<content:encoded><![CDATA[<p><em>Jose Ferreira is the Founder and CEO of <a href="http://www.knewton.com/">Knewton</a></em></p>
<p>When the EU formed in 1998, I was the crazy guy in the corner of the pub ranting to all my friends that it would one day come a cropper. Since there seems to be little appetite in Europe to fully integrate and become a United States of Europe, the risk was high that the EU would inevitably fracture that a member state would one day have to leave. Now former Fed Chairman Paul Volcker seems to <a href="http://www.bloomberg.com/apps/news?pid=20601087&amp;sid=aASZ4SCDL3uQ&amp;pos=4">agree</a>. As the EU charter stands, it&#8217;s unclear how this would occur: the charter has pages upon pages about what it takes to get in, but not a single word about what it takes to get out.<br />
So, under what set of circumstances would a member withdraw? One likely culprit would be a localized recession like the one happening in Greece right now.</p>
<p>When a recession hits a localized area in America such as, say, Ohio, it might be because the local economy has a dearth of large industries, and those that it does have are suffering. Or perhaps local officials have made a series of poor economic policy choices over a number of years. Often, there&#8217;s also a larger downturn affecting the entire country or region. In the case of Greece, all of the above is true.</p>
<p>The EU, against its charter, is bailing Greece out. Much has been <a href="http://www.nytimes.com/2010/05/12/business/economy/12leonhardt.html">written</a> about the similarities between the current financial meltdown in Greece and the one that rocked the U.S. at the end of the 2008. America certainly shares some of Greece&#8217;s weaknesses: bitter partisanship, overly influential interest groups, and a spoiled populace that chronically spends beyond its means.<br />
Nevertheless, the respective crises in America and Greece differ significantly in ways fundamental to the differences between the U.S. and the EU. When the EU was formed and the Euro was adopted, Euro-cheerleaders applauded the efficiency of a unified market for goods and services (including labor). But economic size confers both plusses and minuses. While there was much back-slapping over the desirable effects of European Union, there was little thought given to the negative consequences.<br />
<span id="more-16654"></span></p>
<p>Under ordinary circumstances, largeness leads to more efficient interstate commerce. It can help make labor markets and capital markets more efficient, so that national resources (workers, federal dollars, etc.) naturally fill vacuums. But smallness has advantages as well. It gives a region control over its currency and interest rates&#8211; control that it would lose as part of a larger union.</p>
<p>But the EU has never been anything close to a fully integrated union. And, in practice, the EU confers only some of the benefits of largeness, while taking away all of the benefits of smallness.</p>
<p>In general, fluid labor markets are one of the greatest advantages to largeness and one of the most important defenses against localized recession. This is the case in America: if there&#8217;s a localized recession in one place, people leave the region and go where the jobs are. Most Americans don&#8217;t expect to settle in the town in which they were raised. Sure, there are regional differences, but most Americans can live with trading Dunkin Donuts for Peet&#8217;s Coffee, if it means they have a job. Europeans generally don&#8217;t think this way. There is no central language or culture in Europe. Most Greeks would be astonished if you suggested they move to Dusseldorf.</p>
<p>Capital markets are also generally more efficient in the U.S; money moves around more easily and efficiently, and better fills vacuums where it&#8217;s needed. So if the rustbelt suffers a downturn, capital might move in because it&#8217;s a good place to build new manufacturing plants, given all the high-skill, unemployed labor.</p>
<p>Large economies can also prop up underperforming regions with direct government investment.  The U.S. government often helps out individual states when they&#8217;re struggling. In Europe, doing so is illegal; it wouldn&#8217;t have happened with Greece except for this extraordinary crisis, and it may never happen again.</p>
<p>So the EU lacks some crucial benefits of largeness (at least relative to America). This wouldn&#8217;t be so bad if the member countries retained the advantages of smallness but the EU&#8217;s formation took most of these benefits away too.</p>
<p>Depending on their need, small countries typically have several very powerful tools to affect their economies. They can devalue their currency to make exports more competitive. They can print more money (increase the money supply) which will encourage inflation; that can be helpful (if risky) because increasing inflation reduces a country&#8217;s debts and payables both foreign (government bonds) and domestic (salaries and pensions). Countries can also increase interest rates to attract more foreign investment. Or they can lower interest rates to stimulate manufacturing and business expansion within their borders.</p>
<p>But small countries in the EU can do none of these things, since they control neither their interest rates nor their currency.</p>
<p>Greece is a telling example. When the Greeks joined the EU, they promised to hold their deficit at or below 3% of GDP. It&#8217;s currently around 14%. Because Greece operates at a deficit, each year it has to borrow money to pay the difference. It&#8217;s like Europe has its own 30-something child who lives in the basement, doesn&#8217;t really work, and keeps asking for money. The markets think Greece might default. (It very likely will.) So the markets, quite reasonably, are asking for higher fees to lend Greece money, making it even more difficult for Greece to pay its bills.</p>
<p>Why can&#8217;t Greece just stop spending? It could, but its debts are so great that it wouldn&#8217;t be enough. The Greeks could try to grow their way out of debt, as America did in the 90s. But America is a much more diverse, vibrant, and efficient economy. Greece is an economy whose three largest industries are tourism, shipping, and&#8211; olive oil?</p>
<p>If Greece controlled its currency, it could start pumping money into the system increasing inflation and devaluing its debt. This would effectively reduce the salaries and pensions of all Greek workers, including government workers (further improving the deficit) and private sector workers (making Greek businesses temporarily more profitable, and hence improving growth for a couple of years). But Greece doesn&#8217;t control their currency.</p>
<p>So instead, the rest of Europe is bailing Greece out. They are doing so because they are worried that their own banks own most of that Greek debt. They are also worried about the kind of domino effect we saw in the U.S. with Bear Stearns and then Lehman Brothers. In a crisis, markets always look to see who is the next worst off and proactively begin shying away from them.</p>
<p>But why would Germans, who work harder, save more, and retire later, subsidize lazy irresponsible Greeks? Eighty-eight percent of the German people opposed the bailout plan, and Angela Merkel&#8217;s government was certain to lose seats in their upcoming election if they supported the bailout. The German people, as we are finding out, aren&#8217;t quite the suckers we thought they were. Merkela&#8217;s government supported it nonetheless, and they paid a heavy price at the polls.</p>
<p>Since World War II, the Germans have been devoted to the agenda of fiscal prudence and European stability. Those twin goals had been conjoined; suddenly they are at odds. Apparently, the German governing class had just enough postwar guilt left for one last great effort on behalf of Europe. There won&#8217;t be another. Europe will have to choose between full integration and inevitable fracture.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.knewton.com/blog/knewton/from-jose/2010/05/20/greeces-pieces/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Is there really an NYC start-up boom? And if so, what&#039;s causing it?</title>
		<link>http://www.knewton.com/blog/knewton/from-jose/2010/03/29/is-there-really-an-nyc-start-up-boom-and-if-so-whats-causing-it/</link>
		<comments>http://www.knewton.com/blog/knewton/from-jose/2010/03/29/is-there-really-an-nyc-start-up-boom-and-if-so-whats-causing-it/#comments</comments>
		<pubDate>Mon, 29 Mar 2010 14:42:00 +0000</pubDate>
		<dc:creator>Jose Ferreira</dc:creator>
				<category><![CDATA[From Jose]]></category>
		<category><![CDATA[Knewton]]></category>
		<category><![CDATA[Venture Capital]]></category>

		<guid isPermaLink="false">http://www.knewtonblog.com/?p=2584</guid>
		<description><![CDATA[The San Francisco Bay Area has more VC firms and dollars invested than all East Coast cities combined. But the NY scene has recently been getting uppity. Chris Dixon wrote a story, the NY Times wrote a story, now Silicon Alley Insider. I tweeted that it was all embarrassing provincialism. ...<div class="readmore"><a href="http://www.knewton.com/blog/knewton/from-jose/2010/03/29/is-there-really-an-nyc-start-up-boom-and-if-so-whats-causing-it/">Read this article &#8250;</a></div>]]></description>
			<content:encoded><![CDATA[<p><a href="http://www.knewtonblog.com/wp-content/uploads/2010/03/spaceball.gif"><img class="aligncenter size-full wp-image-2590 colorbox-2584" title="spaceball" src="http://www.knewtonblog.com/wp-content/uploads/2010/03/spaceball.gif" alt="" width="1" height="1" /></a><span style="font-size: 13.2px;">The San Francisco Bay Area has more VC firms and dollars invested  than all East Coast cities combined. But the NY scene has recently been  getting uppity. Chris Dixon wrote a <a href="http://cdixon.org/2010/02/01/the-nyc-tech-scene-is-exploding/" target="_hplink">story</a>, the <em>NY Times</em> wrote a <a href="http://www.nytimes.com/2010/03/07/technology/07reboot.html?emc=eta1&amp;pagewanted=all" target="_hplink">story</a>, now Silicon Alley Insider. I <a href="http://twitter.com/Knewton_Jose/status/10143105524" target="_hplink">tweeted</a> that it was all embarrassing provincialism.  So who&#8217;s right?</span></p>
<p><strong>Both cities attract the very best and brightest. But NYC has  20 times more.</strong></p>
<p>The best programmers and internet entrepreneurs are in the Bay Area.  Don&#8217;t kid yourself about that, not even for a second. To paraphrase <em>Reservoir  Dogs</em>, NYers who even dream we&#8217;re in the same league ought to wake  up and apologize. Looking for a young SEO or SEM wiz? Want to have a  deep discussion about network effects vs. viral effects? Go west, young  entrepreneur. The practical experience and intellectual capital in the  Bay Area is light years beyond that of NYC &#8212; or anywhere else. Even  East Coast VCs &#8212; never mind entrepreneurs &#8212; barely know what network  effects are. They routinely confuse them with viral effects and/or  switching costs, or they confuse viral effects with word of mouth. It&#8217;s  pitiful. It&#8217;s only critical to your success, people; no reason to master  the fundamentals&#8230;</p>
<p>What NYC does attract, year in and year out, is the very best general  talent from around the world. The absolute smartest,  neurons-just-fire-faster, can-bend-spoons-with-their-mind talent. What  MBA types call &#8220;athletes.&#8221; The Bay Area gets the best of the web. NYC  gets the best of everything else. And NYC gets 10-20 times more.</p>
<p><span id="more-2584"></span></p>
<p>And this is where the Bay Area shouldn&#8217;t kid itself: we&#8217;re smarter  than you. Our geniuses are just as smart or smarter, and we have a lot  more of them. Not to mention that we also have WAY more domain expertise  &#8212; more on that later.</p>
<p>The entire Bay Area is tiny compared to NY, in terms of both  population and industry. NY&#8217;s size helps enormously for sourcing any job  not involving coding. But it even helps somewhat WRT coders. Knewton  has had great success taking some of that talent &#8212; US Math Olympic team  jocks, philosophy types with a masters degree in logic, and  award-winning young writing talent from (LOL) Stanford &#8212; and turning  them into coders and content specialists.</p>
<p>In years past, those best-and-brightest all came to NY and joined law  firms, the fashion world, or the financial industry. The talent&#8217;s still  coming. But those industries have all shrunk and/or are becoming less  alluring. The big beneficiary is the start-up scene. Sure, the pay  sucks.  But you could get rich, and the lifestyle is awesome&#8211;as is  doing something that actually matters.</p>
<p><strong>East Coast Funders<br />
</strong><br />
Historically, NYC hasn&#8217;t been known for the quality of its venture  capital. That may be changing. Bessemer, First Round Capital, and Union  Square Ventures are all killing right now. FirstMark is an up-and-coming  fund with a great current portfolio, including the en fuego  SecondMarket. Facebook-backer Accel is also active, investing in Etsy  and Varonis. (Knewton is backed by First Round, Accel, and Bessemer.)  Matrix invested in TheLadders, and just moved a partner to NY. Other NYC  companies that make internet geeks drool all over their iPads:  SeamlessWeb, Foursquare, HuffPost, Gilt, Meetup, Tumblr&#8230;</p>
<p><strong>The Valley Laughs</strong></p>
<p>Every time one of these stories comes out, I get emails all day long  from friends in the Valley making fun of what they see as NYC&#8217;s sad  little inferiority complex.  I mean &#8212; did you see <a href="http://www.businessinsider.com/the-25-new-york-city-startups-to-watch-2010-3" target="_hplink">Silicon Alley Insider&#8217;s 20 Hot New York City Startups</a>?  Half the picks are solid companies that Valley investors are mildly  interested in. But the other half elicit only gloating chuckles from my  B-school pals who gleefully send me the link, along with some variant  upon: &#8220;If NYC is so great, how come _______ is on this list?&#8221;</p>
<p>Seriously people, we&#8217;ve got to stop writing these stories. They&#8217;re  making us look silly. Or, if you are going to write them, at least  include <a href="http://www.knewton.com/" target="_hplink">Knewton</a>!  Sheesh!<br />
<strong><br />
<a href="http://en.wikipedia.org/wiki/Domain_expert" target="_hplink">Domain  Expertise</a></strong></p>
<p>This is probably the biggest difference between the Bay Area and NY,  and the most auspicious sign of NYC&#8217;s continued ascension. It&#8217;s also a  key point missing from the vapid NYC cheerleading we&#8217;ve been reading  recently. So here it is: NYC has vastly more domain expertise in every  non-tech industry than does the Bay Area.</p>
<p>For those starting a web company today, the relative value of  industry expertise vs. Internet savvy is much higher than it was ten  years ago. Jeff Bezos was one of those best and brightest who came to NY  to work in finance. He didn&#8217;t need to know anything about retail  bookselling to start Amazon. If Amazon were started today, though, it  would be by some kid from Barnes &amp; Noble, and it would be based in  NY &#8212; for the same reason that Gilt, TheLadders, Gerson Lehrman Group,  SeamlessWeb and HuffPost all started here.</p>
<p>The gap in Internet expertise has narrowed: every major corporation  in the country has dev teams, SEO/SEM specialists, and blogging/social  networking gurus. It&#8217;s not like hanging out on University Avenue in Palo  Alto, but you can find acceptable web talent in big NYC corporations.  Meanwhile, the gap in domain expertise is still vast&#8211;creating a  relative advantage for NY entrepreneurs.</p>
<p>So if you&#8217;re at some random big business and you see a great  opportunity that your company is too big/dumb/slow to pursue, or won&#8217;t  pursue due to an Innovator&#8217;s Dilemma dynamic, chances are you&#8217;re in NYC.  You can find web talent within your company that you couldn&#8217;t ten years  ago. You may even be one of those people yourself. And you can now  raise very high-quality money in NY, which you couldn&#8217;t do ten years  ago.</p>
<p>In the end, it is this structural advantage that&#8217;s inexorably helping  to create more hot start-ups in NY. And that underlying structure bodes  well for NYC&#8217;s continued gradual ascension.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.knewton.com/blog/knewton/from-jose/2010/03/29/is-there-really-an-nyc-start-up-boom-and-if-so-whats-causing-it/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>A Short History of the Standardized Test Prep Industry</title>
		<link>http://www.knewton.com/blog/edtech/2010/02/17/a-short-history-of-the-standardized-test-prep-industry/</link>
		<comments>http://www.knewton.com/blog/edtech/2010/02/17/a-short-history-of-the-standardized-test-prep-industry/#comments</comments>
		<pubDate>Wed, 17 Feb 2010 14:26:30 +0000</pubDate>
		<dc:creator>Jose Ferreira</dc:creator>
				<category><![CDATA[EdTech]]></category>
		<category><![CDATA[Education & Technology]]></category>
		<category><![CDATA[From Jose]]></category>
		<category><![CDATA[Inside Knewton]]></category>
		<category><![CDATA[Knewton]]></category>
		<category><![CDATA[Test Prep]]></category>
		<category><![CDATA[huffington post]]></category>
		<category><![CDATA[stanley kaplan]]></category>

		<guid isPermaLink="false">http://www.knewtonblog.com/?p=2188</guid>
		<description><![CDATA[I&#8217;ve been writing more on the Huffington Post recently, and my latest piece is a history of the standardized test prep industry. What started with one man became a massive, international business, and my experience in that business is what motivated me to found Knewton. Here&#8217;s the full story: The ...<div class="readmore"><a href="http://www.knewton.com/blog/edtech/2010/02/17/a-short-history-of-the-standardized-test-prep-industry/">Read this article &#8250;</a></div>]]></description>
			<content:encoded><![CDATA[<p>I&#8217;ve been writing more on <a href="http://www.huffingtonpost.com/jose-ferreira" target="_blank">the Huffington Post</a> recently, and my latest piece is a history of the standardized test prep industry. What started with one man became a massive, international business, and my experience in that business is what motivated me to found Knewton.</p>
<p>Here&#8217;s the full story:</p>
<p><strong>The test prep industry</strong> began in Stanley Kaplan&#8217;s Brooklyn basement just after World War II. The son of Jewish immigrants, Stanley believed standardized tests were some kind of elitist plot to keep minorities out of the Ivy Leagues. His philosophy was that anybody could improve at standardized tests. The testing industry and larger education establishment loudly proclaimed that idea to be wrong, foolish, and practically immoral. But Stanley, standing alone for a long time, was proven right.</p>
<p><span id="more-2188"></span></p>
<p>In 1984, The Stanley H. Kaplan Company was bought by the Washington Post/Newsweek Company. The <em>New York Times</em> laughed. Today Kaplan, if it were a standalone company, would be bigger than the rest of The <em>Post</em> and The <em>Times</em> combined.</p>
<p>I joined Kaplan in 1991. I had just graduated from college and moved to San Francisco without a job. It was the middle of a pretty bad recession, but the good news was that I had majored in Philosophy. Turns out that made me unemployable. To try to improve my writing skills, and because I had nothing else to do, I wrote a book. Kind of a techno-thriller in the style of Michael Crichton, only without characters you could identify with or a plot you could comprehend. It wasn&#8217;t published.</p>
<p>I also began taking standardized tests for fun &#8212; in the morning with a cup of coffee, the way other people do crosswords. I found a hidden structure to standardized tests that makes them a lot easier.</p>
<p>A friend said &#8220;You should teach for Stanley Kaplan.&#8221; So I did.</p>
<p>At the time, Kaplan&#8217;s product consisted of 36 hours of live instruction in nine four-hour classes. The curriculum was heavy on content and light on strategy. Or anything fun. By hour four, the class resembled not so much a roomful of go-getters as it did a clinic for narcolepsy. The course also featured a lot of practice material you could only access at the local Kaplan center. Audiotaped explanations were provided via bulky old tape players from kindergarten. Students from other parts of the country found the heavy Brooklyn accents incomprehensible. It was like having Luca Brasi from The Godfather explain algebraic equations to you. But Kaplan management was very proud of the tapes. Without irony they referred to them as &#8220;technology.&#8221;</p>
<p>Students weren&#8217;t allowed to keep their lesson books. At the end of each class, they were required to hand that day&#8217;s booklet back in. This drove students insane. But Kaplan management believed that students only took the course because of &#8220;the secrets&#8221; in the lesson booklets &#8212; yes, arcana like &#8220;arithmetic&#8221; and &#8220;triangles.&#8221; By forbidding students from keeping content they&#8217;d already paid for, Kaplan was saying in effect, &#8220;We&#8217;re more worried about our students stealing our intellectual property than about improving their scores.&#8221; Which, of course, giving them the materials would tend to do.</p>
<p>While Kaplan was sharing this revolutionary customer service philosophy with the world, a small company was being started by Princeton grads John Katzman and Adam Robinson. The Princeton Review (&#8220;TPR&#8221;) electrified the test prep world with its &#8220;Joe Bloggs&#8221; system, based on how a perfectly average shmoe would answer any given question. Easy questions had answers that looked right to Joe Bloggs; difficult questions had answers that looked wrong. Joe Bloggs was fun to teach and to learn. But it was fixable; the test-makers could change their tests to kill Joe Bloggs. And, since John Katzman loved nothing so much as mocking the tests publicly, that&#8217;s precisely what they did. RIP Joe Bloggs.</p>
<p>The smartest thing Katzman did was create test prep guides for bookstores. Kaplan, with their <a href="http://en.wikipedia.org/wiki/Dr._Strangelove" target="_blank">General Jack D. Ripper</a>-esque obsession with secrecy, had of course never published a bookstore product. So TPR had the shelves all to themselves; Katzman used bookstores as a marketing channel to spread the TPR brand. Instead of bleeding cash to build the TPR brand, Katzman found a way to get paid to do it. TPR rose quickly, and Kaplan, with their audio tapes and lesson book lockdown, quickly lost market leadership in SAT prep.</p>
<p>Fortunately for Kaplan, The Post Co&#8217;s <a href="http://en.wikipedia.org/wiki/Donald_E._Graham" target="_blank">Don Graham</a> began to make changes, replacing the ancien regime with a team of Harvard Business School grads. Kaplan&#8217;s new CEO, Greg Rorke, had previously turned around Danskin. Now he got Kaplan focused on technology for the first time. He brought in a lot of charm and energy. He also brought in Jonathan Grayer, who would eventually replace him, from <em>Newsweek</em>&#8216;s ad division. Stanley was still around, but only in an avuncular, non-executive kind of way. Eventually he lost the corner office.</p>
<p>The new Kaplan, minus Stanley, faced a challenge other than new competition: computerized testing. The Educational Testing Service (ETS), long-time publisher of the GRE, SAT, and GMAT, was moving the GRE and GMAT to computer format. Since computer tests are given five days a week rather than five times a year, this would inevitably disrupt Kaplan&#8217;s entire sales infrastructure and field operations. It would presumably also require us to develop technology more sophisticated than audiotapes.</p>
<p>I was made GRE Product Director. My marching orders were to &#8220;figure out this computer thing,&#8221; and quickly make product for a brand new GRE question type called &#8220;Pattern ID&#8221;&#8211;a bewildering cocktail of math and logic that befuddled everyone who saw it. Most people couldn&#8217;t even understand the directions. But it could be batch-created by computers in vast quantities. Since computerized testing requires lots of questions in order to be secure, Pattern ID was a godsend for ETS.</p>
<p>Almost accidentally, I created a Pattern ID strategy that was so powerful that students could get all the questions right without doing any work. I was conflicted. If I kept quiet and let ETS administer Pattern ID on scored exams, ETS would eventually be compelled to cancel every score, affecting hundreds of thousands of students. I had delusions of making it into <em>Time</em> magazine. But doing so would force all those students to retake the GRE. Instead, I gave ETS a heads-up. They wound up throwing away hundreds of thousands of test booklets and tried to forget about Pattern ID. One of them offered me a job.</p>
<p>ETS admitted to a major periodical, and by that I mean the Louisiana State University <em>Daily Reveille</em>, that I &#8220;<a href="http://www.knewton.com/press/reveille" target="_blank">broke the code and published it, so we are removing the questions from the test</a>.&#8221; This marked the only time in the history of standardized testing that a major test-maker admitted they removed questions because they&#8217;d been decrypted by a coaching strategy. Kaplan put that quote on every direct mail postcard they sent out for something like ten years. Even nursing students in the Philippines got postcards about it.</p>
<p>ETS&#8217;s problems with Pattern ID did not slow their drive to administer tests on computer. They launched the computerized GRE in 1994, with plans for the GMAT to follow soon. Pattern ID had taught me that the more tests are based on programmatic rules, the easier it is to break open their underlying structure. I sent researchers to take the new test and immediately discovered two new Pattern ID-sized fiascoes.</p>
<p>First, I reverse-engineered the scoring algorithm. I found multiple weaknesses and began coaching students to skip the last questions in each section and spend the extra time on the first questions. This produced score gains of up to 100 points per section. ETS later admitted as much to <a href="http://www.knewton.com/press/us_news_1" target="_blank"><em>U.S. New</em>s</a> and started recommending it themselves to level the playing field. That was another first: the test-maker giving advice to students on how to game their own system! Eventually they gave up and rebuilt the algorithm to make this approach less effective.</p>
<p>Second, I reverse-compiled the question pool. The way it works is: computerized tests require the same pool of questions to be used for weeks at a time. So question pools have to be enormous to prevent cheating. But my researchers were all seeing a dozen or more of the same questions&#8211;almost mathematically impossible if the pool is large enough. Since ETS had testified under oath before the New York State Senate that the pool was indeed large enough, this had the potential to be perhaps the most fascinating statistical anomaly of all time.</p>
<p>The question pool we handed over to our accounting firm, Price Waterhouse. Then we contacted ETS and said something along the lines of, &#8220;Umm&#8230; wow, this is a little awkward, but we have your test.&#8221; At first, ETS issued a press release thanking us. Two weeks later they sued us on the basis of copyright infringement and named me personally as a defendant. Don Graham, in a visit thereafter to Kaplan headquarters, placed his hand on my shoulder and said, &#8220;You know, you&#8217;re the youngest person ever to get the <em>Washington Post</em>/<em>Newsweek</em> Company sued!&#8221; Lucky for me, he seemed more bemused than anything else.</p>
<p>Deans and docents around the country had been calling ETS asking if the GRE could be trusted&#8211;not questions you want to hear asked about your eight-figure investment in computerized testing. So they sued Kaplan and told everyone else not to worry, that only a fiendish mastermind could compromise their test&#8217;s security. In reality, though, pretty much any buffoon at your college fraternity could have compromised that test.</p>
<p>The parties agreed to a token settlement. Later on it emerged that ETS had for some time been referring to me as &#8220;the antichrist.&#8221; Needless to say, we didn&#8217;t put <em>that </em>on any postcards.</p>
<p>Jonathan Grayer, now CEO, tabbed me with leading a Kaplan-wide initiative called &#8220;Project Footprint,&#8221; the stated purpose of which was to build everything from scratch the way it ought to be built. We streamlined the course to 8 three-hour classes, employing a &#8220;Preview-Classroom-Review&#8221; architecture I took from a GRE course I&#8217;d previously created. We replaced the audiotapes with CDs. And, of course, we let students keep their materials.</p>
<p>I left Kaplan shortly thereafter to go to Harvard Business School. My timing was impeccable. Kaplan went on a tear that continues unabated today, growing from around $70 million in annual revenue to around $2.5 billion.</p>
<p>Kaplan&#8217;s new leaders weren&#8217;t education people. Some of them referred to our products as &#8220;widgets,&#8221; admitting they would be just as happy selling Charmin or dreaming up new marketing campaigns for the Frito Bandito. It often seemed to me that they considered test prep just about the most stupid little industry ever devised by man. And maybe it is, though they have done a marvelous job of making it a bigger industry. They&#8217;ve accomplished this by being obsessed with numbers, calling area managers every day to get the latest. Unfortunately, the numbers they&#8217;re obsessed with are daily revenues, not student score increases.</p>
<p>Today&#8217;s Kaplan course is not very different from the one I built in Project Footprint: still 20-odd hours, with the same Preview-Classroom-Review architecture. As far as I can tell, Kaplan&#8217;s biggest innovation in the last decade has been to realize that many people aren&#8217;t ultimately price sensitive when it comes to determining their entire future. When I first started at Kaplan, the price of a GMAT course was $590. Today it&#8217;s $1,490.</p>
<p>What&#8217;s now clear is that the traditional business model of local &#8220;Strip Mall Test Prep&#8221; is hopelessly archaic. Nearly all the money you spend on old-school test prep is wasted on local teachers, centers, center staff, and marketing. And all the paper, printing, shipping, and commuting requirements are about as eco-friendly as a coal-fired thermometer factory. These things used to be necessary for product delivery, but never added to product quality. Now they&#8217;re just the waste byproducts of a bloated, outdated infrastructure, propped up by your hard-earned dollars. The future of test prep is online, and moving there quickly. Instead of having a mediocre teacher, you&#8217;ll get the very best teachers and test experts in the country, any time you want, for as much time as you need, for a lot less money. I started <a href="http://knewton.com/" target="_hplink">Knewton.com</a> to do exactly that.</p>
<p>People always ask me whether I think standardized tests actually measure anything. I used to give nerdy statistical answers about scoring validity and concordance tables. Eventually I realized that what these people want to hear is: &#8220;Standardized tests combine the diagnostic efficiency of a banana republic health care system with the personal touch of the airport immigration line.&#8221; It helps to throw in a reference to the Nazis for good measure.</p>
<p>The reality is that standardized tests are very effective predictors of academic success in college or graduate school. That&#8217;s a fact of statistics, whether we like it or not. It&#8217;s also just an average, and you may be an exception one way or the other. That&#8217;s why standardized tests are just part of the application process, and are never (or, should never be) the most important part.</p>
<p>Another pop psychology protest is that standardized tests are ipso facto biased against minorities since African Americans and Hispanics on average underperform the mean. This argument is about as logical as divorcing your spouse upon reading that most billionaires are single. Other minority groups perform at or above the mean, so the issue isn&#8217;t ethnic identity. And it isn&#8217;t the tests; every question is now statistically vetted to eliminate any cultural bias. The failure is in society itself.</p>
<p>Yet a growing number of colleges say standardized tests don&#8217;t measure anything and are making the SAT voluntary. Some of these schools use intellectually dishonest arguments like: &#8220;high school grades are a better predictor of college performance.&#8221; That&#8217;s true, but high school grades combined with SAT scores are a better predictor still. So why not use them? After all, getting more information can&#8217;t possibly hurt&#8211;can it?</p>
<p>My suspicion is that schools making the SAT voluntary are doing so for affirmative action purposes. In 2003, the Supreme Court significantly narrowed the allowable use of affirmative action in university admissions. Shortly thereafter, admissions rates across the country declined for Hispanics and African Americans. Since these groups historically underperform the mean, SAT scores tend to be a mildly deflationary force on their overall admissions rates. The ivory tower solution? Drop the test so that affirmative action admits are easier to justify. And, wherever possible, shoot the messenger. It&#8217;s come full circle: The folks who marginalized good ol&#8217; Stanley Kaplan, who once demanded standardized tests in order to keep minorities out, now attack the tests so they can let more minority candidates in.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.knewton.com/blog/edtech/2010/02/17/a-short-history-of-the-standardized-test-prep-industry/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Google&#039;s got the goods on China</title>
		<link>http://www.knewton.com/blog/edtech/2010/01/19/googles-got-the-goods-on-china/</link>
		<comments>http://www.knewton.com/blog/edtech/2010/01/19/googles-got-the-goods-on-china/#comments</comments>
		<pubDate>Tue, 19 Jan 2010 14:03:12 +0000</pubDate>
		<dc:creator>Jose Ferreira</dc:creator>
				<category><![CDATA[EdTech]]></category>
		<category><![CDATA[Education & Technology]]></category>
		<category><![CDATA[From Jose]]></category>
		<category><![CDATA[Knewton]]></category>
		<category><![CDATA[Technology]]></category>
		<category><![CDATA[china]]></category>
		<category><![CDATA[google]]></category>

		<guid isPermaLink="false">http://www.knewtonblog.com/?p=1796</guid>
		<description><![CDATA[Starting this week, Jose is a featured blogger on The Huffington Post. Here&#8217;s his first piece on the Google-China showdown. &#8211; Google is playing hardball. After last week&#8217;s ultimatum, the search giant appears to have left itself no way out: either China allows Google to operate uncensored or Google leaves ...<div class="readmore"><a href="http://www.knewton.com/blog/edtech/2010/01/19/googles-got-the-goods-on-china/">Read this article &#8250;</a></div>]]></description>
			<content:encoded><![CDATA[<p><em> </em></p>
<p><em>Starting this week, Jose is a <a href="http://www.huffingtonpost.com/jose-ferreira">featured blogger</a> on The Huffington Post. Here&#8217;s his first piece on the Google-China showdown.</em></p>
<p><em>&#8211;<br />
</em></p>
<p>Google is playing hardball. After <a href="http://venturebeat.com/2010/01/12/google-threatens-to-pull-out-of-china-after-activist-accounts-are-hacked/">last week&#8217;s ultimatum</a>, the search giant appears to have left itself no way out: either China allows Google to operate uncensored or Google leaves China. Why would Google posture like that? Surely it&#8217;s not serious about leaving China. What would be the point? Why would a company like Google make feeble idealistic gestures that will hurt its business and ultimately help no one else?</p>
<p>There must be a missing fact that makes this puzzle come together. My guess is that Google can prove that the Chinese government was behind the recent cyber-attack. There probably isn&#8217;t any <em>real </em>proof yet, but all Google needs is enough proof to sentence China in the court of public opinion.</p>
<p>Google&#8217;s real threat to China is not that it will leave the country. It&#8217;s that it will embarrass China and damage its national reputation as a place to do business. On the other hand, if Google can convince China to end or reduce the censorship restrictions on its search engine, then Google will have a significant competitive advantage over market leader Baidu.</p>
<p>The way I figure it, Google believes it can pressure to China to loosen, though not lift, restrictions on Google&#8217;s searches while keeping them firm on Baidu&#8217;s presumably China can be counted on to do the minimum loosening possible. Such asymmetric loosening would be a significant competitive advantage for Google in the world&#8217;s biggest Internet market (and one where Google is lagging behind Baidu by a margin of 2:1).</p>
<p>This is the only sense I can make of Google&#8217;s actions. Of course, perhaps they&#8217;re just being stupid&#8230;</p>
]]></content:encoded>
			<wfw:commentRss>http://www.knewton.com/blog/edtech/2010/01/19/googles-got-the-goods-on-china/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The GMAT or the GRE?</title>
		<link>http://www.knewton.com/blog/knewton/from-jose/2009/10/07/the-gmat-or-the-gre/</link>
		<comments>http://www.knewton.com/blog/knewton/from-jose/2009/10/07/the-gmat-or-the-gre/#comments</comments>
		<pubDate>Wed, 07 Oct 2009 18:11:52 +0000</pubDate>
		<dc:creator>Jose Ferreira</dc:creator>
				<category><![CDATA[From Jose]]></category>
		<category><![CDATA[GMAT]]></category>
		<category><![CDATA[GMAT Tips]]></category>
		<category><![CDATA[Knewton]]></category>
		<category><![CDATA[MBA Admissions]]></category>
		<category><![CDATA[GRE]]></category>

		<guid isPermaLink="false">http://blog.knewton.com/?p=488</guid>
		<description><![CDATA[Jose Ferreira is the Founder and CEO of Knewton. You may have heard that some business schools* have started accepting GRE scores in place of GMAT scores. And you may be thinking: &#8220;Awesome! I hear the GRE is easier. I&#8217;m taking that!&#8221; After all&#8212;there&#8217;s no Data Sufficiency on the GRE. ...<div class="readmore"><a href="http://www.knewton.com/blog/knewton/from-jose/2009/10/07/the-gmat-or-the-gre/">Read this article &#8250;</a></div>]]></description>
			<content:encoded><![CDATA[<p>Jose Ferreira is the Founder and CEO of <a href="http://www.knewton.com">Knewton</a>.</p>
<p>You may have heard that some business schools* have started accepting GRE scores in place of GMAT scores. And you may be thinking: &#8220;Awesome! I hear the GRE is easier. I&#8217;m taking that!&#8221;</p>
<p>After all&#8212;there&#8217;s no <a href="http://blog.knewton.com/2009/08/17/data-sufficiency-nurture-over-nature/">Data Sufficiency</a> on the GRE. Sounds great, right?</p>
<p>The problem is: There&#8217;s no Data Sufficiency on the GRE.</p>
<p>The GMAT has been designed and perfected for business school students. GMAT questions mirror the tasks you will perform every day in business school. Reading Comprehension&#8212;because you&#8217;ll be reading 50 -100 pages in case studies every day. And Data Sufficiency&#8212;because you&#8217;ll be skimming each case&#8217;s exhibits and financials to determine which numbers are key to cracking the case and which are irrelevant. What about <a href="http://www.knewton.com/gmat/tour/critical_reasoning">Critical Reasoning</a>? Well, every day in class you will comment on other students&#8217; arguments. And they will comment on yours, sometimes in pretty snarky ways. So you need some facility in arguments, if only to protect yourself from that loudmouth ex-banker in the Skydeck.</p>
<p>In fact, the GMAT is a great test. By that I don&#8217;t mean that it will bring peace to the world, or spiritual enlightenment, or that a good time will be had by all. I mean it&#8217;s extremely well-constructed, with very high scoring consistency. In short, the GMAT does an excellent job of testing the skills you need to excel in business school.</p>
<p>In contrast, the GRE General Test is, well, general. It is designed to provide a sense of the fitness of a student for graduate-level work, whether one is interested in pursuing a PhD in English or a Masters in Psych. But the aptitudes needed to succeed in one discipline are very different from those of other disciplines, and no single test can measure them all well. Success in business, and success in business school, requires very specific skills that the GRE measures poorly, and the GMAT measures very well.</p>
<p><span id="more-656"></span>Furthermore, the GRE has been a rather troubled test. (ETS might claim that I&#8217;m the one who <em>caused</em> their troubles; in fact, I merely shed light on them.) In the 1990s, I developed a strategy for one question type called Pattern Identification that was so devastating that ETS had to discard hundreds of thousands of printed test booklets, admitting that I &#8220;<a href="http://www.knewton.com/press/reveille">broke the code, so we are removing the questions from the test</a>.&#8221; Later on, I reverse-engineered the <a href="http://en.wikipedia.org/wiki/Graduate_Record_Examination#Historical_susceptibility_to_cheating">security protocols</a> and <a href="http://www.knewton.com/press/us_news_1">scoring algorithm</a> of the early GRE computerized test, forcing them to pull the exam for months to fix problems I uncovered. They sued us, and took to calling me the &#8220;antichrist.&#8221; (Umm, do I at least get <em>Connie Nielsen</em> with that?) Later still, they had serious scoring problems with the GRE analytical section, and consequently did away with that section entirely.</p>
<p>So then why do any business schools accept the GRE? Ok, well for one thing the GRE is slowly but surely getting better, and it&#8217;s about to be significantly revised so it will probably improve still further. But mostly, it&#8217;s about access, especially internationally. The GMAT isn&#8217;t available in as many locations, especially overseas. So business schools figure, &#8220;Hey, if we accept the GRE, we&#8217;ll find some great candidates who might not have been able to apply to business school, or who might add an MBA application or two along with their Masters applications.&#8221;</p>
<p>Bottom line: if you can take the GMAT, you should. The GMAT tests skills specific to business school. While admissions officers at schools accepting the GRE will <em>accept</em> a GRE score in lieu of a GMAT score, they doesn&#8217;t mean that they&#8217;ll will <em>trust</em> GRE scores.Â  And if you give them a GRE score when it&#8217;s clear you could just as easily have taken the GMAT, it could hurt your application.</p>
<p>Besides, Data Sufficiency is fun! Well, here at Knewton we think it&#8217;s fun. (Though we also think puns about transfinite cardinality** are hilarious.) More importantly for you, Data Sufficiency is equally hard for everybody. It is also highly coachable, and Knewton&#8217;s <a href="http://www.knewton.com/gmat/course/ultimate_test_experts">Test Experts</a> have developed the most powerful Data Sufficiency strategies there are. Stay tuned and maybe I&#8217;ll blog about them&#8230;</p>
<p>&#8212;-<br />
*MBA programs accepting GRE scores include Harvard, MIT, NYU, Stanford, Virginia, Yale, U Penn, and Berkeley.</p>
<p>**One of our math guys&#8217; last name is Naul. And his middle name is Alan. Like I said&#8212;hilarious!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.knewton.com/blog/knewton/from-jose/2009/10/07/the-gmat-or-the-gre/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>The GMAT and India</title>
		<link>http://www.knewton.com/blog/knewton/from-jose/2009/08/24/jose-ferreira-gmat-india/</link>
		<comments>http://www.knewton.com/blog/knewton/from-jose/2009/08/24/jose-ferreira-gmat-india/#comments</comments>
		<pubDate>Mon, 24 Aug 2009 21:05:38 +0000</pubDate>
		<dc:creator>Jose Ferreira</dc:creator>
				<category><![CDATA[From Jose]]></category>
		<category><![CDATA[GMAT]]></category>
		<category><![CDATA[GMAT Tips]]></category>
		<category><![CDATA[Knewton]]></category>
		<category><![CDATA[india]]></category>

		<guid isPermaLink="false">http://blog.knewton.com/?p=254</guid>
		<description><![CDATA[I wanted to take some time to dispel a fascinating&#8212;but unhealthy&#8212;rumor about the GMAT. This rumor is best summarized by a concerned Knewton student who wrote me the following: I was speaking to someone in India in the test prep industry about the GMAT and that person seemed very confident ...<div class="readmore"><a href="http://www.knewton.com/blog/knewton/from-jose/2009/08/24/jose-ferreira-gmat-india/">Read this article &#8250;</a></div>]]></description>
			<content:encoded><![CDATA[<p>I wanted to take some time to dispel a fascinating&#8212;but unhealthy&#8212;rumor about the GMAT. This rumor is best summarized by a concerned Knewton student who wrote me the following:</p>
<p><em>I was speaking to someone in India in the test prep industry about the GMAT and that person seemed very confident that the database of questions for the <a href="http://www.knewton.com/gmat">GMAT test</a> in India is different from the database of questions in the US and Canada (the pool of questions in India being harder). Have you heard anything like this?</em></p>
<p>And here is how I responded:</p>
<p>You&#8217;ve touched upon some topics that interest me a great deal, so let me give you a longer answer.</p>
<p>The test-makers have always used multiple question pools at any one time, even within the United States. This is done for security reasons, so questions can&#8217;t be pirated&#8212;something I know quite a lot about. (I once reverse-engineered the computerized test and proved the question pool at the time was much too small, and hence susceptible to cheating. The test-makers pulled the exam for months and implemented the changes I and others recommended&#8212;adding more questions, rotating pools, etc.) Question pools rotate every few months. Pools used internationally either just came from and/or will soon head back to North America. These pools are all (almost) perfectly calibrated with each other so that your score on one continent will be&#8212;within the margin of error&#8212;your score on another.</p>
<p>My suspicion is that you&#8217;ve heard some kind of urban myth that has its roots in:</p>
<ul>
<li>paranoia that U.S. schools are too full of Indians and want to restrict their numbers</li>
<li>chauvinism that Indians are smarter/better at math</li>
</ul>
<p><span id="more-254"></span>There is nothing true about the assertion you&#8217;ve heard. If anything, the opposite is closer to the truth. One of the early consequences of standardized tests in the U.S. is that they led to greater acceptance of candidates who weren&#8217;t Anglo-Saxon white males. In the early days, that meant more Jewish Americans. Then it began to mean more minorities of all kinds, including women as schools became co-ed. Standardized tests have been and continue to be the single most important factor in leveling the playing field for qualified minority candidates. Ironically, this is precisely the reason that some U.S. schools are now drifting away from standardized tests&#8212;so they can alter their own standards for acceptance. Due to failings in society itself, and not in the tests, U.S. minorities underperform Caucasians. The hard, unforgiving metrics of standardized tests make it difficult for some schools&#8217; admissions departments to accept as high a percentage of minorities as they would like. So, blaming the messenger, these schools have stopped looking at test scores, so as to give themselves &#8220;permission,&#8221; in a sense, to accept more candidates they otherwise wouldn&#8217;t.</p>
<p>Schools are trying to increase their international exposure, not decrease it. Harvard Business School grads occupy one of the top three positions at something like fifty percent of U.S. Fortune 500 companies. With India and China developing rapidly, HBS and other top schools are eager&#8212;even desperate&#8212;to mirror that dominance in Indian and Chinese companies. Take my word for it&#8212;having gone to HBS and seen their admissions practices firsthand (as well as their legendary habit of nickel and diming their students!)&#8212;Harvard Business School is as much or more about Business than it is about School. HBS is, at its core, a factory churning out top business leaders. Those leaders then turn around and give generously to the endowment. That&#8217;s the model all B-schools operate under, and it only works if they admit whoever they think will be the most successful.</p>
<p>As for the chauvinism argument: No one race has naturally greater math intuition than another. Some societies or microsocieties are practically better, on average, for cultural/parental/educational reasons. But the GMAT doesn&#8217;t measure who knows more math. It measures math intuition and aptitude&#8212;which is why the questions are based on arithmetic/algebra/geometry, not on advanced math. It helps to know more math&#8212;it makes you more familiar with the content and makes you faster, etc. But it&#8217;s not a big advantage.</p>
<p>The GMAT has this just right. Math intuition is very useful to business managers, while deep knowledge of math is not. Math intuition helps inform many of the judgments and decisions made by business leaders. Deep knowledge of math, on the other hand, is a commodity that can be bought inexpensively, since it&#8217;s continually rolling off the assembly lines of MIT and other top quant programs every year. This is why the GMAT focuses on intuition and speed, and that&#8217;s why we work so hard at Knewton to develop your intuition and speed.</p>
<p>In my experience, people who get caught up in this kind of thinking are damaging themselves. Paranoia and chauvinism don&#8217;t generally improve one&#8217;s odds of success in business. What does improve your odds of success is the ability to work well with all kinds of people, and favoring diversity of opinion and skills rather than uniformity. And that&#8217;s exactly what you&#8217;ll learn at every major business school today.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.knewton.com/blog/knewton/from-jose/2009/08/24/jose-ferreira-gmat-india/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>
