Genetic Algorithms in Multivariate Email Optimization
Over the past few months, Belly has worked on an in-house email delivery and optimization service that makes it a lot easier for us to run tests and quickly optimize campaign performance over time. We use a variety of real-time and batch processing technologies to make this happen, and I’d like to quickly dive into one of the more exciting things this new system enables.
Emails in our system are broken down into three high level delivery types: Transactional, Scheduled, and One-Off (marketing). Examples of transactional emails in our system include User Registration via iPad, Registration via Mobile, First Visit At Business, and Forgotten Password Requests. Scheduled emails are delivered in batches or via a State Machine and include things like New Merchant Day 3/15/28, Merchant Offline iPad reminders, Monthly Member Digests, and New User Drip Campaigns. One-off Marketing emails in our system have by far the highest variability in open rates, call to action click throughs, and unsubscribes and therefore have the most to gain from an intelligent optimization system.
All emails we send out are versioned with templates maintained in our database and use Shopify Liquid to support dynamic content blocks (including a Business’s logo, a list of rewards, nearby businesses, etc.), Zurb Ink to be responsive on mobile devices, and custom template markers to support user-defined variables. User-defined variables allow us to test multiple variations of the same email version simultaneously to test the effectiveness of call to action buttons, subject lines, banner images, copy, and completely different blocks of HTML entirely.
Where’d The Water Go? Google Maps Water Pixel Detection With Canvas
An enhancement to a product we’ve been working on recently included a mockup of a business logo overlaid on a Google Map with people scattered randomly nearby intending to represent potential first time customers.
Facebook, Find My iPhone
Find My iPhone is a nifty feature in Apple’s iOS that shows a map of wherever a person’s phone is. While the main purpose of this feature is listed as finding misplaced phones, most people tend to presciently enable it hoping to recover their not-yet-stolen phone.
David Pogue, a New York Times technology writer, recently had his phone stolen and was using the Find My iPhone feature to locate his phone, which found its way to a rough part of Maryland. Being a high profile person, Pogue was able to get the help of a local police officer who said he would knock on the door where the phone’s GPS was located and ask for the phone. Because the GPS accuracy varies, the police officer said that getting a search warrant would be tricky and that if the person simply denied stealing the phone that there wouldn’t be much more they could do. In a separate case, police in Ottawa denied granting a search warrant based on location alone stating that: “Just because an app says that this is the location of where a laptop is or where a device is, it doesn’t provide us with the full picture”.
With the recent additions of Facebook to iOS6, Apple should also include Facebook in its Find My iPhone application. This would effectively give you the full identity of whoever stole your phone, which coupled with the location data, should be more than enough to justify a search warrant. While not everyone uses Facebook’s mobile application, its use is more common among young people (who are more likely to steal a smartphone to begin with). This would not only allow people to retrieve their stolen phone, but would also deter thieves from taking the phone in the first place because they wouldn’t be able to use Facebook.
Another solution is for Facebook to implement this themselves since a thief might be able to get around Find My iPhone by wiping your phone first. Facebook already shows you devices that your account is connected to and optionally allow you to require Two Factor Authentication when logging in from a new device. They have a unique identifier within the app that knows the Device ID, so it wouldn’t be that much more for them to also show other accounts connected to the same account in the specific case of smartphone apps since it’s highly unlikely for multiple people to use the same smartphone.
GitHub is Eating the World
About 11 months ago, Marc Andreessen, founding partner of venture capital firm Andreessen-Horowitz, wrote an essay titled “Why Software is Eating the World”. In it, he claims that industry leading corporations that fail to adapt by making technology the core of their business will be “creatively destructed” by startup companies.
Plenty of comparison has been made about the opportunity for GitHub to capitalize on the increased amount of software being written with their plans to further support development teams with plans and pricing for individuals, small businesses, and enterprises. GitHub has grown from bootstrapped to being valued at $750m without raising any outside funding, and I think the real value Andreessen-Horowitz sees lies far beyond GitHub’s current business model of monthly service plans.
It’s no secret that there is a significant engineering talent crunch for filling technical roles in companies. I’m asked fairly regularly if I know anyone available looking for programming work and my response is almost always look on GitHub for people who have written code in the languages you’re looking for – you can filter search queries by location and the programmer’s email is almost always included at the top of source-code they write.
If the talent crunch is as pronounced as recruiters and founders say it is, and technology jobs continue to transform previously untouched industries, then GitHub is sitting on an active database of the most in-demand user base in the world. Today GitHub is monetizing its viewership with a public jobs board, but in the future they could match technology job seekers with potential candidates in their user base by the type and quality code they’ve written, and that is a multi-billion dollar opportunity.
If you liked this post, you might also like Startup Investment Portfolio Game.
Startup Investment Portfolio Game
I read about technology news and startups fairly regularly and often find myself saying “man, I wish I could invest in them”. I thought it would be a fairly fun exercise to compile a list of companies I’m excited about now and look back on them in the future. For the past few months I’ve been maintaining a Google Spreadsheet of startups I would invest in if I could. If I had money to invest in private companies, these are the ones I would look to get involved with. Last Updated: 2/02/2016
|Company View Notes||Date||Pre-Investments|
|Synthetic Biology will revolutionize the nearly $1T specialty chemical market. This founding team has the right skills and background to lead the pack.|
|Leader in consumer oriented drone technology, which will be a huge market as drones become more pervasive.|
|Tackling just about the only e-commerce vertical Amazon won’t touch – which also happens to be a $40b industry: pets. Plus, jellyfish (their first niche) are wicked cool.|
|Marketplace and platform for unmanned arial vehicles, or “Drones”. Automated hardware, some of which will be mobile, will shape the future and create many billion dollar industries.|
|Facebook and Google are inherently incentivized not to build this product themselves. A lot like Greplin in that it allows searching private “locked” data, but this is very well fine-tuned for people.|
|Twilio for 2-Factor Authentication. Team has lots of experience and knows how to scale this.|
|Vastly improves the most expensive computer you own: your car. Lots of lucrative plays for enterprise/fleet customers with many established potential exits.|
|Incredible team of “Big Data” engineers. Solving interesting problem of optimizing marketing around social media data.|
|Online banking is absolutely awful. Policies and answering basic financial questions are way too complicated for the average consumer. Industry is ripe for disruption.|
|Intriguing approach to mobile dating that appears very well executed technically. Product feels sticky, and addresses a lot of the stigma usually associated with online dating.|
|Eventually local storage will be indistinguishable from data stored remotely (“in the cloud”). A solution like this will be how this is accomplished.|
|BitPay is well poised to be very large embedded players in the online BitCoin payments market, which doesn’t appear to be going anywhere anytime soon.|
|Breathable Foods (Aeroshot)||10/23/2011||unknown|
|Energy drinks are expected to be a $45b+ market in 2014. The Aeroshot is an innovative pure caffein inhaler. Coffee drinkers rejoice.|
|“Square without the reader”.|
|“Closing the redemption loop” is something a lot of companies with big pockets are trying to do. CardSpring has somehow figured out how to expose a developer friendly service that connects credit card numbers to actual purchase data.|
|Leading the space in real-time analytics. Newsbeat should be a huge hit with publishers.|
|Virtual Currency is here to stay, and Coinbase looks to be the trusted marketplace that will make this (trillion dollar[!!?]) industry happen for the masses.|
|Uber for the $600b freight industry.|
|“WhatsApp for Business.” Like Yammer, this will be a ~$1b exit.|
|Innovative marriage of NoSQL and RDBMS database systems. Memcached is Everywhere.|
|Love this product. Well built and designed. No clue if the business model works, but it’s almost identical to Dropbox.|
|Forefront of “Big Data” trend and generally regarded as the leader in commercially available Apache Hadoop. Disclaimer: I was previously an intern and built their website.|
|Will eventually be the security and performance backbone of the internet. Already processing 15% of all internet traffic. Would give left nut to invest.|
|Injecting themselves into the online commerce feedback loop and creating tools to increase virality sounds like a win to me. Team’s also demonstrated that they’ve done it before.|
|Very versatile crawling/parsing api that, as a developer, i know is in high demand.|
|Incredible technology that remedies the number one problem with buying clothes online: will it fit?|
|On-Demand deliveries for local businesses of all types. The initial approach will be food, but expanding to all forms of commerce once their fleet is at scale will have incredible upside.|
|Dr. Chrono||5/4/2011||$20k (YC)|
|One of many potential home-runs in healthcare. Lots of money at stake with digitizing medical records.|
|Leading the way in HTML5 cross-native apps. Potentially huge acquisition target for Microsoft, Adobe, Yahoo, or Facebook who want to improve their mobile footprint.|
|Love this product and so do the majority of its 25m users.|
|The “last mile problem” is the biggest issue for delivering goods and services. It’s undoubtedly daunting, but the upside is tremendous with the right focus (enterprise, not consumer) and team.|
|Creating a search engine is probably the hardest thing to do successfully, but DDG could have a prayer with its privacy-conscious approach.|
|Online equivalent to cash that maximizes network effects and doesn’t have interchange fees. $$$$$$|
|Stock Option granting is stuck in the paper world. There is a lot of value in a simple management platform that digitizes private company stock options.|
|The vision for “An OS for the Physical World” is so ambitious it’s scary. As data collection grows exponentially, Estimote-like sensors will increasingly provide more data to shape retail and consumer experiences.|
|Expect Labs (MindMeld)||9/11/2012||$0|
|This could change the way people have conversations digitally. Impressive technology of predictive named entity recognition that could be applied to a variety of other platforms.|
|Incredibly brandable domain name. Love the concept and execution so far.|
|World-class design. People are addicted to tv.|
|Findery (formerly PinWheel)||2/16/2012||$2m|
|Annotate the world. A service like this couldn’t have existed before smartphone proliferation, and it seems to be the perfect mix between FourSquare and Pinterest.|
|Digitizing the $7 Trillion global construction industry. Lots of inefficiencies to cut down during the whole process. (See also: PlanGrid).|
|A marketplace for on-demand international shipping could massively impact global trade. Product is well-positioned to win the space where network effects will be hard to overturn.|
|Could be the company that fully unlocks the power of mobile + local offline commerce.|
|A local Columbus company that could make waves in how technology companies get financed via equity – well timed current legislation being passed. Team is extremely talented.|
|A compiler for creating living things. We have programming languages to abstract computer language, this is a compiler for the language of living organisms, the genome. Video.|
|Database of the worlds most prominent open-source programmers and the projects they’re creating. “Engineering talent crunch”|
|Solving the “Other half of search”. Don’t know if people have the problem of knowing where some piece of information is in their private web frequently enough for Greplin to matter, but the product/team are ripe for acq-hire.|
|Super unique approach to group dating that takes the hush-hush stigma out of finding someone online. Growing nationally quickly.|
|A bit late on this given it’s likely previous investment valuation, but I still think there’s enough upside for this, and traffic is really starting to take off.|
|Extremely well built Enterprise productivity suite. The main advantage is the desktop/mobile apps which appear to be built to remain lean and fast. This will be a very large Yammer-esque exit.|
|Uber for on-demand doctors. Could be massive, or crash and burn.|
|I think this app finally nailed the mobile app dating equation. I expect this to explode in popularity once they fix the messaging kinks and are available everywhere.|
|They started with flight search, which is pretty well done and has fans, but if they can solve the awful experience of finding a hotel they will print money.|
|Bringing an API to outsourced brainpower.|
|Super impressive backend, can tell the product will get easier to use (maybe featured tasks in a gallery?) over time. Lots of creative and helpful uses.|
|“Mint.com for small business”. Collecting an incredibly valuable dataset and will be able to do for businesses what Mint did for consumers. Also, Jessica Mah rocks.|
|Banner ads in games suck. The concept of turning achievements into rewards is really compelling, and their team is stacked to do it.|
|From what I’ve seen, the leading analytics provider on the Facebook platform. Huge acquisition play.|
|Marketplace bringing efficiency to finding qualified legal services|
|This is an incredibly transformative improvement to human-computer interaction with insane opportunity to revolutionize gaming and healthcare (among other industries). Can’t believe the $70 price-point as well.|
|Impressive team of networkers, designers, and hustlers. Currently focused on Columbus, but poised for national growth. Everyone hates hangovers.|
|Huge market. I love skiing. Win for resorts: reduces risk of volatile weather conditions. Win for users: cheaper lift tickets.|
|My singularity dreading inner luddite loves to fear a company like this. (Read the Wikipedia article on Grey goo).|
|No brainer buy for every VC out there who, by nature, are very accessible. Can eventually scale to Angels with more geographic focus/restriction to truly become an operating system for private investors.|
|Delivery will be the “sexiest” application for drones, but their impacts will be far more pronounced in other industries, like agriculture and aid second/third world countries.|
|I hate advertising, but MediaLets’ approach with rich-media advertising is the lesser of many evils. Team knows what they’re doing.|
|Extremely high growth with Twitter-like scale. Ease of discovering high quality content is remarkable, and the effects of the content virality compounds with increased network size.|
|Solving a real problem of Enterprise password management that companies will pay for to simplify. Solid technical team from Amazon and Microsoft.|
|Technically sound pre-funding team. Huge space to disrupt, and open-source memcached is the gorilla in the room.|
|Kevin Rose has seen the whole spectrum of the dos and don’ts with running a startup between Digg and companies he’s angel invested in. I expect him to take this corpus of experience and build something meaningful; Oink looks like a great start.|
|This game isn’t out yet, but I’ve used a beta version from their iOS developer and it’s like crack. The game mechanics used here are insane. This could be on the same level of Angry Birds in terms of popularity.|
|Computer Vision technologies are hard to develop (valuable IP) and will open up a floodgate of potential new mobile, financial, surveillance, security, and logistics applications.|
|Optimized PPC campaigns on Adsense. No brainer team/product acquisition for Google.|
|Mechanical Turk is great, but result quality is questionably reliable. This approach is extremely well thought out and solves a very interesting and potentially lucrative problem.|
|MongoDB is one of the leaders in the NoSQL space and MongoHQ has built a platform growing very rapidly in revenue and distribution.|
|Ex-Apple employees have figured out how to intelligently expose accelerometer data into a Siri-like personal assistant. A lot more powerful than existing products.|
|Haven’t seen anything reported of funding, but this app has nailed the Open Graph and is exploding. Another different-kind-of-sharing pinterest-like app, but can’t argue with growth.|
|Home automation will play a significant part in energy use reduction and economic efficiency. Nest, tackling the often-looked-over thermostat, is in a great position to do well.|
|Closing the redemption loop in offline (in addition to online) commerce. Yodlee is destroying their margins, but this is a huge opportunity.|
|A/B testing might be a buzzword, but it’s still incredibly powerful. From using their product, they make running campaigns dead simple. Acquisition target.|
|Closing the redemption loop in offline (in addition to online) commerce. Yodlee is destroying their margins, but this is a huge opportunity.|
|Morality aside, this is a goldmine. Not much else here to say.|
|Solving a super fascinating problem of location-relevant interest matching. Could be transformative.|
|A/B testing might be a buzzword, but it’s still incredibly powerful. From using their product, they make running campaigns dead simple. Acquisition target.|
|Bringing change to a bloated $900b industry (postal mail) – sounds like a huge win.|
|Significantly improves upon a very minimal Facebook Page Insights product. Well built with and has a clear business model where customers have deep pockets.|
|Version 2 of Path makes Google’s previous $100m+ acquisition offer denial look prescient. This is where mobile social networks are headed.|
|Irrespective of the fact that this is a restaurant that’s only current located in Columbus, Ohio, this is destined to be the next Chipotle.|
|Simplifying drug delivery prescriptions for potentially tens of millions of customers (in the United States alone) is a huge opportunity. Quite a Zenefits-type model, which is also disrupting a Goliath industry with a nascent tech approach.|
|Digitizing the $7 Trillion global construction industry. Immense upside, and a well built product with great grown.|
|Extremely successful independent mobile social gaming company. Backed by Sequoia. No-brainer acquisition for EA or Zynga.|
|Traffic has exploded in 2011. Growing a huge community of people and a database of things they think are cool. Feels like early days of Tumblr.|
|“Realtime application as a service”. Love the concept, execution is solid, and the team is riding the giant transition to a more interactive and immediate web experience.|
|Definitely a bit too much buzz given their founding team, but if they can effectively get away from the current tech/startup focus into more “normal” topics, they’ll have a goldmine of data/users.|
|Implementing payment solutions sucks. Recurly makes subscription billing simple and beautiful.|
|Eventually hard-drives will be solid state, and RethinkDB is poised to lead the field. Until that happens, they’re refocusing on optimizing existing HD solutions.|
|I have no idea why this isn’t built right into Amazon’s Cloud services because managing EC2 clusters manually is awful.|
|The power of being able to trade on information as it happens is wildly powerful.|
|Mobile how-to guides wherever you need them. Extremely well thought out product and will be a mainstay on a lot of users’ phones.|
|Growing like a weed. No-brainer acquisition by eBay or Amazon.|
|Incredible early adoption from merchants like Best Buy. Love the product and approach.|
|Shortmail (410 Labs)||7/02/2011||$0|
|Everyone uses email, but a few rotten users ruin the experience for everyone. Tying accounts to a social authentication system and placing Twitter-like length restrictions may be the cure.|
|Mint.com for Investments. Clear acquisition for Intuit or wealth management companies which literally and figuratively print money.|
|Being the location backbone of the web has a lot of potential. Killer team.|
|Big Data meets convoluted legal fees.|
|Paper Coupons will get replaced by *something* in the digital era. This looks like an interesting proprietary technology that will work with existing coupons on a phone.|
|Captchas are annoying and command our scarce attention for an otherwise valuable period of time. This approach is equally annoying for consumers, but at least it makes publishers and advertisers money.|
|Couldn’t be a more lucrative market to disrupt, and Square has all the right pieces in place.|
|AI for Stats and Analytics. Incredible tech chops.|
|Similar approach to Payvment, but a more Amazon-like approach with a central website (which is more in tune with how consumers currently shop).|
|I don’t think any merchants or developers wake up saying “man, I can’t wait to use work with Paypal today”. Stripe has a solid team and solid mission of remedying an otherwise excruciating experience.|
|Software eats architecture.|
|This might appear to be just another blogging service, but something tells me Dustin Curtis has his finger right on the head of the future of quality news production and consumption, albeit it’s limited to technology-oriented writers now.|
|Site search is something that is an absolute pain to implement and is something almost every company wants to outsource. Google site search is a very mediocre solution and leaves most developers wanting more – this just may be it.|
|NFC will change the way technology interacts the real world. It’s a far ways out, but the companies who will be relevant tomorrow will have started today.|
|Impressive gesture control for the wearable computing devices that are about to explode in popularity. Very cool use cases with gaming and sports – definitely getting acquired.|
|This is gaining huge traction on campuses and will definitely get more public attention later this year.|
|AWS-like platform for Life Science bio experimentation.|
|Bringing a full commerce checkout ad experience into native applications as a platform. Seems smart and like a solid acquisition play for dozens of companies/platforms/brands.|
|I don’t know if the transition from Stickybits to Turntable could be classified as a pivot.. more like a complete redux. Regardless, I’m addicted to Turntable. That being said, online music startups are notoriously hard to succeed with. I just want a custom avatar.|
|Have seen their traffic skyrocket after reducing SMS costs. They simplify an extremely painful process of manually building out an SMS solution as all previous ways require convoluted APIs or custom software.|
|Smart product that natively deep links high-value product purchases in the right place. It’s a new category of mobile ad, but if it works it could be hugely valuable.|
|Walker & Co||12/18/2013||$2.4m|
|Addresses a quickly growing segment in one of the largest markets on earth, Health and Beauty. Traditional CPG companies are behind the eight ball on this one, and a strong branding play will make all the difference in an upstart taking mass market share.|
|“Zappos for prescription eyewear”. No reason to go into LensCrafters if you can try it on and return for free.|
|Huge opportunity to capitalize augmenting smartphones with peripheral devices. Their approach with virality around health products (auto-tweeting) is sick.|
|If this reaches critical mass, it will change the world. Incredibly designed and fascinating story behind its launch.|
|This ties into many more business oriented services that IFTTT doesn’t and will undoubtedly get a lot of people/businesses paying for their (albeit expensive) premium plans|
|# Companies||Last Updated: 2/02/2016|
Companies with a star next to them are once I’m exceptionally bullish on given their current capital intake, likely valuation, and liquidation opportunity. All fundraising numbers (listed under pre-investments column) were obtained via Crunchbase and are meant to indicate the amount of outside capital put into the companies before the date listed. To simulate a real-world investing scenario, I will be adding (and not removing) companies on an ongoing basis. Feel free to correct any mistakes, point out companies you think are exciting, or provide any feedback.
Facebook Vulnerability: Like Clickjacking
The Facebook Open Graph Like Button is susceptible to a type of attack known as clickjacking. Basically, if the like button is embedded on the page you’re on, made completely transparent, then an attacker could trick you into Liking something without your discretion.
How the attack works:
1. User navigates to your page, like button is embedded invisibly
3. User clicks what they believe is a link on the page and “Likes” the attacker’s content instead.
4. User doesn’t see any notification of Liking the content, which results in a News Feed story.
5. News Feed contains mention of attacker’s content, which allows it to grow virally.
Twitter ran into a very similar attack last february with the propagation of a “Don’t Click” button. The main difference is that Twitter was able to block the hole by disabling iFrame embeds (basically if (window.top !== window.self), then Twitter is nefariously being iFrame embedded). Since the Like Button itself is an iFrame, Facebook can’t employ the same logic to detect clickjacking.
Advanced users would notice the change in cursor since the mouse is always located above a link and can’t be overridden since it’s in an iFrame. However, during the casual flow of browsing this would hardly go noticed.
Hacking ChatRoulette’s “Report”
While the media coverage for ChatRoulette has largely died out, I was curious to see how the site had evolved in the past few months. After browsing through the site for a few minutes, I quickly discovered that not much has changed: there are still a lot of naked guys gratifying themselves. With as much emphasis the site puts on reporting people, I was surprised that there wasn’t more communal effort to cleanse the site and make it look less like a gay porn. Curious, I set about testing the mechanics of the report button.
- Find 1: The report button relies solely on client-side flash storage
The flash webcam viewer on ChatRoulette uses Flash’s Local Shared Objects to uniquely identify the anonymous user so user ban reports can be tracked. The only problem with this is that you can reset the storage. I didn’t dive in to inspecting the data that ChatRoulette’s flash webcam viewer actually stores, but my best educated guess is that they generate a random identifier and send it back to their servers to identify you. Someone could decompile the player and see what is actually being stored to really reverse-engineer it, but that doesn’t really matter in the grand scheme of things – all a banned user needs to do is reset the local storage and they can proceed to using the site in whatever manner originally got them banned. Adobe has a nifty tool to do this yourself.
- Find 2: It took me over 6 minutes and 80 people to get banned
I used a program called ManyCam to broadcast an image asking for people to report and ban me. Much to my surprise, it took over 80 people to next me before I got banned for 10 minutes. Though, thanks to Find #1, that wouldn’t stop anyone from hopping back on and trying again.
Even after asking people to ban me, it took over 6 minutes for enough people to press report so my account would be disabled. Users of the site press “Next” out of habit and seemingly can’t bare the thought of moving the mouse slightly to the right or pressing a different key. Someone nude gratifying themselves would likely receive bans more quickly, but the number of people using the site for this purpose leads me to believe that users press “Next” instead of “Report” almost universally (or a bunch of people already know about Find #1).
- Find 3: Of the first 80 people I looked through, more than 10 were advertisements to adult websites
Competing adult cam websites view ChatRoulette as a gateway drug to their services and have (probably intelligently) catered their marketing to the many potential users using ChatRoulette. I have seen ads for (not linked because they’re all nsfw) webcamclub.com, chatroulettestrip.com (a fake front-end for the Zwinky virtual-world / spyware toolbar), chatroulettehalloffame.com, girlschat.org and bunny-chat.com (fake front-ends for Cams.com), AdultFriendFinder, chathopper.com, and streamate.com. There’s certainly no shortage of solutions for someone not finding that special someone on ChatRoulette itself. However, it’s detrimental if the site is to be taken seriously.
My intention with this post is not to belittle the service – I very much want to support other young entrepreneurs. I was disappointed to find that It was so easy to bypass the banning feature of the site (I think a server-side solution could fix this). I was also disappointed to find that the mechanics and audience of the site render the Report functionality useless. I would love nothing more than to have a service which truly allows you to have spontaneous conversation with anyone around the world, but as the site currently exists it is next to impossible. Maybe all of this says something about us as people, but that might be reading in to it too hard.
Updated: New iPhone Developer Agreement Bans the Use of Third-Party Analytics and Services
The updated iPhone Developer Agreement includes stringent clauses around the acceptable use of storing, transmitting, and processing user data. Here is the updated section 3.3.9 in its entirety. I have added emphasis to clauses I would like to highlight:
3.3.9 The following requirements apply to You and Your Application’s use, collection, processing, maintenance, uploading, syncing, storage, transmission, sharing and disclosure of User Data:
– All use of User Data collected or obtained through an Application must be limited to the same purpose as necessary to provide services or functionality for such Application. For example, the use of User Data collected on and used in a social networking Application could be used for the same purpose on the website version of that Application; however, the use of location-based User Data for enabling targeted advertising in an Application is prohibited unless targeted advertising is the purpose of such Application (e.g., a geo-location coupon application).
– You may only provide or disclose User Data to third parties as necessary for providing services or functionality for the Application that collected the User Data, and then only if You receive express user consent. For example, if Your Application would like to post a message from a user to a third party social networking site, then You may only share the message if the user has explicitly indicated an intention to share it by clicking or selecting a button or checking a box that clearly explains how the message will be shared.
– Notwithstanding anything else in this Agreement, Device Data may not be provided or disclosed to a third party without Apple’s prior written consent. Accordingly, the use of third party software in Your Application to collect and send Device Data to a third party for processing or analysis is expressly prohibited.
– You and the Application must take appropriate steps to protect any User Data from unauthorized disclosure or access. If a user ceases to consent to Your use and/or Transmission of User Data, You must promptly cease all such use and/or Transmission and destroy any such information from Your records (except to the limited extent necessary for Your Application back- ups and record-keeping or as otherwise prohibited by law).
Location Based Advertising
The first emboldened clause states that location based advertisements can only be included in advertisements whose only goal is providing location based advertising. My interpretation of this clause is that unless an application’s sole purpose is providing location based advertisements in the form of nearby coupons, offers, or sales, then location based advertisements are not allowed. This is interesting, because the promise of applications like FourSquare, Gowalla, and Loopt is that through a social network of seeing where your friends are, businesses will be able to add value to the experience by targeting users most likely to make a real-world purchase – if I check in to a store at the mall, what better opportunity for a business five stores down to promote their sale.
The line here is unclear in that I don’t use FourSquare (or any other check-in service) for the sole purpose of finding nearby deals, but rather to see where my friends are. The language in the Developer Agreement suggests that check-in services like the aforementioned will not be able to provide auxiliary location based ads. Ad networks looking to capitalize on the promise of location based advertisements will undoubtedly have a lot of qualms with this clause as it effectively eliminates the ability to provide fine-grained location targeting with GPS or AGPS, leaving the traditional city-level IP-Table lookups as the only means of approximating a user’s location. One has to question whether iAd will adhere to these same targeting guidelines.
Third-Party Data Providers
The second emboldened clause spells trouble for third-party providers building services on top of the iPhone ecosystem, including analytics companies, data stores like SimpleGeo, and potentially third-party ad networks. The clause states that an application can not include a third-party library which sends data to their servers for “processing”. I put processing in quotes because it’s an overloaded term that could mean a lot of things – If I throw some data into a database and count how much disc space I’ve used, that could be considered “processing”. It is unclear whether this bans third-party ad networks as all of them receive data from the device and run optimization analysis in some capacity. Whether or not Apple will enforce all current applications running networks like AdMob or MediaLets to switch to iAd remains to be seen, but the move would be highly controversial and would spark a giant clusterfuck of anti-trust violations from Google and the like.
The clause all but signals the death of third-party analytics software built to provide application developers information about how their applications are being used (Disclaimer: I was the co-founder of AppLoop, which we shut down about 14 months ago). The web example of these services is Google Analytics, which provides millions of people with useful information to optimize their websites and provide better user experiences. Apple previously didn’t make a public stance forbidding the use of third-party analytics tools like Flurry (which acquired Pinch Media a few months ago), MediaLets, or MobClix, but it is hard to put a spin on this agreement which would allow these services to operate under the new agreement.
This move comes at somewhat of a surprise given how important customer feedback is in the product development cycle – iPhone AppStore review quality is mediocre at best, and there really is no other way to optimize how applications are used to improve quality (something Apple has previously touted). If this is enforced, it will leave a gaping opportunity for Android developers to listen to their customers, improve application quality, and bring the Android ecosystem on par with the AppStore in terms of content quality, quantity, and diversity.
In all, the updates to section 3.3.9 allow Apple to selectively enforce whatever they want on whoever they want. Although they’re already doing this to some extent, the updated terms allow them to do so legitimately.
Venturebeat has posted an email received from an iPhone developer who received a response from Apple regarding Flurry, which was one of the analytics companies mentioned in this post:
We’ve reviewed your application and determined that we cannot post this version of your iPhone application to the App Store. It is not appropriate for applications to gather user analytics. Specifically, you may not collect anonymous play data from a user’s game. A screenshot of this issue has been attached for your reference.
In order for your application to be reconsidered for the App Store, please resolve this issue and upload your new binary to iTunes Connect.
It appears as if Apple is calling an audible on the new agreement as they don’t yet have definitive standards internally for what they will and will not allow:
They basically said the new clauses are for 4.0 (not accepting 4.0 apps yet) and they haven’t decided what will be allowed and what won’t be allowed. They said they will discuss with guys like [mobile analytics vendor] Flurry, etc.
This will be one to watch. It’s almost certain that Analytics companies just got shot in the foot, but the real question will be whether Apple forces developers to switch from Admob or MediaLets to its own proprietary iAd advertising network. I will reiterate this from my original post: the updates to section 3.3.9 allow Apple to selectively enforce whatever they want on whoever they want.
Did you mean: Google Maps
Let me ask a simple question. What would you expect to happen if you typed in http://google.com/mapss in to your browser bar? I’d be willing to bet that you’re looking to be directed to Google’s mapping service, but what do you find?
Ouch, that’s disappointing – now I feel like an idiot, and I still have to adjust my requested URL to be typo-free. Some people simply would have typed in “Google Maps” in to their browser’s built-in search, but not everyone uses this available functionality. Let’s see what happens when you do a plain Google search for “google.com/mapss”:
Much better. The current system is about as useless as it gets, but searching Google returns exactly what I want to see. For a company that strives on using data, Google is missing an opportunity to create value and display more search ads. It seems obvious to me that all misspelled Google product URLs should be directed through Google’s search engine rather than displaying the current “Not Found” dead end, providing more value to end users and creating more ad impressions/revenue for Google.
I’ve quietly been compiling a list of predictions for what’s going to happen in 2010 for the past few weeks, and it will be fun to look back in a year and see how I did. There are a leisurely 40 predictions – some bold, some straightforward – but I’m sure the unexpected will make 2010 one we’ll never forget. Let me know your thoughts, and feel free to disagree. So, enough chatter – here’s my predictions:
Mobile / Hardware
1. iPhone AppStore backlash continues and Apple does nothing about it.Apple has alienated developers and pushed away many prominent evangelists with its tyrannic policies around AppStore approval, regulation, and ambiguity. While the debate has certainly expanded in to mainstream media, I don’t see Apple changing its ways, at least not when it doesn’t need to. It will need to when an open alternative platform rises in popularity, but for now it’s Apple’s way or the high way.
2. Mobile CPA monetization in games gets hot.Incentivized CPA offers are already the De facto way many Facebook game developers choose to make money. It makes sense that CPA on the iPhone is soon to follow. A few small companies are making inroads now, but none are having the breakout success publishers are with social games on Facebook – it’s coming though. I predict 2010 will be a big year for CPA monetization in mobile social games.
3. E-Reader device popularity continues to rise. Amazon polishes its Kindle and B&N struggles to create comparable demand for Nook.Amazon has established itself as the digital marketplace for goods, and I predict that B&N will struggle to make the transition.
4. TechCrunch effectively loses CrunchPad lawsuit, but JooJoo fails anyway.Plenty of controversy here with contradicting stories from the two parties involved. Taking a step back, I find it hard to believe that Arrington – a previous lawyer himself – would neglect the opportunity to get assignment of intellectual property rights if there was any legitimate opportunity to do so. Regardless, the JooJoo is terribly overpriced, and skepticism around the lawsuit will make buyers wary of purchasing the device from a potentially ill-fated company.
5. Verizon doesn’t land with iPhone.I hope I’m wrong, but I don’t think Verizon will land the iPhone for a few reasons. Verizon started a huge campaign against AT&T which undoubtedly didn’t go over too well with the folks at Apple. Apple even partnered with AT&T in an ad campaign in response to Verizon’s attacks. Verizon’s flagship smartphone is now the Droid, and I find it unlikely that Apple will expand its GSM hardware to support Verizon’s CDMA network. I do hope Apple does prove me wrong though.
6. Microsoft struggles with Windows 7 Mobile and remains irrelevant in the mobile space.Windows 7 Mobile has been postponed in to obscurity, closing Microsoft’s window in the mobile market.
7. Apple Tablet launches with pseudo-iPhone OS complete with AppStore.Lots of speculation here, but a tablet would give Apple an entrant in the leisure-reading market that is sure to make mac fans drool with envy.
8. Android proves itself as a formidable competitor to Apple and becomes second overall to iPhone by year’s end.The Droid is hands-down the best non-iPhone phone on the market. While Android doesn’t have the polish that comes from the user experience prowess at Cupertino, it does have the advantage of diversification that could prove it a formidable competitor. Apps published on the Android platform have the disadvantage of being on multiple device types with no least common divisor, but at the same time it is a blessing. I think that Android will slowly and incrementally find itself the flagship smartphone (and generic device) operating system, and I think 2010 will be the year that this starts to become evident.
9. Palm continues to push out mobile devices with little demand.Palm had all its marbles in the Pre basket, and unfortunately the folks at Apple cut a hole in the bottom. Enough said.
10. Square realizes its bottleneck is additional hardware, so it gives card reader away for free.Jack Dorsey’s Square project is one of the most intriguing startups of 2009. After the smoke from the fireworks clears, I think Square’s main problem will be convincing people to get additional hardware. Without the additional hardware, the service is useless, and I’m not certain that consumers will be able to see tangible value in the service without testing the product first-hand. To combat this, Square needs to make acquiring the hardware as frictionless as possible, so I believe they’ll release the reader for free. Alternatively, they could remove the external hardware dependence by utilizing the built-in camera on smartphones and apply some OCR in a similar fashion to the way Red Laser reads barcodes.
11. DropBox gets acquired.
12. GitHub gets acquired.GitHub has quietly been building a base of extremely sought after users that any company would love access to. I wouldn’t be surprised to see them make a nice exit for access to a great product/team with valuable users.
13. “Spray and pray” investment model becomes validated as a few players have significant exists.The “Spray and Pray” model of angel investors like Ron Conway and incubators like YCombinator has been under a lot of scrutiny since its inception. I expect 2010 to be plush with exits including a number of companies backed by these spray and pray investors, largely validating the model.
14. Facebook will not enter the geo space in 2010. If it does, it won’t be through an acquisition.Most experts say that Facebook is poised to take over geo. I would agree with that statement, but I don’t think it will happen in 2010. Facebook has been under a lot of scrutiny for it’s recently changed privacy policies. Everyone knows that FaceBook wants its users to be as open as possible, much to the cry of privacy zealots everywhere. Adding location data to the mix only adds fuel to the fire, and I think Facebook will wait until its other privacy issues have cooled down. That being said, if Facebook does jump in to the nascent geo arena this year, I do not think it will be via acquisition (of a service like Foursquare or Gowalla). Facebook would likely make location an additional type of status/wall-post update, and very little of the code from existing services could be ported over easily, so it would simply be a talent buy (which does frequently happen). As a definitive prediction (and one that many disagree with), I don’t think FaceBook will enter the geo space this year, but when it does, it will be a force to be reckoned with.
15. Foursquare has breakout year. Gowalla grows but is labeled “cute”.
Browsers / Software
16. Firefox hits peak in 2010 and will slowly be replaced by faster browsers.Firefox 3.5 recently enjoyed the position as the most popular browser, but I believe 2010 will be the year it’s overall market share peaks. Users are fed up with its inefficient memory use, poor startup times, and bloated plugins, and faster alternatives will make Firefox’s reign at the top short lived.
17. Google Chrome hits double digit market share as extensions and mac availability catapult adoption.Chrome is fast, and I like fast. In a few years time, I expect Chrome to replace Firefox as the most popular browser, but for 2010 double digit market share is a good start. Chrome is promoted on two of the most eyeballed real estate spaces in the history of the world: Google.com and Youtube.com; if anyone can push a browser down peoples’ throats, it’s Google. Safari is forever plagued to be “the mac browser”, so while it is fast in its own right, Windows users will mostly stick to alternatives.
18. Jolicloud project does not gain significant traction as Chrome OS steals its thunder.As much as I love to see the small guy succeed, I don’t see Jolicloud getting a significant install base as entrants will saturate the market and have much greater marketing power. It’s unfortunate for Tariq Krim as his previous startup, Netvibes, also directly competed against Google’s personalized start page. At least he’s in the arena.
19. Rockmelt, despite the prowess of its investors, does not gain significant traction as its competition can leverage significant real-estate space.It’s hard to bet against this team backed by these investors, but I can’t see a Flock successor making inroads in the highly competitive browser space. But if I’m wrong, everyone involved will be very, very wealthy – and that’s why startup culture is awesome.
20. Adobe CS5 makes biggest splash in the “Objective-C is hard, here’s another way to make iPhone applications” space.Adobe CS5 will include a very interesting feature to allow flash developers to export their projects as native iPhone applications. This means that the tens of thousands of flash games around the internet can be easily ported to the iPhone – and I expect it to be huge.
21. MySpace moves away from being an identity hub, integrates FaceBook Connect, strengthens focus on digital media, but sees traffic continue to drop.It’s no secret that MySpace has been having an identity crisis recently. They’re struggling to figure out who they are, and in the process, their traffic is plummeting.
22. Wave slowly insinuates itself in to your work and personal life after assets and talent from the EtherPad help with interface and performance improvements.Wave was one of Google’s first products that wasn’t created out of user demand, and all users seem to have been doing so far with it is hand out invites. Users are begging for a reason to use the product, but it will be awhile until Wave is completely part of your online work flow. Google’s recent acquisition of Etherpad should help with performance and interface issues, and over time (not necessarily in 2010) I expect Wave to be used by the majority of active email users.
23. Twitter releases analytics product for businesses.Twitter is rumored to have been working on a premium analytics product for businesses for quite some time. I expect something of this nature to be announced this year as a more definitive revenue model comes in to light.
24. Twitter continues to grow, but not at the same rate it did in 2009.2009 was a huge year for Twitter. Following the election, Twitter was part of every type of media coverage from daily news to sports games. I expect Twitter’s growth to continue (though recently it’s been stagnant), but not at the rate it did in 2009.
25. Tumblr more than doubles traffic and breaks in to Alexa top 150.Tumblr has quietly built a web service with staggering traffic numbers. It currently ranks 230 worldwide on Alexa, and I expect it to break the top 150 – top 100 might be pushing it, but anything’s possible given its explosive growth in 2009.
26. Facebook introduces redesign, users protest, Facebook doesn’t do anything about it.Nothing new to see here, move along.
27. Facebook makes major push to get people to organize friends in to lists.One of the most under-utilized feature on Facebook is Lists. Facebook needs users to create lists so it can slowly allow more and more of the site to be open to external sources, like search results. Users using lists are also more likely to feel comfortable sharing more information on the social network, and that is Facebook’s sole intention. It may be an algorithmic “suggested best friends” or a requirement, but I expect Facebook to make a major push to get users to organize their friends.
28. Facebook Connect moves closer to being De facto login.Everyone is using Facebook Connect. It’s dead simple. OpenID is cute, but anyone who wants users, data, and brand familiarity (which is everyone) will go with a proprietary solution – for good or bad. This isn’t so much a prediction as an observation: Facebook will own your identity, and that will become even more apparent in 2010.
29. News Corp continues to threaten removing itself from Google’s index, but it wont.Rupert Murdoch has threatened repeatedly that he’s going to remove News Corp’s content from Google’s almighty index. I’m calling bluff – News Corp can’t really be that stupid (well they can, but I wouldn’t bet on it).
30. Bing beats Google to integrating innovative features.Microsoft’s shining online star is Bing, and it has repeatedly beat Google to implementing social features. BingTweets was first to marry Twitter with web search results. Bing then followed that up by striking a deal with Twitter to provide tweets front and center. This was shortly followed by Google’s similar announcement. I expect this trend to continue: Bing has something to prove and less to lose, so it will be first to integrate cutting-edge features. As a result…
31. Bing passes 15 percent search market share.Users are growing wary of Google’s omniscient power, and Bing is a great search engine. Bing already has a 10% market share on search (Google has an impressive 65%), but users like the overall search innovation coming from Redmond. Case in point, compare the two companies’ iPhone apps. Google lets you do voice search and links to their other apps, but Bing’s iPhone app takes it a step further. Bing lets you do voice transcribed map directions (and search), and is much more tailored for local search, which is much more pertinent for a mobile device.
32. “Netscape IPO moment” begins tech IPO eruption.
33. Founders Visa movement generates a lot of talk, but unfortunately no action.The Founders Visa movement has generated a fair amount of discussion as a possible way to aid the ailing economy. Proponents cite the number of large companies founded by foreign workers and speculate how many more large companies could be formed if people could freely come to the United States to start companies. It should be trivial for highly motivated entrepreneurs to stay in the country and start companies, but nothing in government moves quickly. Unfortunately, I predict that there won’t be any progress made to offer foreign entrepreneurs a Founder’s Visa in 2010 with all the other issues at stake.
34. Augmented Reality shows a few cool use cases, but has slow consumer adoption.Augmented Reality faces the same problem as the Segway: both are extremely awkward to use in public. I don’t want to get laughed at holding a gizmo up to my face as I look up information about my surroundings – I’d look absurd. Society’s general acceptance of extreme technology use will change, and so too will the adoption of Augmented Reality. I expect to see some cool demonstrations of what is possible with the intersection of technology, cloud information services, and real-world scenarios, but I don’t expect it to all happen any time soon. We’re still at least a decade away from fabled devices like those conjured at MIT to being more commonplace.
35. The online music website “convection oven” pattern continues.2009 was not a good year for sreaming music startups. iLike, LaLa, and iMeem all had asset fire-sales, and this illustrates a larger “convection oven” pattern of music services: quick rise to the top, law-enforcement, death, and recycle. Several similar services await what I believe to be a similar fate, including Project Playlist, MySpace Music, Pandora (which barely dodged royalty hikes), GrooveShark, TheSixtyOne, and the beloved Spotify.
36. Privacy and data integrity issues force enterprise customers towards “private cloud” solutions.A big movement right now is the transition from old mainframe data warehouses to more efficient and powerful “private cloud” solutions powered by technologies like Hadoop. I expect to see the demand for data integrity and privacy to force enterprise customers away from public clouds like Amazon and toward a secure private solution.
37. CPA offer providers will try to appear to be consumer friendly, but will continue to do use shady tactics to make money.The great CPA scandal that recently erupted with Facebook applications was one of the more intresting tech stories of 2009. Stories surfaced on how far CPA marketers are willing to go to make money, and I don’t expect the market to purge its sins in one night. Expect to see several cases of CPA publishers and advertisers being called out for scammy tactics in 2010.
38. Aol.’s rebranding efforts don’t have desired effect by turning the company around.You know a company is desperate when its logo is a goldfish. If anything is going to turn Aol. around, it’s an extreme brand change to make the company seem cool, relevant, and different. Unfortunately, I don’t think anything can keep the S.S. AOL ship afloat – they’re just re-arranging deck chairs on the Titanic.
39. Microsoft’s online Office products fail to win any fanatics.Microsoft has had little success with web products, and I predict that through 2010 its only success will be Bing. Google’s online productivity suite has years of polish and won’t be taken down as the market leader any time soon.
40. HTML5 video support has slow adoption as most large vendors find flash good enough for now.Eventually video will not require additional browser plugins, but complete HTML5 adoption is years away from being a reality. There are many problems with HTML5 video including browser compatibility, fallback issues, and user control issues (video buffers automatically). Ultimately, there is very little reason for large vendors to implement HTML5 video standards when Flash has 99% market penetration and I don’t see any making the switch in 2010.
Bonus: RSS faces death as filtered content recommendation systems on social services emerge. They, along with most real-time startups, struggle to find a revenue model (in 2010).People almost get enjoyment out of claiming “RSS Is Dead”. The main problem with completely switching off RSS and on to Twitter is that there is a lot of noise – not to say that RSS isn’t noisy either, but it’s at least generally focused. The complete switch for me will occur when a service can leverage the vast amount of data collected by these social services and curate it in to a personalized feed just for me. Companies and investors are bullish on the real-time space, and I expect to see this service come to light this year. That being said, it is unclear to me that real-time content services have any significant revenue advantages over almost-real-time content services. Accordingly, I predict that there won’t be any services which figure out a way to monetize the added value of extreme recency in 2010.