3D Mapping with a Drone in Wildest Vermont

DCIM101GOPRO

If you know me at all, you’re probably aware that I write about and research the humanitarian uses of drones for a living. One aspect of today’s drone technology I find particularly interesting is how aerial imagery can be used to make 3D modeling, even with inexpensive consumer technology. I’ve been wanting to try it for a long time.

Well, I don’t currently have a UAV that I can program for autonomous flight, to create the pattern of transects that allow drone-shot images to overlap in an optimal way, so they can be stitched together to create maps and 3D models. I also don’t have a point and shoot camera, just a GoPro Hero 3+ with a fish-eye lens, which is rather less than optimal for mapping applications.

But as it turns out, with the help of the open source Visual SFM software, you can *still* get pretty good results. I was visiting my boyfriend Dan’s family in Southwestern Vermont last weekend, which is a really ideal place to mess around with drone mapping since there are very few people there to notice. My friend Matthew Schroyer of the Professional Society of Drone Journalists has been getting good 3D modeling results just by pulling out video imagery from drone videos shot by amateur pilots.

So, I figured I’d give it a go and see what we got. I flew my Phantom 2 over my boyfriend’s parent’s house in some approximation of a zig-zag pattern, with the GoPro 3 set to shoot an image every second – probably overkill, all things considered. I eyeballed the pattern, and since it was a bit of a windy day, it wasn’t as tight as I’d have liked it to have been.

With the initial fly-over done, we had a few hundred images that could be fed into Visual SFM, which Dan handled. Dan says the VisualSFM model used 378 photographs and took about 20 hours to render using his late-2013 Macbook Pro Retina laptop. That’s including the time required to render the image in MeshLab, which creates the mesh required for three-dimensional modeling and overlays the photographic texture on top of it. You can read about how you can use Visual SFM to crunch images over at the excellent Flight Riot.

Agisoft Photoscan performs all these functions inside of the same program, and is a more effective and powerful software, although unlike Visual SFM, it isn’t free. Dan ran the images through Agisoft Photoscan and added some still shots from a video we’d taken the day before, but it didn’t seem to make much of an improvement to capturing the backside of the house, which was quite fragmented. He ran it again with 75 photos, taking out the video stills, and got a better result with fewer artifacts.

Screen Shot 2015-05-31 at 3.11.53 PM

Here’s the results with VisualSFM. You can manipulate the model we made with Visual SFM in Sketchfab at this link.

Screen Shot 2015-05-31 at 3.05.41 PM

Here’s the first Agisoft Photoscan model.

Screen Shot 2015-06-01 at 2.40.25 PM

And here’s the second Agisoft Photoscan model, with the Sketchfab link here.

The results obviously aren’t perfect, but considering how little effort or specialized equipment we used, I’m still impressed. I’m planning to have a good quality mapping UAV with a point and shoot camera and the ability to program transects up and running by July. I think that there’s some very interesting potential for story-telling and journalism with 3D modeling, and I want to figure out ways to experiment. Beyond that, it’s rather fantastic that I can use consumer-grade technology to made video-game like maps of the world around me.

Charlie Hebdo, Twitter, and The Battle of Who Could Care Most

anger-anger-computer
This drawing seems apropo.

“You don’t care about the Boko Haram attacks in Nigeria, but you do care about Charlie Hebdo,” some pissed-off Twitter user says. “All this anger over attacks in Paris, but none over children freezing to death in Syria!” another rages.

It’s a familiar pattern, one that bubbles to the surface whenever a terrible event hits the international news and dominates the social media conversation: why do you care about this, but not that? Why is the media intent on promoting one story, and not another? Why do Westerners seem to care so much more when an attack strikes Paris, or London, or NYC, than they care about the Boko Haram slaughter of thousands (or hundreds, or…) in Nigeria’s northeast?

These comments are both utterly predictable and almost entirely useless. However well intentioned they may be, they are fighting a very elemental part of human nature: our biases, our fondness for that which is close to us, easy for us to understand. We crave novelty. We are naturally subjective, tribal beings. We only have so much capacity to care, lest we suffer from the modern ailment of “compassion fatigue.” What’s more, they are grounded in some ignorance of the historical context of the request for More Compassion Over Here Please, and perhaps too, of the privileged state of the complainer to begin with.

The media of every free nation in the world covers the death of a countryman overseas with more concentrated interest than the deaths of those local to the country – and usually extends the favor to foreigners with racial and cultural ties to themselves. This tendency was lampooned in a 1970 Monty Python’s Flying Circus skit in which a serious-looking Michael Palin notes, “No parrots were involved in an accident on the M-1 today…. A spokesman for parrots said he was glad no parrots were involved.”

It’s satire in the finest British tradition, but the “Python” riff on the tribal nature of parrots is also a clear-eyed observation about human nature: if something bad happens to someone who is more like us, we are programmed to be much more concerned about it. For those of us who live comfortable lives in comfortable places, it is far easier to imagine ourselves being shot in the head in our office downtown or blown to pieces on a subway than it is for us to imagine being kidnapped by rebels in a Nigerian forest or succumbing to Ebola in the slums of Liberia.

Nor does this particular brand of parochialism suggest we care equally about all such deaths of those we consider our own. When was the last time the death of an American soldier in Iraq or Afghanistan made international headlines, warranted a segment on the evening news, or trended enormously on Twitter? US soldiers killed in battle in some lonely Central Asian outpost rarely seem to warrant more than a mention in their hometown paper or, at most, a poignant but impersonal wire photo of a flag-draped coffin at a funeral, evoked in service of some larger point about some aspect of the war. If this is the blasé reaction that even our supposedly beloved and venerated soldiers get when they die in battle in pursuit of our agreed-upon, national interests, then something more than mere nativism is going on.

To understand why, we must consider the power of novelty, which even the most woefully stupid marketing or media executive is intimately acquainted with. Tragic as it is, a dramatic and bloody terrorist attack on the refined streets of Paris is more exciting, more unexpected, and even more entertaining than the steady and interminable drumbeat of children dying in the streets of Aleppo or Baghdad. The stage-managed for media death of a Western journalist at the hands of ISIS is more interesting to an American audience – perhaps only dimly aware of the ongoing conflict in Syria and Iraq in the first place – than the brutal death of yet another Syrian cameraman.

Beyond just novelty, to truly garner attention in both the traditional media and on social media, a death or disaster usually must also have a connection to a larger societal concern, especially if it happens overseas. A resurgent ISIS, feeding anxiety over homegrown jihadists, has brought the issue of Islamic terrorism to the forefront of the American consciousness once again. Likewise, freedom of speech rights are seen as under attack by both all sides of the political spectrum: cultural critics such as David Brooks fret over campus activism and micro-aggressions, while the supporters of Edward Snowden worry about the chilling effects of NSA surveillance. We evaluate terrible events overseas through the prism of our own anxieties: are the victims like us and could this terrible thing happen here?

As a kind of calculated equation, with a final value of how much we end up caring for something, these elements: novelty, relatability, and a story’s relationship to our broader cultural milieu seem crass and cruel. Perhaps in a moral and unbiased world, we would be spending just as much time being enraged about Syria, kidnapped Nigerian schoolgirls, Ukraine, and the continuing Ebola crisis as we have all been this week about Charlie Hebdo. But what is the alternative to our current imperfect system of choosing what to pay attention to? Not everything can be covered equally, certainly not in an era where foreign correspondents are roughly as endangered as the white rhinoceros. How then do we decide what warrants conversation and coverage, and what doesn’t – beyond dictating just how much time the media must give to any story, which is very much the crux of the Charlie Hebdo argument?

International conflicts and problems are often terrifyingly complex. While raising awareness and drumming up compassion for the suffering can accomplish good things, awareness and compassion by themselves are not nearly enough to solve problems. Going around on Twitter demanding that people care more about some things than other things is yet another form of armchair activism: it makes us feel good and righteous, like we’re doing something, but it rarely actually accomplishes anything concrete.

Remember this? Nah, you probably don't.
Remember this? Nah, you probably don’t.

The Kony 2012 campaign captured the attention of the social media world, but accomplished nothing at all with regards to ending the abuse of child slaves by the Lord’s Resistance Army in Central Africa, and wasted a lot of well-intentioned money on splashy adverts and stickers in the process. What do we hope to accomplish if we get people to divert some of their attention from the dead of Charlie Hebdo, and towards the plight of Syria, or Boko Haram? Is there a concrete benefit for that starving Syrian child if a college student on Twitter whose avatar is a picture of his dog decides to give Syria’s plight a hashtag and a pithy little quote?

Complaints about why people in America seem to care more about one international tragedy than another also evince a certain ignorance of history, of just what that request means. In our media saturated and interconnected world, it is easy to forget the demand that people in America or India or Cambodia care deeply about the plight of people in Syria or France or Somalia is a profoundly new one.

The widespread and swift dissemination of international news and tragedy dates only to the mid-nineteenth century with the proliferation of international telegraph communication. Previously, news from overseas had taken months to travel from Asia to Europe and vice versa. When these far-away tragedies finally did hit the news, they were atomized, already out of date. People may have cared about starving millions far away, but it was a very abstract thing, and even the educated elite probably did not feel pressured to make public displays of feeling bad about it. On the whole, most people only worried themselves about distant tragedy when it had some kind of economic impact on them.

Technology has since made prodigious new demands on our reserves of compassion and time. The rise of instantaneous international news 24-hour cable networks, and most recently, social media, has prompted many people to develop empathy for exponentially more humans than they were ever asked to do before, at any time in human history. It has also produced the expectation that a good and educated person should be aware of all the world’s suffering, and be vocal about that awareness and empathy. We are not only bombarded with dozens of new and horrifying stories every day: there is considerable pressure to make it clear that we are aware, we care, and we’re not going to take it sitting down (whatever that may mean).

On the whole, we do a surprisingly good job of this newfound demand for both total awareness and total compassion. But, no, we do not do a perfect job. How could we? Susan D. Moeller’s “Compassion Fatigue” described the issue very well back in 1999, and her discussion of how 24-hour television news coverage of international events contributed to the public’s exhaustion of empathy seems absolutely quaint in the Twitter era. We in the international spectator class may have developed considerable new powers of empathy for people who do not resemble us, but we have yet to figure out how to develop inexhaustible stores of empathy.

In case you've been under a rock.
In case you’ve been under a rock.

Those of us who care about things like Charlie Hebdo versus Boko Haram, those of us who with time enough to read an article like this, constitute a particular and privileged segment of humanity. We who spend our free time and energy shouting at each other on Twitter about how much (or how little) we care about things should also remember that we are among the blessed of the earth for being able to get into Internet fights to begin with.

Susan Sontag, in her “Regarding the Pain of Others,” put it well: “To speak of reality becoming a spectacle is a breathtaking provincialism. It universalizes the viewing habits of a small, educated population living in the rich part of the world, where news has been converted into entertainment… It assumes that everyone is a spectator.”

And not everyone is, of course, and this is easy to forget if you live in a urbanized place in a wealthy city and have friends who spend their time glued to social media and to current events. Many people, even those in our wealthy Western countries, have neither the time, the energy, nor the inclination to spend their free time spectating and worrying about misery in foreign countries. Many other people lack any access to an open media and to public forums at all. If you are going to reprimand someone for not adequately caring about something in a certain part of the world, the object of your ire has got to be on Twitter or Facebook or the Internet and somewhat interested in your opinion in the first place – to forget this is to run the risk of dangerously universalizing our comfortable online echo chambers.

So if you’re angry about people on Twitter caring more about Charlie and less about Boko Haram: I understand, but stop and think about what you’re asking. The problem is bigger than merely telling people to give a damn: it is hardwired into our basic psychology. Not only that, the problem of biased compassion about one disaster or killing is a historically new one – and a problem that today, many people around the world still lack the tools to even engage with in the first place.

Someday we might solve or mitigate it. Perhaps we can find a way to direct our compassion in effective ways, and spread it around more evenly. But shouting at people on Twitter for inadequately caring about whatever story has caught your attention is unlikely to be the answer.

 

Some Thoughts on TEDx Chiang Mai

What I always thought TEDx was like.
What I always thought TEDx was like.

I have somehow never attended a TEDx conference before. TEDx is the independent wing of the TED Conference, which was founded by Chris Anderson and other Silicon Valley illuminati types back in 1984, and have been gathering in repute and international popularity ever since.

Owned by the nonprofit Sapling Foundation, the motto of TEDx is “Ideas Worth Spreading” – a moniker that is both positive and makes it sound vaguely like something to do with getting a cold. The events, wherever they’re held, seek to create an environment where a lot of people who are interested in innovation, big-picture ideas, and wearing avant-garde turtlenecks can meet each other. Technology experts, social change agents, artists, performers, and the merely curious are all mean to mix under one big tent.

Selife time at TEDx.
Selife time at TEDx.

The format, if you’ve been hiding under a rock somewhere, is pretty simple: people get up and talk for a limited amount of time about something they’re really passionate about. Invited by event organizers, their talks are usually accompanied by slides, and there’s no Q&A period. Dramatic music plays as each attendee mounts the stage, and there’s atmospheric, moody lighting. TED talks of various kinds are collected online and transcribed, and many have become exceedingly popular and influential on the Internet – you’ve seen them, trust me.

The event was first brought to Chiang Mai four years ago as two neighborhood events, whose attendance are capped at under 100, per organizer Rob Evans, a long-time expat who helped the first events come into being. The first full-scale TEDx Chiang Mai, permitted to use the city name, took place in 2013, and the 2014 edition saw almost 700 attendees, with a good mix of Thai and foreign attendees.

Per the press release, TEDx Chiang Mai was out to “create a portfolio – an overall good composition.” And it was intentional that some of the speakers were more obscure. “We want you to hear their ideas, connect with them, and connect with each other,” as the release went.

TEDx organizers.
TEDx organizers.

What did I think of it? I only stayed for the talks during the first portion of the day, but I liked the relatively fast, punchy nature of the talks – they didn’t drag on too long, and time limits were strictly enforced. It was interesting to hear from Thai designers, business people, and entrepreneurs, and I gained a lot of info about people I should reach out for further stories about the entrepreneurship scene here. It was reemphasized to me once again that Chiang Mai is a surprisingly cool little city – sort of the Boulder of Thailand, with slightly fewer hipster beards.

Screen Shot 2014-10-01 at 8.03.25 AM

Particular shout-outs to Puey Ounjai, who discussed the benefits of combining an artistic sensibility with art – his engaging style and anecdote about a friend introducing him at bars as a “sperm expert” were much appreciated. I also got a kick out of Thai designer Ploypan Theerachai and her THINKK Studio, who discussed her design firm’s emphasis on light-hearted play, as well as designer Pitupong (Jack) Chaowakul of Supermachine Studio, whose droll observations on the nature of Bangkok urbanity – right down to those ubiquitous, slightly intimidating wires over the streets – were very amusing and well received.

This saxophone is made of plastic and I love it.
This saxophone is made of plastic and I love it.

However, I think the TedX format is TOO talk-heavy. More networking time is always a plus. If connectivity and networking are the goal, it’d be nice to have either a longer lunch break or slightly more commodious breaks in between sessions to chase people down and hand out business cards. The after-party was a good time but the booze did run out rather quickly. Regardless, I got some good connections and am looking forward to following up. Also, there was this fantastic plastic saxophone that sounded exactly like the real thing….

In Which I Evaluate Some Humanitarian UAVs

Drones desire your affection.
Drones desire your affection.

As those who have interacted with me at any time in the recent past are aware, I’m really fond of UAVs, which some of you might know better as “drones.”

I’m incredibly excited by the possibility of using flying robots with cameras on them in both journalism and in humanitarian aid. They will provide us with a cheap, easy to use, and incredibly versatile way of gathering data, from perspectives humans have rarely had much access to before.

Beyond that: they are extremely cool.

For the past couple of months, I have been working with Patrick Meier, the founder of the Humanitarian UAV Network (UAViators) on a large-scale evaluation of UAVs for humanitarian applications. In this work, I was joined by Peter Mosur and Justine Mackinnon, and I think we did a pretty darn good job.

You can look at the open-to-editing Google spreadsheet we created here.

The public is welcome to make suggestions or add entries. I hope it is useful to those of you who are interested in working with drones for the benefit of humanity.

MakerFaire Day Two: Game of Drones, Flaming Octopi

dragon and ocotopus makerfaire
Flaming dragon AND octopus. As one does.

I spent most of this day at MakerFaire hanging out at the Game of Drones encampment, but got the chance to wander around the main show area again.

I left early in the morning, arriving from my place in Palo Alto around 8:15 AM, and quickly learned one useful MakerFaire trick: the Franklin Templeton Investments outlet in San Mateo was offering free parking to attendees, only about a ten minute walk from the event grounds.

You might want to remember that tip for next year. Why Templeton did this — I can’t answer that one, although it’s certainly not often that I harbor kind thoughts about a global investment firm.

Game of Drones kicked off another long day of vicious aerial robot battles, which were eternally well-attended. I think they’re really onto something here, judging by the rapt fascination of both kids and adults who showed up to watch the action and the well-delivered calling. I could see this being a highly amusing new road-show — like Robot Wars but a lot speedier.

The Barbie Dream Drone.
The Barbie Dream Drone.

A true profusion of UAV makes and models competed in the action, but my favorite was definitely the Barbie Dream Drone, made by Edie Sellars. I think I need to make a My Little Pony themed model for next year.

reiner freeing barbie drone

The safety net proved to be the undoing of more drones today, although the pilots were getting better at avoiding it. On the plus side, the crowd goes nuts when a drone gets tangled in the netting. Also, turns out a PVC tube with a toy gripper claw operated by string works pretty well for getting the UAVs down.

game of drones victory 5

The organizers of MakerFaire seemed to agree about the event: Game of Drones scored an Editors Choice award, which was presented in a delightfully country-fair analogue little blue ribbon. I wish them all the best. And hope to get my filthy paws on one of their Sumo quad airframes soon.

bow before thy flaming octopus

Turns out El Pulpo Mecanico gives the occasional show, with bursts of superheated flame coordinated to blippy electronic music. If you can’t get to Burning Man and are in fact opposed to spending $500+ to hang out with your parents and their friends while they drop endless quantities of acid, the sculptures here at MakerFaire may represent your next best bet. The El Pulpo operators occasionally give the flames full blast without warning, scaring the hell out of the spectators milling around the area. It’s very, very fun to watch.

glassblowing makerfaire

Glassblowing, blacksmithing, jewelry and more by complements of The Crucible. I am fairly certain I’d end up covered in third degree burns if I tried to imitate my favorite Skryim character in real life, but I’m glad someone does it. They’ve got classes on offer if you want to take your faux video game skills into the real world, and make some sweet swords or something. Or spoons. You could also make spoons.

Screen Shot 2014-05-19 at 10.20.42 PM

I managed to resist the urge to buy everything I wanted at MakerFaire, which would have been a hilariously expensive proposition, but this bronze giant squid necklace from Dragon’s Treasure was too awesome to resist. If you’re as fond of eccentric jewelry as me, you should check out their website immediately.

I was also very impressed by the biologically-friendly creations of Bug Under Glass, including beautiful butterfly wing jewelry. And framed beetles riding tiny bicycles, which is pretty much my idea of good home decor.

Here’s some more random-access images:

MakerFaire – Day One

makerfaire octopusToday, I went to MakerFaire for the first time. A two day event organized by Make Magazine and located at the San Mateo Event Center, MakerFaire is rather like the country fair of your technological dreams.

And far more fun than the state fair: this event features Arduino-powered robots, animatronic giant animals, flaming sculptures, and battle drones instead of butter art and depressed looking show rabbits. Burning Man devotees turn out in force for this with their work, and you’ll regularly be passed by a six year old riding a mechanical trilobite, or a bored looking teenager steering around in a felted, moveable, blue cupcake. It’s everything you ever imagined about California gloriously confirmed. Well, the good things about California.

It's armor for your cat!
It’s armor for your cat!

Steampunk cosplayers look regretful in the sun in their tight leather corsets, some guy is making the rounds with a robotic parrot obviously cannibalized from an errant Furby, and every other person seems to have engineered some strange LED arrangement with their hat.

cardboard bot

It takes a remarkably long time to see everything — my feet were aching by the end of the day, but it was worth it, as I took in robotic ship battles, the organic food and farming section, an endless array of 3D-printer startups, and an extremely alluring DIY shop where I (today) managed to talk myself out of buying anything. It’s some of the most fun I’ve ever had in a convention setting.

Further, I liked the vibe. Everyone was in a good mood, curious, and thoroughly enjoying spending a good day utterly geeking out over everything in sight. Lots of women in evidence too, both manning booths with their projects and checking out the show. If you’re looking for a geek event that does a good job of actually including everybody, this is it.

battle droneI went to MakerFaire thanks to the crew behind Game of Drones,which was able to get some friends and associates into the show for free. Game of Drones, as the title may hint, makes ruggedized UAV airframes that are suitable for unholy aerial battle.

The Game of Drones team had a big show at MakerFaire, running one-on-one battles every hour. The turn out was impressive: hundreds of people staring, transfixed, as small flying robots did their best to kill one another, or at least knock each other out of commission.

barbie dream quad

Everyone snaps their heads around when we hear the tell-tale buzzsaw noise of imminent drone death. It’s a ton of fun. I did not subject my Phantom and its camera gimbal to the tender embrace of the battlefield, but I’m hoping to get my hands on one of these ruggedized airframes in the near future.

netting-deathsThe netting around the battle arena served its purpose of protecting the many, many spectators that came to watch the action, but had the side-effect of capturing drones like so many hapless bluefin tuna. A big PVC tube with a knife stuck on the end had to be deployed. More than a few times.

Here’s a grab-bag of images from the first day of MakerFaire. Coming back tomorrow….