²¨¶àÒ°´²Ï·ÊÓÆµ ѸÀ×ÏÂÔØ ѸÀ×ÏÂÔØ

    1. <form id=UUExFZdPw><nobr id=UUExFZdPw></nobr></form>
      <address id=UUExFZdPw><nobr id=UUExFZdPw><nobr id=UUExFZdPw></nobr></nobr></address>

      *** Voting for the MeFiCoFo Board has begun! ***
      September General Site Update | 9/27 MeFiCoFo Board Update

      Autonomous cars and the law
      December 14, 2012 10:53 AM   Subscribe

      Can autonomous vehicles navigate the law? This year has been full of big news about the progress of self-driving cars. They are currently street legal in three states and Google says that on a given day, they have a dozen autonomous cars on the road. This August, they passed 300,000 driver-hours. In Spain this summer, Volvo drove a convoy of three cars through 200 kilometers of desert highway with just one driver and a police escort. Cadillac's newest models park themselves. The writing, one might think, is on the wall. But objects in the media may be farther off than they appear.
      posted by modernnomad (83 comments total) 12 users marked this as a favorite
       
      They'd be better than a lot of Russian drivers, at least...
      posted by kmz at 10:56 AM on December 14, 2012 [1 favorite]


      This August, they passed 300,000 driver-hours.
      It seems to me that they are still stuck at zero driver-hours, actually.
      posted by Flunkie at 10:58 AM on December 14, 2012 [16 favorites]


      Self-driving cars will never catch on unless they include an "IRRATIONALLY AGGRESSIVE DICKHEAD" mode.
      posted by The Card Cheat at 11:10 AM on December 14, 2012 [7 favorites]


      I thought the biggest problem was that they actually obeyed the law, throwing everyone else off?
      posted by Hactar at 11:16 AM on December 14, 2012 [3 favorites]


      IANAL, but the biggest problem is that there's no case law saying who is at fault when one of these cars kills someone. Well, that and no law-law either.
      posted by GuyZero at 11:18 AM on December 14, 2012 [1 favorite]


      No disassemble Johnny 5!
      posted by mrnutty at 11:20 AM on December 14, 2012


      It seems to me that they are still stuck at zero driver-hours, actually.

      Beware those divide-by-zero errors....
      posted by dhartung at 11:30 AM on December 14, 2012


      Autonomous vehicles will still make mistakes and kill people in the early years, probably a lot less than human controlled vehicles though. This may work as an argument when convincing regulators, but you can't defend yourself from a civil wrongful death lawsuits using the argument that statistically speaking the dead person's death was a reasonable trade-off.

      Maybe some kind of parallel system will need to be developed to compensate victims of autonomous vehicle malfunctions, funded by a levy on vehicles and maybe from general taxation revenue. This could keep civil suits out of the court system and allow society in general (which benefits from the reduction in fatalities) to compensate the victims.

      That system could also enforce standards and force manufacturers to share certain safety discoveries that are made as a result of these accidents.
      posted by atrazine at 11:35 AM on December 14, 2012 [9 favorites]


      IANAL, but the biggest problem is that there's no case law saying who is at fault when one of these cars kills someone. Well, that and no law-law either.

      This is silly. How are cars different from any other product that can kill people? There are tons of product liability laws that try to determine blame, and whether that blame is on the developers or the users.
      posted by GDWJRG at 11:36 AM on December 14, 2012 [2 favorites]


      States and municipalities are going to fight these tooth and nail - it will rip out traffic enforcement as a revenue source, and hence drive up local property and/or income taxes.

      I'm OK with this myself:

      - Traffic fines are a regressive tax. You will be pulled over more often, and suffer a greater amount of fines and fines for not paying the fines on time and fines for not paying those on time, if you're poor.

      - Traffic enforcement is often used to harass and unjustly imprison the poor or minorities, usually for drug possession offenses unrelated to the (often imaginary) traffic violation that the officers pulled them over for in the first place.

      - Self driving cars remove "macho" high-performance considerations from car buying. If you're not driving, and the car is going the speed limit at all times, anyway, the primary considerations are comfort, utility and fuel efficiency, depending on what you're buying the car for. Pulling a trailer? It will be cheaper to buy a driverless tractor that can follow your much more comfortable car to the boat ramp than it will be to buy a full-size SUV for everyday driving. So cars will become much lighter, as that's more fuel efficient, which means roads will need repair less often. Fuel will become a much smaller part of the household budget, which means taxes on gas consumption, another regressive tax, will decrease.
      posted by Slap*Happy at 11:39 AM on December 14, 2012 [17 favorites]


      Cadillac's newest models park themselves.

      Based on what I've actually seen of Cadillac drivers just in the past few months, they need the ability to pull out themselves as well: I've never seen anything to match Cadillac owners for bashing cars front and back when pulling out, no matter how much room they have. At this point I think all Caddies should be full-time self-drivng, with no manual controls, because the only people still buying them in 2012 really shouldn't have a license.
      posted by George_Spiggott at 11:42 AM on December 14, 2012 [5 favorites]


      You wonder how long it will take before people who drive for a living are out of jobs? In ten or twenty years will the professions of taxi driver or truck driver exist?
      posted by octothorpe at 11:47 AM on December 14, 2012


      "When someone invents self driving cars, we will invent the drinking game for those cars." --Ze Frank
      posted by poe at 11:48 AM on December 14, 2012 [1 favorite]


      atrazine: That's the best solution to the liability issues I could come up with, too. But in the current cultural/political climate it's hard to see people agreeing to any scheme that requires everyone to pay for the benefit of only a few.
      posted by saulgoodman at 12:11 PM on December 14, 2012


      This is silly. How are cars different from any other product that can kill people? There are tons of product liability laws that try to determine blame, and whether that blame is on the developers or the users.

      Car accidents are routine and current state law may require that one party in an accident be designated as at-fault. And there are all sorts of economic consequences of that at-fault determination. It's going to be tricky to throw a third-party into the mix. Nowadays, determining liability for most car accidents doesn't involve the car manufacturer or other third-parties. This tech potentially creates all sorts of disruptions to well-established legal processes and the auto insurance business. With as much money as there is at stake, it's not going to be easy to untangle the mess.
      posted by saulgoodman at 12:18 PM on December 14, 2012


      I look forward to more all-night car chases, like in The Blues Brothers.
      posted by The Card Cheat at 12:18 PM on December 14, 2012


      You wonder how long it will take before people who drive for a living are out of jobs? In ten or twenty years will the professions of taxi driver or truck driver exist?

      Taxi drivers and chauffeurs are toast. Delivery vehicles will require someone to, you know, deliver what the vehicle drove to the location with. Busses and trucks will require someone to monitor and chaperone the cargo, tho they won't drive anymore... long haul truck drivers in particular will instead be trained as mechanics rather than drivers, and there may be one of them for a convoy of four or five vehicles.
      posted by Slap*Happy at 12:19 PM on December 14, 2012


      I was joking with someone today about how exactly Google can be sure its flawless performance record with this tech isn't due to other drivers on the road compensating for their self-driving car's erratic driving style... Maybe everyone on the road who sees one of their cars coming can tell something's wrong by the robotic way it's driving and drives super-defensively until it passes. Are their tests controlling for those kinds of effects? I would love to see this tech work and take off, but there's still a lot to be ironed out before people will be willing to adopt it. And I'd be interested to see if any unique problems emerge when lots of these self-driving cars are let loose on the road at the same time.
      posted by saulgoodman at 12:23 PM on December 14, 2012 [1 favorite]


      I still think self-driving, autonomous vehicles are a logistical nightmare given the number of different manufacturers, models, types (sedan, SUV, truck, etc), and roads involved. How can you even test how such a complicated system will behave?

      If a dozen different vehicles with different AIs manufactured by different companies all converge upon an abnormal rotary, intersection, or deer in the road, what happens?

      ( We know what happens with humans, but autonomous vehicles aren't even humans )
      posted by RonButNotStupid at 12:28 PM on December 14, 2012


      Are their tests controlling for those kinds of effects?

      There's always someone in the car, just not actively driving (though they can take over at any time). I suspect they would have noticed if that were a significant issue.
      posted by jedicus at 12:33 PM on December 14, 2012


      Have they ever put, say, 50 of these cars on a test track and watched how they responded to each other in different real-life driving scenarios? There might be errors in their navigation logic that only show up as an emergent property when lots of these self-driving systems interact.
      posted by saulgoodman at 12:41 PM on December 14, 2012 [2 favorites]


      As someone who enjoys driving (mostly), I welcome self-driving cars for those who don't. (And actually, for some who do, but do so badly--a category I of course am not in, by definition.)
      posted by maxwelton at 12:41 PM on December 14, 2012 [1 favorite]


      I would expect the first widespread use of autonomous cars will be on major highways, where an "express lane" might be reserved for autonomous vehicles with a higher speed limit.

      If the technology can develop to be robust enough (and I've gotta be honest, I am totally blown away by how far the Google approach has gone in such a short period of time so I expect it will), then I don't actually doubt that the necessary regulatory changes will be made. I posted the article not because I agree with it, but rather because I find it a fascinating topic. The rise of autonomous vehicles could fundamentally reshape the typical North American city.
      posted by modernnomad at 12:43 PM on December 14, 2012 [1 favorite]


      it's hard to see people agreeing to any scheme that requires everyone to pay for the benefit of only a few.

      Isn't that effectively what we've already done by making car insurance mandatory? Seems to me that insurance is the solution here too. I expect that self-driving car liability insurance will be much cheaper than human-driver liability insurance, simply because the likelihood of a crash is so much lower.
      posted by Mars Saxman at 12:55 PM on December 14, 2012 [1 favorite]


      Fair points, Mars Saxman, but we recently tried to make health insurance mandatory and it almost sparked violence, so the times have changed a bit.
      posted by saulgoodman at 1:02 PM on December 14, 2012


      Agree with Mars Saxman - the entire concept of insurance is pooling risk with the financial benefit going to the few who must draw on the pool. If autonomous vehicles can prove themselves to be safer than 'normal' vehicles (though we must assume that for the forseeable future all autonomous vehicles would in fact be 'hybrid' models where the self-driving system could be engaged/disengaged by the driver), then insurance rates might actually drop.

      The biggest stumbling block will be perception of safety. The same way that some people are absolutely terrified of flying even though it is statistically FAR safer than driving, any fatalities in autonomous vehicles might doom the whole project, because everyone would think "well I'm a better driver than the average person so why put my life in the hand of a computer?"

      I'm not sure how you get around that stumbling block, because I assume they would need widespread adoption for the economies of scale to work.
      posted by modernnomad at 1:04 PM on December 14, 2012


      I'm not sure how you get around that stumbling block

      I could drive... or I could watch "Community" re-runs on the in-car TV on my way to the mall.

      I could drive... or I could crack open a beer on the way to the game.

      I could drive... or I could sleep through my entire commute.

      Vanity and pride is no match for laziness and self-indulgence.
      posted by Slap*Happy at 1:14 PM on December 14, 2012 [8 favorites]


      Car insurance is already mandatory though. In Europe some vehicles come with insurance; this is an obvious way for Google to crack open the self drive car market. They could partner with a manufacturer and offer insurance as part of a lease. If the vehicles were lease only they could control the distribution like GM did with the EV1.

      octothorpe writes "You wonder how long it will take before people who drive for a living are out of jobs? In ten or twenty years will the professions of taxi driver or truck driver exist?"

      Some taxi drivers will still be around to serve people who need assistance loading and unloading. But I imagine that will be a small percentage. Truck drivers will still be around because you need someone to shepard the cargo both in transit and at both ends plus perform operations like refueling; preventive maintenance (brake adjustment) and chain up. Like Slap*Happy said the job would morph to mechanic/overseer. However there are some point to point routes where the truck is loaded at a warehouse and unloaded at a warehouse that could be completely autonomous. Also probably most of the containers you see on roads rather than rails.

      RonButNotStupid writes "I still think self-driving, autonomous vehicles are a logistical nightmare given the number of different manufacturers, models, types (sedan, SUV, truck, etc), and roads involved. How can you even test how such a complicated system will behave?"

      Incrementally. Both the limited access special lane and particular communities are good starting points. Autonomous minivans serving a retirement community as a point to point transit system would be a good test.
      posted by Mitheral at 1:16 PM on December 14, 2012


      I actively despise driving, and I would pay a 50% premium for the autonomous version of a car over an otherwise-identical traditional model.

      Car manufacturers are aware of this, I suspect.

      Autonomous vehicles will happen. Individual cities & states may try to prevent them, but they'll happen somewhere and that will force the hand of everywhere else over time.

      ...but I also suspect that many of the more scaredy-cat jurisdictions will require that the human "driver" must still pay attention and must not be drunk etc. That way if the car kills someone, we'll just blame the human behind the wheel since they could potentially have prevented the accident.
      posted by aramaic at 1:46 PM on December 14, 2012 [1 favorite]


      This analysis is completely wrong. Since the dawn of the industrial age, the law has done a very good job keeping up with technological innovation the market wants.

      Government has been especially quick to sweep away impediments to making transportation more convenient, cheaper or faster, particularly when industry has a lot of investments to make and return on investment to reap. Paddle-wheel steamers, locomotive trains, automobiles, and planes all (would have) violated long lists of laws and enforceable customs, and created untold personal and property injury liability ... except that those laws were changed, customs abandoned, and lawsuits prohibited or dismissed, in very short order.

      The incompatibility between self-driving and person-driven cars is less in magnitude than the incompatibility between cars and horse-drawn carts. The creative destruction of driver jobs is a lot less than the jobs lost in the move from passenger trains to planes.

      Think about how fast technology that no one really needs, never even knew they wanted, and doesn't really make their life measurably better, has been adopted in the past 15 years, and how far along it is in superseding prior technologies. Now compare this to the incremental productivity and comfort of self-driving cars, and the huge economic opportunity which would be converting 50 million cars to the systems over the course of half a dozen years.

      The real challenge is getting the technology actually read for prime time, because it is hard.
      posted by MattD at 1:54 PM on December 14, 2012 [3 favorites]


      Agree with Mars Saxman - the entire concept of insurance is pooling risk with the financial benefit going to the few who must draw on the pool.

      I've done a fair bit of work in insurance (on the regulatory side) and while this all sounds simple, the way the sausage is made is so much uglier and involves so much litigation to settle matters of liability. In Florida, for example, we have hardly any home insurance providers left because no one thinks they can make money in the market (due to the frequency of catastrophic weather events). We're currently having serious issues in this area. The only really good solution would be risk pooling at the national level, but no one is willing to do that because that would require people in less catastrophe prone states to carry the load.

      Also, what car insurer is going to want to write policies in which their drivers are always at fault and the liability is always on their side? Because you know, most court aren't going to want to put the blame on the human driver in one of these crashes, regardless of the reality. And which insurer pays in an self-driving car on self-driving car accident? The two sides would be tied up in court forever trying to avoid paying. Unless there are new regulations and a system such as atrazine described to clarify things, I predict much confusion and lots of expensive litigation at the start.
      posted by saulgoodman at 1:55 PM on December 14, 2012


      Incrementally. Both the limited access special lane and particular communities are good starting points.

      This invites another set of legal problems involving fairness because not everyone will be able to purchase an autonomous vehicle right way. Do human drivers get to share these special lanes, or will they just become privileged lanes for the wealthy?

      And if you're going to set aside an entire lane for autonomous vehicles, why not just roll out more mass transit?
      posted by RonButNotStupid at 1:55 PM on December 14, 2012


      And if you're going to set aside an entire lane for autonomous vehicles, why not just roll out more mass transit?


      Need not be an either/or. Much as I am a fan of mass transit and take it daily, the reality is that a lot of North American communities do not have the density to support regular, cheap mass transit that actually goes where people want to go. Autonomous vehicles that can support fuel efficient and rapid "train mode" on highways might be a great way to bridge the gap.
      posted by modernnomad at 2:15 PM on December 14, 2012 [1 favorite]


      The legal fairness thing isn't a problem; I'm thinking about the states that allow electric vehicles in HOV lanes regardless of number of occupants. Or the lane discrimination enforced on heavy trucks. Or heck even toll roads and bridges discriminate against the poor.

      The setting aside would be temporary; once the cars have been proven you'd allow mixing with the non-autonomous traffic.
      posted by Mitheral at 2:23 PM on December 14, 2012


      and I would pay a 50% premium for the autonomous version of a car over an otherwise-identical traditional model. Car manufacturers are aware of this, I suspect.

      You know who else says a version of this? The bane of the car message boards, the fan of European, rear wheel drive manual diesel station wagons - who all post some version of "I currently drive a 1998 4 cyl Camry, but I'd buy an E-Class Mercedes if only it was offered in diesel with a manual." When the manufacturer introduces a like model, fanbois rejoice............ and the model goes mostly unsold.

      My guess is that the media and fans will clamor for autonomous vehicles, which then go on sale to great acclaim only to gather dust.
      posted by lstanley at 2:38 PM on December 14, 2012


      Autonomous vehicles will happen. Individual cities & states may try to prevent them, but they'll happen somewhere and that will force the hand of everywhere else over time.
      I think this pretty much sums it up. If we can build reliable, safe self driving cars (something that Google has already shown we're very close to doing), the complete advantage they have over the person-driven variety will win out. It only needs a friendly jurisdiction somewhere in the world to allow them for the technology to be proven, and once it's proven the pressure to allow it will easily push down any barriers.

      Fundamentally, self driving cars would improve the lives of millions upon millions of wealthy commuters. That is the kind of force that drives laws.
      posted by leo_r at 2:49 PM on December 14, 2012


      In the early automobile era, the biggest challenge to overcome wasn't technological, but social. It involved convincing people that they were responsible for keeping their kids off the streets, rather than the older understanding that vehicle drivers were responsible for not killing kids.

      I think the most interesting development will concern the use of public space. If a car can be sent away to some empty lot instead of having to spend 14 hours a day within 50 feet of your residence, can that space be repurposed, and if so, to what? If automated cars are indeed perfectly safe, does that mean kids will be allowed to go on bike rides and play sports in the street? Or, on the flip side, if automated cars can be operated by kids and the elderly, will this be the justification to ban pedestrians and bicyclists from streets entirely, in the interest of allowing continuous 60 mph travel on every road?

      toll roads and bridges discriminate against the poor.

      If toll roads discriminate against the poor, then so do all limited-access roads, since not everyone can afford to operate a car.
      posted by alexei at 3:05 PM on December 14, 2012


      Since we are all making predictions, here is mine: Someone will look at the technology and the legal situation and off an "autonomous" car that really doesn't do much more than park itself, regulate cruise control, and do assisted corners and lane changes on the highway including active prompts to let you take the off ramp. The driver will still be expected to remain entirely alert through the entire process. It will cost a lot and folks will hate it because it actually makes driving even more dull and dreary. Folks will decide they don't want autonomous cars. A few years later someone will roll out the real thing as a low cost compact commuter and everyone will be shocked when it becomes the best selling vehicle model ever.

      I remember seeing early testing on this technology over twenty years ago, and it was impressive even then. I suspect this will be some of the most heavily vetted safety technology ever when it hits the market.
      posted by meinvt at 3:19 PM on December 14, 2012


      meinvt: what do you mean by "the real thing"?
      posted by Mars Saxman at 3:22 PM on December 14, 2012


      Also true. Owning a car in the first place is expensive which is one of the reasons poor people don't tend to live in suburbs.

      meinvt writes "A few years later someone will roll out the real thing as a low cost compact commuter and everyone will be shocked when it becomes the best selling vehicle model ever."

      Look for the Apple iCar to "revolutionize" the auto-drive market while all the companies that put the sweat into early development walk away with bupkis.
      posted by Mitheral at 3:22 PM on December 14, 2012


      If a dozen different vehicles with different AIs manufactured by different companies all converge upon an abnormal rotary, intersection, or deer in the road, what happens?

      Have they ever put, say, 50 of these cars on a test track and watched how they responded to each other in different real-life driving scenarios? There might be errors in their navigation logic that only show up as an emergent property when lots of these self-driving systems interact.

      I have seen this at the DARPA Urban Challenge: 11 autonomous vehicles plus 11 chase cars with human drivers, all driving in traffic, negotiating intersections & stop signs, merging and passing.

      MIT's car "Talos" car and Cornell's car "Skynet" collided in one of the first-ever collisions between autonomous vehicles. This article from the Journal of Field Robotics, "The MIT¨CCornell Collision and Why It Happened" has lots of details on the crash, but basically what happened was that one vehicle's actions confused another, causing a low-speed collision while passing.
      posted by jjwiseman at 3:28 PM on December 14, 2012 [3 favorites]


      Self driving cars remove "macho" high-performance considerations from car buying. If you're not driving, and the car is going the speed limit at all times, anyway, the primary considerations are comfort, utility and fuel efficiency, depending on what you're buying the car for.

      Then again, why buy the car in the first place? That way you have to store it and maintain it, and if it is damaged or stolen, that is your problem. My bet is that most people won't bother buying cars, and instead will subscribe to an automated car rental service that effectively works like a robot taxi service. A few will hold out and keep their sedans out of the sentimental attachment to having somewhere to leave their stuff and to adorn with bumper stickers, but that vestigial behaviour will die out within a generation. The only car owners will be the car buffs, the enthusiasts who build, maintain and drive their own vintage/art cars out of sheer eccentric love.
      posted by acb at 3:30 PM on December 14, 2012 [2 favorites]


      One thing I worry about with autonomous cars is that while I'm certain they will be much safer and save thousands of human lives, I think they may result in a lot more miles driven, globally, and more fuel being burned.

      They will certainly be able to drive in a more fuel-efficient manner than manned vehicles, but it seems like they'd significantly encourage more road trips. And once they get good enough (50 to 100 years, say), they may be capable of driving without even a human rider--in which case the global mileage driven will include miles driven while ferrying people as well as "empty" miles: imagine a couple with one car, where one person drives to work with the robocar at 8:30 AM, then the car drives home and takes the other person to work. You then have (miles from home to work A: with person) + (miles from work A to home: empty) + (miles from home to work B: with person).
      posted by jjwiseman at 3:36 PM on December 14, 2012 [1 favorite]


      I don't want to go all libertarian Rush fan here and start quoting "Red Barchetta," but driving is a pretty sacred thing to a lot of people. I myself am aware of the environmental impact and drive a fuel-efficient car, but there's something about just you and your car on a lonely highway, especially if you're lucky enough to live in the Western US.

      They may become an option, but I don't think the US would ever accept a ban on person-driven cars.

      Another issue is this: Does anyone think even for a second these robot-cars wouldn't remember every single place they took you? Does anyone believe Google or their equivalent wouldn't hold onto this information and make use of it? Would the companies that make the cars resist when the government asked to know exactly when and where "suspicious" person X drove? (I imagine they'd resist just about as much as the telecoms did.)

      Imagine trying to ditch work or school only to find out your car has other ideas.
      posted by drjimmy11 at 3:54 PM on December 14, 2012 [3 favorites]


      Autonomous cars will come, accident rates will drop to almost nothing, insurance for autonomous cars will be very cheap, and insurance for people who insist on driving the old-fashioned way will go wayyyy up. When an accident does happen, it will be the fault of the owner if the owner did something wrong (poor maintenance or vehicle misuse) or the manufacturer (poor design) or no one (shit happens).
      posted by pracowity at 4:34 PM on December 14, 2012 [1 favorite]


      > I imagine they'd resist just about as much as the telecoms did.

      Google already gives up user info to law enforcement without warrants/subpoenas. 90% of US requests are approved.

      If they have NSA/FBI search bots in their data centers, it's still secret.
      posted by morganw at 4:35 PM on December 14, 2012


      As a cyclist, I look forward to this. Cars that stay the fuck out of the bike lane until they're 200 feet from an intersection where they're turning? Awesome.

      I really wonder how good the sense & avoid logic can be, though. Will they avoid passing a cyclist with 2 feet to spare? What then? Can the "driver" ask for a lane change to give more room? I'm guessing the car won't drive half way out of a lane to get around an obstruction, but will want to do legal, complete lane changes.
      posted by morganw at 4:47 PM on December 14, 2012


      Autonomous individual cars should never actually take off, if our society has a lick of sense. It should be all self-driving electric trolleys and buses. I'm not convinced that there is a use case for automatically driving around 1-4 individuals at a time, but using it to spread mass transit much further and more economically would be excellent.
      posted by graymouser at 5:49 PM on December 14, 2012


      A self-driving bus would be a roving venue for muggings.
      posted by nev at 6:36 PM on December 14, 2012 [1 favorite]


      Human override will always be an option. It has to be. ( scenario follows after next point ).

      A recent link from the guardian's data blog shows that deaths due to vehicle accidents are strongly tied to age. (in the first graph, change the right most selector box from "Overview" to "Transport Injuries").

      People who die in their teens, 20s and 30s are much more likely to die of car accidents than older people.

      If the act of driving itself were uniformly dangerous than we wouldn't see such a strong a correlation with death and age.

      Since age is a factor I posit that behvior is the underlying cause. Would a reckless driver let an autonmous vehicle drive, or would they use the override as a defining characteristic of their ego?

      I gladly welcome the tech and hope it saves many lives, forces slower driving overall and reduces emissions etc.

      But it will not prevent the daily insanely high death toll on the roads. Only a complete ban on cars would do that.

      Here's the the previously promised scenario which says human override must be allowed on autonomous vehicles. Sirens. What would an autonomous car do when it's approaching a green light and a siren is going off?

      If the car is designed to ignore the siren and obey the green light it'll either be T-boned by an emergency vehicle, or if there are enough autonomous vehicles they'd completely obstruct the emergency vehicle.

      Alternatively if the car is designed to stop when it hears a siren (or other warning device) well that's a recipe for a denial of service attack.
      So you'd have to allow humans to override to an autonomous car. A human override implies reckless people who cause accidents will continue to do so presumably at the same rate as now.
      posted by ecco at 6:42 PM on December 14, 2012


      I could drive... or I could watch "Community" re-runs on the in-car TV on my way to the mall.

      You just described my dystopian nightmare fantasy. Everyone atomized in their own private box, absorbing things passively through their screen as they are moved from home to work to the mall so that they can consume more. I'm sure Google loves what's coming: the opening of vasts amounts of your attention formerly taken up by driving. Now everyone will have lots of time to sit alone and stare at Google's ads on whatever media you are watching on your boring commute.

      Sorry I can't get excited about the technology or hypothetical logistics of such a lame ass future.
      posted by bradbane at 7:02 PM on December 14, 2012 [1 favorite]


      ecco makes a good point. This idea might work in a world with a better caliber of human being in it, but it doesn't seem workable to me in the world we've got now. I'm not happy about that conclusion, but unless we change who we are, all the way from deep down at the bottom of human culture to the very top, that's what we're stuck with. We're not willing to exchange driving the cars we've got now for driving slightly slower cars even if that might help prevent an ecological nightmare we've seen coming for nearly a half century. Why would we be willing to give up our Fahrvergn¨¹gen now? GM and other American car makers certainly don't seem to be betting on a more sensible future.
      "I've talked to people who say 'I just put $100 in gas in my tank,'" he said. "[But] when I ask if they want to trade down to a smaller engine next time their response: 'Hell no.'"
      But maybe today's news has just gotten me in a cynical frame of mind.
      posted by saulgoodman at 7:02 PM on December 14, 2012


      The real question is how much longer non-autonomous vehicles will remain legal. Probably a while, but I can't imagine a technology that has the capacity to save tens of thousands of lives per year in the US, and millions worldwide will remain illegal.

      ---
      Speaking of energy use and driving though, Tesla unveiled their supercharger stations a couple months ago.

      If you own a Tesla in California you can now fill up with electricity on major highways in just a half an hour, and they plan to cover the country in about a half an hour.

      And, with each station they're building they're installing enough solar to cover all the charging year round.

      And, charging will be free. So not only will you not have to pay $100 to fill up your tank, you won't need to pay a cent. Zero cost, zero carbon emissions. At least on long trips.
      GM and other American car makers certainly don't seem to be betting on a more sensible future.
      Last I checked, Tesla was an American manufacturer.
      posted by delmoi at 7:34 PM on December 14, 2012



      Here's the the previously promised scenario which says human override must be allowed on autonomous vehicles. Sirens. What would an autonomous car do when it's approaching a green light and a siren is going off?

      If the car is designed to ignore the siren and obey the green light it'll either be T-boned by an emergency vehicle, or if there are enough autonomous vehicles they'd completely obstruct the emergency vehicle.
      There are a couple of things wrong with this scenario.

      1) Lights turn red when they detect emergency lights.

      2) The cars can detect all the cars around them, they absolutely do not assume that other cars will follow the rules and won't go if it's not safe. They would be able to detect an emergency vehicle speeding towards an intersection - they could also detect a speeding car without sirens and not go through a green light if the car were driven by a drunk driver or just someone being inattentive.

      3) People get hit driving through green lights all the time. It's actually much less likely that an autonomous vehicle would get into an accident. I actually heard second hand from someone who saw another driver pull into an intersection and get hit by an emergency vehicle. Except the lights for them were actually red and they decided to go anyway, not seeing the police car.
      posted by delmoi at 7:41 PM on December 14, 2012


      Autonomous vehicles will still make mistakes and kill people in the early years, probably a lot less than human controlled vehicles though. This may work as an argument when convincing regulators, but you can't defend yourself from a civil wrongful death lawsuits using the argument that statistically speaking the dead person's death was a reasonable trade-off.
      I'm not sure why this is supposed to be such a huge stumbling block. When legislators write laws allowing autonomous vehicles, they can spell out the liability directly in those laws.
      I was joking with someone today about how exactly Google can be sure its flawless performance record with this tech isn't due to other drivers on the road compensating for their self-driving car's erratic driving style... Maybe everyone on the road who sees one of their cars coming can tell something's wrong by the robotic way it's driving and drives super-defensively until it passes. Are their tests controlling for those kinds of effects? I would love to see this tech work and take off, but there's still a lot to be ironed out before people will be willing to adopt it. And I'd be interested to see if any unique problems emerge when lots of these self-driving cars are let loose on the road at the same time.
      If a driver is paying close attention to the driving styles of other cars, they're probably not going to get into an accident at all. It's the people who aren't paying attention who cause them.
      The biggest stumbling block will be perception of safety. The same way that some people are absolutely terrified of flying even though it is statistically FAR safer than driving, any fatalities in autonomous vehicles might doom the whole project, because everyone would think "well I'm a better driver than the average person so why put my life in the hand of a computer?"
      So you can do something else, like text, surf the internet, watch movies, get work done, and so on? Why wouldn't people want to be chauffeured around by a robot most of the time?

      I think, absent the whole 'falling out of the sky' aspect of flying, people won't be very afraid at all. They're not currently afraid to ride in a taxi, bus, or limo. If a person is afraid of flying, I don't think giving them the controls would comfort them all that much.
      You just described my dystopian nightmare fantasy. ... Everyone atomized in their own private box, absorbing things passively through their screen as they are moved from home to work to the mall so that they can consume more. ... sit alone and stare at Google's ads on whatever media you are watching on your boring commute.
      So currently all that stuff is already true, except people only listen to the radio and have to concentrate on a somewhat tedious and extremely dangerous task, where they can kill people or die if they fail - resulting in tens of thousands of death a year - But if you remove the death and destruction then it becomes a dystopian future? Because people can surf the internet? Which is what you're doing right now?

      Also, Google's ads? Is there something about autonomous vehicles that you think will make adblock not work?
      posted by delmoi at 8:01 PM on December 14, 2012 [4 favorites]


      Autonomous cars will come, accident rates will drop to almost nothing, insurance for autonomous cars will be very cheap, and insurance for people who insist on driving the old-fashioned way will go wayyyy up.

      This. I've been trying to convince people of this future for a while, but they seem disinclined to take it seriously. But:
      - insurance companies do actuarial data really well,
      - that data will almost surely show a hugely reduced accident rate for autonomous vehicles, and
      - insurance companies, being rational businesses, will reflect that in their pricing.

      All the rest -- details of liability, cultural comfort, etc -- is just noise around the overwhelming economics of insurance. Absent some extreme circumstance, I don't see how it could possibly turn out otherwise.
      posted by bjrubble at 10:52 PM on December 14, 2012 [1 favorite]


      "Oh my god, autonomous cars might get into accidents! What, accidents already happen, and at an astronomically higher rate than the autonomous cars get into? Who cares?"
      posted by Pope Guilty at 11:24 PM on December 14, 2012 [1 favorite]


      I really cannot understand the opposition to autonomous cars. I've seen a lot of comments along the lines of "I'm such a great driver there is no way a robot can drive better than me" on other sites (usually with more misspellings), but that really isn't the point. There are lots of terrible drivers out there who do acknowledge that they are bad drivers and would love to have an autonomous car (my wife for instance - although she really isn't as bad of a driver as she thinks). Furthermore, consider the reduction in drunk driving. While I am sure that some drunks would manually override the system, I think that their drunkenness in combination with general laziness would lead most of them not to bother driving manually.

      Anyway, I would pay a significant premium - say $10,000 - for a self driving car and I am not a person who is obsessed with the latest gadgets. This could represent a significant improve in the quality of life.
      posted by nolnacs at 4:43 AM on December 15, 2012


      Now, Smith asks the workshop, who gets sued?

      Party with the deepest pockets, generally.
      posted by flabdablet at 4:58 AM on December 15, 2012


      most experts predict drivers will be legally required to have a person in the car at all times, ready to take over if the automatic system fails. If they're right, the self-parking car may never be legal.

      You know what really ticks me off? The way that guy I employ to run in front of me with the red flag can't sustain a faster pace than 20 km/h. I could cut my commute time in half if we could just do away with that rule.
      posted by flabdablet at 5:03 AM on December 15, 2012 [1 favorite]


      I read that as "Can autonomous vegetables navigate the streets" and did a double-take.
      posted by Serene Empress Dork at 5:43 AM on December 15, 2012


      Autonomobiles.
      posted by Pope Guilty at 8:18 AM on December 15, 2012


      Autonomous cars just need to store all of their sensor data to a high capacity black box. Reading out the black box data after an accident will prove who or what is liable pretty unambiguously, and there need never be a "he said/she said" debate after an accident. In a few years time all of the sensor data, including cameras, that a car sees during its entire lifetime will fit onto an inexpensive SSD.

      The civil liberties implications of every car recording everything it sees forever are obvious, but that's the price we pay for convenience.
      posted by monotreme at 10:17 AM on December 15, 2012


      With autonomous cars you can do scary intersection routing like this.
      posted by Pyry at 10:57 AM on December 15, 2012 [2 favorites]


      Exactly, Pyry. Once things get to that point, computers will drive cars in the same way they play chess: differently from the way humans do it. They won't need to pull over to a stop for an emergency vehicle, they'll just move over slightly to make a hole at exactly the right time, and that hole will be just in front of the ambulance/police/fire truck during its entire trip.

      (Actually while that is possible it may take a while before things get to that point--you need well tested, robust algorithms for doing that when you can't guarantee that other vehicles will cooperate, with reasonable fallback behavior.)
      posted by jjwiseman at 11:32 AM on December 15, 2012


      monotreme why would you need more than a few minutes of history or at most the duration of the most current trip for an accident investigation?
      posted by Mitheral at 11:48 AM on December 15, 2012


      @mitheral: I agree that there's no need for more than a few minutes of data for accident investigation. However, in a few years time, terabytes of storage will cost pennies and the collected data has so many potential uses that companies and governments won't want to delete it.
      posted by monotreme at 1:07 PM on December 15, 2012


      With autonomous cars you can do scary intersection routing like this.

      Where are the sidewalks?
      posted by bradbane at 6:36 PM on December 15, 2012 [1 favorite]


      Sidewalks are not necessary. Simply occupy a lane, submit your request to the intersection controller using the standard AIM protocol applicable in your region and you will be routed accordingly.

      You have ten seconds to comply.
      posted by flabdablet at 9:46 PM on December 15, 2012 [3 favorites]


      You know, I've yet to see somebody talk about how dangerous self-driving cars would be in residential areas. Highway driving? No problem, everything's pretty straight-forward. But if you're driving in an area where kids are running around, where people are carelessly getting out of their cars, where pedestrians are illegally crossing the street -- you can't rely on a short-range sensor to tell you when to stop. A human can analyze the situation and slow down or change lanes from a considerable distance; a self-driving car cannot, and probably won't be able to for a long while.

      I don't think fully self-driving cars have a future. A self-driving highway mode might be possible, though.
      posted by archagon at 1:08 AM on December 16, 2012


      archagon, I think that you are underestimating the technology and overestimating human driver's safety around other humans. Autonomous should be able to handle all those things better than human drivers in a few years.

      A human can analyze the situation and slow down or change lanes from a considerable distance

      Yea but they don't; they blast through 25 MPH zones at fifty while eating chicken nuggets, talking on the phone and smoking cigarettes. Some lady near me was hit by three vehicles and at least one the vehicles didn't even notice and kept going. It won't take much for robots to do a better job than that.
      posted by octothorpe at 4:59 AM on December 16, 2012 [1 favorite]


      The way skeptics talk about autonomobiles reminds me of how skeptics talk about climate change; there's no end of "Well I bet you smarty-pants [scientists/engineers] didn't think about THAT, did ya?!" and it's really obnoxious and stupid.
      posted by Pope Guilty at 5:12 AM on December 16, 2012 [1 favorite]


      Archagon, if you read up on how Google's cars work now, you'll see that they already have the ability to detect pedestrians illegally crossing streets.

      Bear in mind that these are still prototypes - the technology will improve and get cheaper, just as has been the case with every technological innovation in the history of the world. We're really no longer asking "whether" autonomous vehicles are possible, but instead have moved on to wondering "when" they will be commonplace.
      posted by modernnomad at 8:46 AM on December 16, 2012


      Where are the sidewalks?

      You could put in pedestrian walkways that either go under or over the roads as appropriate. If that doesn't work for the intersection in question then just keep it as a standard traffic light, perhaps with the ability to communicate with nearby cars so that people aren't waiting more than necessary.
      posted by any portmanteau in a storm at 9:37 AM on December 16, 2012


      > already have the ability to detect pedestrians illegally crossing streets

      But they can't anticipate that a pedestrian on the side of the street will suddenly dart in front of them. To some extent they don't need to anticipate because they don't need to "guard" the brake pedal for a shorter reaction time and they don't need to stop playing with the radio, but there is a bit of situational awareness only available to human drivers.

      > I've seen a lot of comments along the lines of "I'm such a great driver there is no way a robot can drive better than me"

      For some values of better. If better means shorter travel time, laws and vulnerable road users be damned, then humans driving ungoverned cars are "better" than robots.

      While changing lanes a lot in slow-and-go traffic on the freeway might not get you there much faster, on 40 MPH arterial with stoplights, cutting, speeding (60+) and running "late yellows" is significantly faster.
      posted by morganw at 10:14 AM on December 16, 2012


      morganw, why do you think that situational awareness is only available to humans? You can put 360 degree laser scanners & cameras & radar on cars, they potentially can have situational awareness that it is strictly impossible for humans to have.
      posted by jjwiseman at 11:59 AM on December 16, 2012 [1 favorite]


      You could put in pedestrian walkways that either go under or over the roads as appropriate.

      I have been kind of joking about this, but seriously, instead of remaking our cities and neighborhoods for robot cars, how about we do it the other way around and redesign them around actual people.

      Then I can walk to the store and get on the (self driving!) train to go to work. Let the autonomobiles drive the delivery trucks.
      posted by bradbane at 1:28 PM on December 16, 2012


      how about we do it the other way around and redesign them around actual people.

      Indeed. Charles Marohn, "recovering engineer", has been banging that drum for a couple of years now.

      Watch that video carefully and try to consider every intersection in town like that, with autonomous cars zooming through in every direction. Before watching Marohn's critique I was actually enthused about the diverging diamond idea, but even though I'm an avid cyclist I hadn't thought through the complete streets concept.

      Now, I don't think the autonomous car per se autonomous car is antithetical to a complete streets approach or better access for pedestrians and cyclists and the disabled. In fact I think it offers a lot of promise. I do not, however, think that imagining some sort of server-managed controlled chaos intersection is the way to go about doing this.
      posted by dhartung at 5:02 PM on December 16, 2012


      I'd way rather cycle on a street with autonomobiles than on a street full of people who may or may not thinking running cyclists off the road or tapping my rear wheel at an intersection or throwing shit at me is fucking hilarious.
      posted by Pope Guilty at 5:26 PM on December 16, 2012 [2 favorites]


      The way skeptics talk about autonomobiles reminds me of how skeptics talk about climate change; there's no end of "Well I bet you smarty-pants [scientists/engineers] didn't think about THAT, did ya?!" and it's really obnoxious and stupid.

      I don't know. I'm really irritated by the sudden onslaught of "Oh, self-driving cars are totes the future!" in the past few months, especially by people who know nothing about CS or AI. This is a nascent technology that's barely been tested, and I've been in plenty of situations on the road that required me to use my full cognitive abilities to avoid an accident. Color me skeptical.

      And personally, I find it "obnoxious and stupid" how we rush to solve most of our problems through convoluted technological means rather than more difficult but ultimately more sustainable solutions. Industrial farming treating animals poorly? Vat-grown meat sounds good! Not enough oil to feed our industry? Punch a hole in the bottom of the ocean, why not? Instead of increasing road safety by building super-advanced robot cars, why don't we improve driver training or build better public transit? Do we really want to become even more of a commuter culture than we already are?
      posted by archagon at 6:22 PM on December 16, 2012 [1 favorite]


      people who may or may not think running cyclists off the road or tapping my rear wheel at an intersection or throwing shit at me is fucking hilarious

      plugins.autonomobile.mozilla.org
      posted by flabdablet at 6:38 PM on December 16, 2012 [1 favorite]


      The legal answer is very simple; you legislate a class of vehicles called "self-propelled vehicles", and that they:
      "be accompanied by a crew of three: the driver, a stoker and a man with a red flag walking 60 yards (55 m) ahead of each vehicle. The man with a red flag or lantern enforced a walking pace, and warned horse riders and horse drawn traffic of the approach of a self propelled machine."
      Been done before.
      posted by the cydonian at 12:10 AM on December 17, 2012


      As with any new tech I expect there will be resistance by a vocal minority but this is how I see autonomous vehicles implement themselves into our society:

      First, naturally, it will be a high end luxury option with a hefty price tag and a monthly subscription (because my-oh-my companies love when you pay them for infinity!) to cover support, mapping updates (rather critical) and system maintenance. There will be news reports, car shows, lots of showing off and oh-my-gosh... it will work.

      Next, the trucking and transportation industry will test it out and discover that even with premiums paid for the tech - and even if they still need a driver in there - that reduced costs from accidents and delayed or damaged deliveries will make this well worth it. Imagine the gains that walmart will see when their ~7,000 tractor trailer fleet can be reduced by even 10% because their drivers can sleep while the computer drives. If they are permitted to have a "convoy manager" and just have one well trained CDL driver with basic mechanical know-how and troubleshooting ability to take care of 3-4 tractor-trailers going in the same direction - we are talking big savings.

      Now imagine these savings scaled up. Coca-Cola has around 17,000 trucks. AT&T? 78,000! Not every truck will likely go autonomous, but we are talking big numbers when you can have human drivers going for 24 hour hauls with computer assistance, reduced fuel consumption, reduced accident costs, increased reliability with deliveries, and likely *reduced* insurance costs (bare in mind many of these fleets are self-insured, so that is an immediate savings, not one they need to wait for as insurance companies build new formulas and tables).

      So now shipping and luxury markets have heavy market penetration and shortly thereafter the rest will follow suit. Our energy dependence will be lessened, safety standards can be greatly reduced for cars that just don't crash, thousands of lives will be saved, and millions of hours of our time will be better utilized as people can nap, relax, or start work earlier while a magic silicon box handles the commute.

      And I can't wait.
      posted by cheesyburgercheese at 9:51 AM on December 18, 2012 [2 favorites]


      « Older Jul!   |   Winter Camping for Dummies, Iron Chef version Newer »


      This thread has been archived and is closed to new comments




      "Yes. Something that interested us yesterday when we saw it." "Where is she?" His lodgings were situated at the lower end of the town. The accommodation consisted[Pg 64] of a small bedroom, which he shared with a fellow clerk, and a place at table with the other inmates of the house. The street was very dirty, and Mrs. Flack's house alone presented some sign of decency and respectability. It was a two-storied red brick cottage. There was no front garden, and you entered directly into a living room through a door, upon which a brass plate was fixed that bore the following announcement:¡ª The woman by her side was slowly recovering herself. A minute later and she was her cold calm self again. As a rule, ornament should never be carried further than graceful proportions; the arrangement of framing should follow as nearly as possible the lines of strain. Extraneous decoration, such as detached filagree work of iron, or painting in colours, is [159] so repulsive to the taste of the true engineer and mechanic that it is unnecessary to speak against it. Dear Daddy, Schopenhauer for tomorrow. The professor doesn't seem to realize Down the middle of the Ganges a white bundle is being borne, and on it a crow pecking the body of a child wrapped in its winding-sheet. 53 The attention of the public was now again drawn to those unnatural feuds which disturbed the Royal Family. The exhibition of domestic discord and hatred in the House of Hanover had, from its first ascension of the throne, been most odious and revolting. The quarrels of the king and his son, like those of the first two Georges, had begun in Hanover, and had been imported along with them only to assume greater malignancy in foreign and richer soil. The Prince of Wales, whilst still in Germany, had formed a strong attachment to the Princess Royal of Prussia. George forbade the connection. The prince was instantly summoned to England, where he duly arrived in 1728. "But they've been arrested without due process of law. They've been arrested in violation of the Constitution and laws of the State of Indiana, which provide¡ª" "I know of Marvor and will take you to him. It is not far to where he stays." Reuben did not go to the Fair that autumn¡ªthere being no reason why he should and several why he shouldn't. He went instead to see Richard, who was down for a week's rest after a tiring case. Reuben thought a dignified aloofness the best attitude to maintain towards his son¡ªthere was no need for them to be on bad terms, but he did not want anyone to imagine that he approved of Richard or thought his success worth while. Richard, for his part, felt kindly disposed towards his father, and a little sorry for him in his isolation. He invited him to dinner once or twice, and, realising his picturesqueness, was not ashamed to show him to his friends. Stephen Holgrave ascended the marble steps, and proceeded on till he stood at the baron's feet. He then unclasped the belt of his waist, and having his head uncovered, knelt down, and holding up both his hands. De Boteler took them within his own, and the yeoman said in a loud, distinct voice¡ª HoME²¨¶àÒ°´²Ï·ÊÓÆµ ѸÀ×ÏÂÔØ ѸÀ×ÏÂÔØ ENTER NUMBET 0016www.juhohw.com.cn
      hetcoinex.com.cn
      www.jjhgome.com.cn
      www.fbklqm.com.cn
      www.jdbianli.com.cn
      jxlvlin.com.cn
      www.nbqs.com.cn
      tsjzzs.com.cn
      vtrip.net.cn
      www.rjiebao.org.cn
      亚洲春色奇米 影视 成人操穴乱伦小说 肏屄蓝魔mp5官网 婷婷五月天四房播客 偷窥偷拍 亚洲色图 草根炮友人体 屄图片 百度 武汉操逼网 日日高潮影院 beeg在线视频 欧美骚妇15删除 西欧色图图片 欧美欲妇奶奶15p 女人性穴道几按摸法 天天操免费视频 李宗瑞百度云集 成人毛片快播高清影视 人妖zzz女人 中年胖女人裸体艺术 兽交游戏 色图网艳照门 插屁网 xxoo激情短片 未成年人的 9712btinto 丰满熟女狂欢夜色 seseou姐姐全裸为弟弟洗澡 WWW_COM_NFNF_COM 菲律宾床上人体艺术 www99mmcc 明星影乱神马免费成人操逼网 97超级碰 少女激情人体艺术片 狠狠插电影 贱货被内射 nnn680 情电影52521 视频 15p欧美 插 欧美色图激情名星 动一动电影百度影音 内射中出红濑 东京热360云盘 影音先锋德国性虐影院 偷穿表姐内衣小说 bt 成人 视频做爱亚洲色图 手机免费黄色小说网址总址 sehueiluanluen 桃花欧美亚洲 屄屄乱伦 尻你xxx 日本成人一本道黄色无码 人体艺术ud 成人色视频xp 齐川爱不亚图片 亚裔h 快播 色一色成人网 欧美 奸幼a片 不用播放器de黄色电影网站 免费幼插在线快播电影 淫荡美妇的真实状况 能天天操逼吗 模特赵依依人体艺术 妈妈自慰短片视频 好奇纸尿裤好吗 杨一 战地2142武器解锁 qq农场蓝玫瑰 成人电影快播主播 早乙女露依作品496部 北条麻妃和孩子乱 欧美三女同虐待 夫妻成长日记一类动画 71kkkkcom 操逼怎样插的最深 皇小说你懂的 色妹妹月擦妹妹 高清欧美激情美女图 撸啊撸乱伦老师的奶子 给我视频舔逼 sese五月 女人被老外搞爽了 极品按摩师 自慰自撸 龙坛书网成人 尹弘 国模雪铃人体 妈妈操逼色色色视频 大胆人体下阴艺术图片 乱妇12p 看人妖片的网站 meinv漏出bitu 老婆婚外的高潮 父女淫液花心子宫 高清掰开洞穴图片 四房色播网页图片 WWW_395AV_COM 进进出出的少女阴道 老姐视频合集 吕哥交换全 韩国女主播想射的视频 丝袜gao跟 极品美女穴穴图吧看高清超嫩鲍鱼大胆美女人体艺网 扣逼18 日本内射少妇15p 天海冀艺术 绝色成人av图 银色天使进口图片 欧美色图夜夜爱 美女一件全部不留与男生亲热视 春色丁香 骚媳妇乱伦小说 少女激情av 乱伦老婆的乳汁 欧美v色图25 电话做爱门 一部胜过你所有日本a片呕血推荐 制服丝袜迅雷下载 ccc36水蜜桃 操日本妞色色网 情侣插逼图 张柏芝和谁的艳照门 和小女孩爱爱激情 浏览器在线观看的a站 国内莫航空公司空姐性爱视频合集影音先锋 能看见奶子的美国电影 色姐综合在线视频 老婆综合网 苍井空做爱现场拍摄 怎么用番号看av片 伦理片艺术片菅野亚梨沙 嫩屄18p 我和老师乳交故事 志村玲子与黑人 韩国rentiyishu 索尼小次郎 李中瑞玩继母高清 极速影院什么缓存失败 偷拍女厕所小嫩屄 欧美大鸡巴人妖 岛咲友美bt 小择玛丽亚第一页 顶级大胆国模 长发妹妹与哥哥做爱做的事情 小次郎成电影人 偷拍自拍迅雷下载套图 狗日人 女人私阴大胆艺术 nianhuawang 那有绳艺电影 欲色阁五月天 搜狗老外鸡巴插屄图 妹妹爱爱网偷拍自拍 WWW249KCOM 百度网盘打电话做爱 妈妈短裙诱惑快播 色色色成人导 玩小屄网站 超碰在线视频97久色色 强奸熟母 熟妇丝袜高清性爱图片 公园偷情操逼 最新中国艳舞写真 石黑京香在线观看 zhang 小说sm网 女同性恋换黄色小说 老妇的肉逼 群交肛交老婆屁眼故事 www123qqxxtop 成人av母子恋 露点av资源 初中女生在家性自慰视频 姐姐色屄 成人丝袜美女美腿服务 骚老师15P下一页 凤舞的奶子 色姐姝插姐姐www52auagcom qyuletv青娱乐在线 dizhi99两男两女 重口味激情电影院 逼网jjjj16com 三枪入肛日本 家庭乱伦小说激情明星乱伦校园 贵族性爱 水中色美国发布站 息子相奸义父 小姨子要深点快别停 变身萝莉被轮奸 爱色色帝国 先锋影音香港三级大全 www8omxcnm 搞亚洲日航 偷拍自拍激情综合台湾妹妹 少女围殴扒衣露B毛 欧美黑人群交系列www35vrcom 沙滩裸模 欧美性爱体位 av电影瑜伽 languifangcheng 肥白淫妇女 欧美美女暴露下身图片 wwqpp6scom Dva毛片 裸体杂技美女系 成人凌虐艳母小说 av男人天堂2014rhleigsckybcn 48qacom最新网 激激情电影天堂wwwmlutleyljtrcn 喷水大黑逼网 谷露英语 少妇被涂满春药插到 色农夫影Sex872com 欧美seut 不用播放器的淫妻乱伦性爱综合网 毛衣女神新作百度云 被黑人抽插小说 欧美国模吧 骚女人网导航 母子淫荡网角3 大裸撸 撸胖姥姥 busx2晓晓 操中国老熟女 欧美色爱爱 插吧插吧网图片素材 少妇五月天综合网 丝袜制服情人 福利视频最干净 亚州空姐偷拍 唐人社制服乱伦电影 xa7pmp4 20l7av伦理片 久久性动漫 女搜查官官网被封了 在线撸夜勤病栋 老人看黄片色美女 wwwavsxx 深深候dvd播放 熟女人妻谷露53kqcom 动漫图区另类图片 香港高中生女友口交magnet 男女摸逼 色zhongse导航 公公操日媳 荡妇撸吧 李宗瑞快播做爱影院 人妻性爱淫乱 性吧论坛春暖花开经典三级区 爱色阁欧美性爱 吉吉音应爱色 操b图操b图 欧美色片大色站社区 大色逼 亚洲无码山本 综合图区亚洲色 欧美骚妇裸体艺术图 国产成人自慰网 性交淫色激情网 熟女俱乐部AV下载 动漫xxoogay 国产av?美媚毛片 亚州NW 丁香成人快播 r级在线观看在线播放 蜜桃欧美色图片 亚洲黄色激情网 骚辣妈贴吧 沈阳推油 操B视频免费 色洛洛在线视频 av网天堂 校园春色影音先锋伦理 htppg234g 裸聊正妹网 五月舅舅 久久热免费自慰视频 视频跳舞撸阴教学 色色色色色色色色色色色色色色色色色色色色色色色色色色邑色色色色色色色色色 萝莉做爱视频 影音先锋看我射 亚州av一首页老汉影院 狠狠狠狠死撸hhh600com 韩国精品淫荡女老师诱奸 先锋激情网站 轮奸教师A片 av天堂2017天堂网在线 破处番号 www613com 236com 遇上嫩女10p 妹妹乐超碰在线视频 在线国产偷拍欧美 社区在线视频乱伦 青青草视频爱去色色 妈咪综合网 情涩网站亚洲图片 在线午夜夫妻片 乱淫色乱瘾乱明星图 阿钦和洪阿姨 插美女综合网3 巨乳丝袜操逼 久草在线久草在线中文字幕 伦理片群交 强奸小说电影网 日本免费gv在线观看 恋夜秀场线路 gogort人体gogortco xxxxse 18福利影院 肉嫁bt bt种子下载成人无码 激情小说成人小说深爱五月天 伦理片181电影网 欧美姑妈乱伦的电影 动漫成人影视 家庭游戏magnet 漂亮少女人社团 快播色色图片 欧美春官图图片大全 搜索免费手机黄色视频网站 宝生奈奈照片 性爱试 色中色手机在线视频区 强轩视频免费观看 大奶骚妻自慰 中村知惠无码 www91p91com国产 在小穴猛射 搜索www286kcom 七龙珠hhh 天天影视se 白洁张敏小说 中文字幕在线视频avwww2pidcom 亚洲女厕所偷拍 色色色色m色图 迷乱的学姐 在线看av男同免费视频 曰一日 美国成人十次导航2uuuuucom wwwff632cim 黄片西瓜影音 av在线五毒 青海色图 亚洲Av高清无码 790成人撸片 迅雷色色强暴小说 在线av免费中文字幕 少年阿宾肛交 日韩色就是色 不法侵乳苍井空 97成人自慰视频 最新出av片在线观看 夜夜干夜夜日在线影院www116dpcomm520xxbinfo wwwdioguitar23net 人与兽伦理电影 ap女优在线播放 激情五月天四房插放 wwwwaaaa23com 亚洲涩图雅蠛蝶 欧美老头爆操幼女 b成人电影 粉嫩妹妹 欧美口交性交 www1122secon 超碰在线视频撸乐子 俺去射成人网 少女十八三级片 千草在线A片 磊磊人体艺术图片 图片专区亚洲欧美另娄 家教小故事动态图 成人电影亚洲最新地 佐佐木明希邪恶 西西另类人体44rtcom 真人性爱姿势动图 成人文学公共汽车 推女郎青青草 操小B啪啪小说 2048社区 顶级夫妻爽图 夜一夜撸一撸 婷婷五月天妞 东方AV成人电影在线 av天堂wwwqimimvcom 国服第一大屌萝莉QQ空间 老头小女孩肏屄视频 久草在线澳门 自拍阴shui 642ppp 大阴色 我爱av52avaⅴcom一节 少妇抠逼在线视频 奇米性爱免费观看视频 k8电影网伦理动漫 SM乐园 强奸母女模特动漫 服帖拼音 www艳情五月天 国产无码自拍偷拍 幼女bt种子 啪啪播放网址 自拍大香蕉视频网 日韩插插插 色嫂嫂色护士影院 天天操夜夜操在线视频 偷拍自拍第一页46 色色色性 快播空姐 中文字幕av视频在线观看 大胆美女人体范冰冰 av无码5Q 色吧网另类 超碰肉丝国产 中国三级操逼 搞搞贝贝 我和老婆操阴道 XXX47C0m 奇米影视777撸 裸体艺术爱人体ctrl十d 私色房综合网成人网 我和大姐姐乱伦 插入妹妹写穴图片 色yiwuyuetian xxx人与狗性爱 与朋友母亲偷情 欧美大鸟性交色图 444自拍偷拍 我爱三十六成人网 宁波免费快播a片影院 日屄好 高清炮大美女在较外 大学生私拍b 黄色录像操我啦 和媛媛乱轮 狠撸撸白白色激情 jiji撸 快播a片日本a黄色 黄色片在哪能看到 艳照14p 操女妻 猛女动态炮图 欧洲性爱撸 寝越瑛太 李宗瑞mov275g 美女搞鸡激情 苍井空裸体无码写真 求成人动漫2015 外国裸体美女照片 偷情草逼故事 黑丝操逼查看全过程图片 95美女露逼 欧美大屁股熟女俱乐部 老奶奶操b 美国1级床上电影 王老橹小说网 性爱自拍av视频 小说李性女主角名字 木屄 女同性 无码 亚洲色域111 人与兽性交电影网站 动漫图片打包下载 最后被暴菊的三级片 台湾强奸潮 淫荡阿姨影片 泰国人体苍井空人体艺术图片 人体美女激情大图片 性交的骚妇 中学女生三级小说 公交车奸淫少女小说 拉拉草 我肏妈妈穴 国语对白影音先锋手机 萧蔷 WWW_2233K_COM 波多野结衣 亚洲色图 张凌燕 最新flash下载 友情以上恋人未满 446sscom 电影脚交群交 美女骚妇人体艺术照片集 胖熊性爱在线观看 成人图片16p tiangtangav2014 tangcuan人体艺术图片tamgcuan WWW3PXJCOM 大尺度裸体操逼图片 西门庆淫网视频 美国幼交先锋影音 快播伦理偷拍片 日日夜夜操屄wang上帝撸 我干了嫂子电影快播 大连高尔基路人妖 骑姐姐成人免费网站 美女淫穴插入 中国人肉胶囊制造过程 鸡巴干老女老头 美女大胆人穴摄影 色婷婷干尿 五月色谣 奸乡村处女媳妇小说 欧美成人套图五月天 欧羙性爱视频 强奸同学母小说 色se52se 456fff换了什么网站 极品美鲍人体艺术网 车震自拍p 逼逼图片美女 乱伦大鸡吧操逼故事 来操逼图片 美女楼梯脱丝袜 丁香成人大型 色妹妹要爱 嫩逼骚女15p 日本冲气人体艺术 wwwqin369com ah442百度影院 妹妹艺术图片欣赏 日本丨级片 岳母的bi e6fa26530000bad2 肏游戏 苍井空wangpan 艳嫂的淫穴 我抽插汤加丽的屄很爽 妈妈大花屄 美女做热爱性交口交 立川明日香代表作 在线亚洲波色 WWWSESEOCOM 苍井空女同作品 电影换妻游戏 女人用什么样的姿势才能和狗性交 我把妈妈操的高潮不断 大鸡巴在我体内变硬 男人天堂综合影院 偷拍自拍哥哥射成人色拍网站 家庭乱伦第1页 露女吧 美女fs2you ssss亚洲视频 美少妇性交人体艺术 骚浪美人妻 老虎直播applaohuzhibocn 操黑丝袜少妇的故事 如月群真口交 se钬唃e钬唃 欧美性爱亚洲无码制服师生 宅男影院男根 粉嫩小逼的美女图片 姝姝骚穴AV bp成人电影 Av天堂老鸭窝在线 青青草破处初夜视频网站 俺去插色小姐 伦理四级成人电影 穿丝袜性交ed2k 欧美邪淫动态 欧美sm的电影网站 v7saocom we综合网 日本不雅网站 久久热制服诱惑 插老女人了骚穴 绿帽女教师 wwwcmmovcn 赶集网 透B后入式 爱情电影网步兵 日本熟女黄色 哥也色人格得得爱色奶奶撸一撸 妞干网图片另类 色女网站duppid1 撸撸鸟AV亚洲色图 干小嫩b10Pwwwneihan8com 后女QQ上买内裤 搞搞天堂 另类少妇AV 熟妇黑鬼p 最美美女逼穴 亚洲大奶老女人 表姐爱做爱 美b俱乐部 搞搞电影成人网 最长吊干的日妞哇哇叫 亚洲系列国产系列 汤芳人体艺体 高中生在运动会被肉棒轮奸插小穴 肉棒 无码乱伦肛交灌肠颜射放尿影音先锋 有声小说极品家丁 华胥引 有声小说 春色fenman 美少女学园樱井莉亚 小泽玛利亚素颜 日本成人 97开心五月 1080东京热 手机看黄片的网址 家人看黄片 地方看黄片 黄色小说手机 色色在线 淫色影院 爱就色成人 搞师娘高清 空姐电影网 色兔子电影 QVOD影视 飞机专用电影 我爱弟弟影院 在线大干高清 美眉骚导航(荐) 姐哥网 搜索岛国爱情动作片 男友摸我胸视频 ftp 久草任你爽 谷露影院日韩 刺激看片 720lu刺激偷拍针对华人 国产91偷拍视频超碰 色碰碰资源网 强奸电影网 香港黄页农夫与乡下妹 AV母系怀孕动漫 松谷英子番号 硕大湿润 TEM-032 magnet 孙迪A4U gaovideo免费视频 石墨生花百度云 全部强奸视频淘宝 兄妹番号 秋山祥子在线播放 性交免费视频高青 秋霞视频理论韩国英美 性视频线免费观看视频 秋霞电影网啪啪 性交啪啪视频 秋霞为什么给封了 青青草国产线观1769 秋霞电影网 你懂得视频 日夲高清黄色视频免费看 日本三级在线观影 日韩无码视频1区 日韩福利影院在线观看 日本无翼岛邪恶调教 在线福利av 日本拍拍爽视频 日韩少妇丝袜美臀福利视频 pppd 481 91在线 韩国女主播 平台大全 色999韩自偷自拍 avtt20018 羞羞导航 岛国成人漫画动漫 莲实克蕾儿佐佐木 水岛津实肉丝袜瑜伽 求先锋av管资源网 2828电影x网余罪 龟头挤进子宫 素人熟女在线无码 快播精典一级玩阴片 伦理战场 午夜影院黑人插美女 黄色片大胸 superⅤpn 下载 李宗瑞AV迅雷种子 magnet 抖音微拍秒拍视频福利 大尺度开裆丝袜自拍 顶级人体福利网图片l 日本sexjav高清无码视频 3qingqingcaoguochan 美亚色无极 欧美剧av在线播放 在线视频精品不一样 138影视伦理片 国内自拍六十七页 飞虎神鹰百度云 湘西赶尸886合集下载 淫污视频av在线播放 天堂AV 4313 41st福利视频 自拍福利的集合 nkfuli 宅男 妇道之战高清 操b欧美试频 青青草青娱乐视频分类 5388x 白丝在线网站 色色ios 100万部任你爽 曾舒蓓 2017岛国免费高清无码 草硫影院 最新成人影院 亚洲视频人妻 丝袜美脚 国内自拍在线视频 乱伦在线电影网站 黄色分钟视频 jjzzz欧美 wwwstreamViPerc0M 西瓜影院福利社 JA∨一本道 好看的高清av网 开发三味 6无码magnet 亚洲av在线污 有原步美在线播放456 全网搜北条麻妃视频 9769香港商会开奖 亚洲色网站高清在线 男人天堂人人视频 兰州裸条 好涨好烫再深点视频 1024东方 千度成人影院 av 下载网址 豆腐屋西施 光棍影院 稻森丽奈BT图书馆 xx4s4scc jizzyou日本视频 91金龙鱼富桥肉丝肥臀 2828视屏 免费主播av网站在线看 npp377视频完整版 111番漫画 色色五月天综合 农夫夜 一发失误动漫无修全集在线观看 女捜査官波多野结衣mp4 九七影院午夜福利 莲实克蕾儿检察官 看黄色小视频网站 好吊色270pao在线视频 他很色他很色在线视频 avttt天堂2004 超高级风俗视频2828 2淫乱影院 东京热,嗯, 虎影院 日本一本道88日本黄色毛片 菲菲影视城免费爱视频 九哥福利网导航 美女自摸大尺度视频自拍 savk12 影音先锋镇江少妇 日皮视频 ed2k 日本av视频欧美性爱视频 下载 人人插人人添人射 xo 在线 欧美tv色无极在线影院 色琪琪综合 blz成人免费视频在线 韩国美女主播金荷娜AV 天天看影院夜夜橾天天橾b在线观看 女人和狗日批的视屏 一本道秒播视频在线看 牛牛宝贝在线热线视频 tongxingshiping 美巨乳在线播放 米咪亚洲社区 japanese自拍 网红呻吟自慰视频 草他妈比视频 淫魔病棟4 张筱雨大尺度写真迅雷链接下载 xfplay欧美性爱 福利h操视频 b雪福利导航 成人资源高清无码 xoxo视频小时的免费的 狠狠嗨 一屌待两穴 2017日日爽天天干日日啪 国产自拍第四季 大屁股女神叫声可射技术太棒了 在线 52秒拍福利视频优衣库 美女自拍福利小视频mp4 香港黄页之米雪在线 五月深爱激情六月 日本三级动漫番号及封面 AV凹凸网站 白石优杞菜正播放bd 国产自拍porno chinesewife作爱 日本老影院 日本5060 小峰磁力链接 小暮花恋迅雷链接 magnet 小清新影院视频 香蕉影院费试 校服白丝污视频 品味影院伦理 一本道αⅴ视频在线播放 成人视频喵喵喵 bibiai 口交视频迅雷 性交髙清视频 邪恶道 acg漫画大全漫画皇室 老鸭窝性爱影院 新加坡美女性淫视频 巨乳女棋士在线观看 早榴影院 紧身裙丝袜系列之老师 老司机福利视频导航九妹 韩国娱乐圈悲惨87 国内手机视频福利窝窝 苍井空拍拍拍视频` 波木春香在线看 厕拍极品视影院 草莓呦呦 国产自拍在线播放 中文字幕 我妻美爆乳 爱资源www3xfzy 首页 Α片资源吧 日本三级色体验区 色五月 mp4 瑟瑟啪 影音先锋avzy 里番动画av 八戒TV网络电影 美国唐人十次啦入口 大香蕉在伊线135 周晓琳8部在线观看 蓝沢润 av在线 冰徐璐 SHENGHAIZISHIPIN sepapa999在线观看视频 本庄优花磁力 操bxx成人视频网 爆乳美女护士视频 小黄瓜福利视频日韩 亚卅成人无码在线 小美在线影院 网红演绎KTV勾引闺蜜的男朋友 熟妇自拍系列12 在线av视频观看 褔利影院 天天吊妞o www銆倆ih8 奥特曼av系列免费 三七影视成人福利播放器 少女漫画邪恶 清纯唯美亚洲另类 、商务酒店眼镜小伙有些害羞全程长发白嫩高颜值女友主动 汤元丝袜诱惑 男人影院在线观看视频播放-搜索页 asmr飞机福利 AV女优磁力 mp4 息子交换物语2在线电影 大屁股视频绿岛影院 高老庄免费AⅤ视频 小妇性爱视频 草天堂在线影城 小黄福利 国产性爱自拍流畅不卡顿 国内在线自拍 厕所偷拍在线观看 操美女菊花视频 国产网红主播福利视频在线观看 被窝福利视频合集600 国产自拍第8页 午夜激情福利, mnm625成人视频 福利fl218 韩主播后入式 导航 在线网站你懂得老司机 在线播放av无码赵丽颖 naixiu553。com gaovideo conpoen国产在线 里番gif之大雄医生 无内衣揉胸吸奶视频 慢画色 国产夫妻手机性爱自拍 wwwjingziwou8 史密斯夫妇H版 亚洲男人天堂直播 一本道泷泽萝拉 影音先锋资源网喋喋 丝袜a∨天堂2014 免费高清黄色福利 maomi8686 色小姐播放 北京骞车女郎福利视频 黄色片随意看高清版 韩国舔屄 前台湿了的 香椎 国产sm模特在线观看 翼裕香 新婚生活 做爱视屏日本 综合另类视频网站 快播乱鬼龙 大乳牛奶女老四影院 先锋影院乱伦 乱伦小说网在线视频 色爷爷看片 色视频色视频色视频在线观看 美女tuoyi视频秀色 毛片黄色午夜啪啪啪 少妇啪啪啪视频 裸体瑜伽 magnet xt urn btih 骑兵磁力 全裸欧美色图 人人日 精油按摩小黄片 人与畜生配交电影 吉吉影院瓜皮影院 惠美梨电话接线员番号 刺激小视频在线播放 日韩女优无码性交视频 国产3p视频ftp 偷偷撸电影院 老头强奸处女 茜公主殿下福利视频 国产ts系列合集在线 东京热在线无码高清视频 导航H在线视频 欧美多毛胖老太性交视频 黑兽在线3232 黄色久视频 好了avahaoleav 和体育老师做爱视频 啪啪啪红番阁 欧美熟妇vdeos免费视频 喝水影院 日欧啪啪啪影院 老司机福利凹凸影院 _欧美日一本道高清无码在线,大香蕉无码av久久,国产DVD在线播放】h ujczz成人播放器 97色伦在线综合视频 虐玩大jb 自拍偷拍论理视频播放 广东揭阳短屌肥男和极品黑丝女友啪啪小龟头被粉穴搞得红红的女女的呻吟非常给 强奸女主播ed2k 黄色色播站 在线电影中文字幕无码中文字幕有码国产自拍 在线电影一本道HEYZO加勒比 在线电影 www人人插 手机在线av之家播放 萝莉小电影种子 ftp 偷拍自拍系列-性感Riku 免费日本成人在线网视频 啪啪自拍国产 日妹妹视频 自拍偷拍 老师 3d口球视频 裸体视频 mp4 美邪恶BBB 萝莉被在线免费观看 好屌看色色视频 免賛a片直播绪 国内自拍美腿丝袜第十页 国模SM在线播放 牛牛在线偷拍视频 乱伦电影合集 正在播放_我们不需要男人也一样快乐520-骚碰人人草在线视频,人人看人人摸人人 在线无码优月真里奈 LAF41迅雷磁力 熟女自拍在线看 伦理片87e 香港a级 色午夜福利在线视频 偷窥自拍亚洲快播 古装三级伦理在线电影 XXOO@69 亚洲老B骚AV视频在线 快牙水世界玩走光视频 阴阳人无码磁力 下载 在线大尺度 8o的性生活图片 黄色小漫 JavBiBiUS snis-573 在线观看 蝌蚪寓网 91轻轻草国产自拍 操逼动漫版视频 亚洲女人与非洲黑人群交视频下载 聊城女人吃男人阴茎视频 成人露露小说 美女大肥阴户露阴图 eoumeiseqingzaixian 无毛美女插逼图片 少女在线伦理电影 哥迅雷 欧美男男性快播 韩国147人体艺术 迅雷快播bt下载成人黄色a片h动漫 台湾xxoo鸡 亚洲人体西西人体艺术百度 亚州最美阴唇 九妹网女性网 韩国嫩胸 看周涛好逼在线 先锋影音母子相奸 校园春色的网站是 草逼集 曰本女人裸体照 白人被黑人插入阴道