Robotics Education & Competition Foundation
Online Challenges

Lightning Ninjas

1

NanoBeasts2020
Entry ID #: 9145
Created: Tue, Dec 8, 2020 11:54 AM


How Sensors are used  in Amazon Fresh with Lightning Ninjas and Expert Mark Kojak

 

  1. How does the whole amazon thing work? (intro question)

 

Download an app to give an account for QR code. Scan, watch what you get, charge you with a certain bank account.

 

  1. What different sensors are used?

 

Most are visual, QR scanner, cameras at gate, 3D models of you, heat signature, see what you have by using cameras

 

  1. How many are required?

 

100s, all around to watch.

 

  1. Which sensor is used the most?

 

Visual, infrared, cameras.

 

  1. How do the sensors work together?

 

Infrared sensor, and cameras monitor you at all times which sends the information to cloud

 

  1. How do they detect who takes what?

 

See what the arm goes to and charges you for it. The optical sensors watch you if you put an item in the wrong place because then the store would sell the wrong thing.

 

  1. What sensors contribute to the cloud and what is their practicality? 

 

Infrared sensors see your specific heat signature and know it’s you. Optical sensors look at you from all sides and make a 3D image of you.

 

  1. Are there potential flaws?

 

No not really but is possible to fool but very hard 

 

  1. How does it know that it should take money from the bank?

 

When you walk out it charges you when you walk out because the optical sensors trak you the whole time 

 

  1. How does the face recognition work if there isn’t any, then what is it and how does that work?

 

They make a 3D image of you by using the optical cameras to take pictures of you. Basically the same thing as an iPhone software thing but for the whole body.

 

  1. What do sensors contribute to the store?

 

Optical and infrared sensors contribute the most. They were thinking about using (RFID?) to read everything you walk out of the store with, but it costs more.

 

  1. Does it have any other abilities?

 

They can determine if you have a fever or not, because they can see your temperature.

 

  1. How does it process all this information at the same time?

 

There’s a lot of intense algorithms going on in the back rooms. Their devices have a lot of processing power, which is the key. It isn’t in the cloud, because it would be overloaded, so they just process it in the store. The bare minimum goes up to the cloud.

 

  1. could someone scan in as you if they have your phone? is it possible?

 

 possible, but isn’t very likely. The app is password protected. (just speculation).

Files

There is nothing here.

Links / Videos

Sensors discussion with expert Mr. Mark Kojak How does the whole amazon thing work? (intro question) Download an app to give an account for QR code. Scan, watch what you get, charge you with a certain bank account. What different sensors are used? Most are visual, QR scanner, cameras at gate, 3D models of you, heat signature, see what you have by using cameras How many are required? 100s, all around to watch. Which sensor is used the most? Visual, infrared, cameras. How do the sensors work together? Infrared sensor, and cameras monitor you at all times which sends the information to cloud How do they detect who takes what? See what the arm goes to and charges you for it. The optical sensors watch you if you put an item in the wrong place because then the store would sell the wrong thing. What sensors contribute to the cloud and what is their practicality? Infrared sensors see your specific heat signature and know it’s you. Optical sensors look at you from all sides and make a 3D image of you. Are there potential flaws? No not really but is possible to fool but very hard How does it know that it should take money from the bank? When you walk out it charges you when you walk out because the optical sensors trak you the whole time How does the face recognition work if there isn’t any, then what is it and how does that work? They make a 3D image of you by using the optical cameras to take pictures of you. Basically the same thing as an iPhone software thing but for the whole body. What do sensors contribute to the store? Optical and infrared sensors contribute the most. They were thinking about using (RFID?) to read everything you walk out of the store with, but it costs more. Does it have any other abilities? They can determine if you have a fever or not, because they can see your temperature. How does it process all this information at the same time? There’s a lot of intense algorithms going on in the back rooms. Their devices have a lot of processing power, which is the key. It isn’t in the cloud, because it would be overloaded, so they just process it in the store. The bare minimum goes up to the cloud. could someone scan in as you if they have your phone? is it possible? possible, but isn’t very likely. The app is password protected. (just speculation).