-
Notifications
You must be signed in to change notification settings - Fork 0
/
pollination.html
180 lines (164 loc) · 14.2 KB
/
pollination.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
<!DOCTYPE html>
<html lang="zxx" class="no-js">
<head>
<!-- Mobile Specific Meta -->
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
<!-- Favicon-->
<link rel="shortcut icon" href="img/fav.png">
<!-- Author Meta -->
<meta name="author" content="colorlib">
<!-- Meta Description -->
<meta name="description" content="">
<!-- Meta Keyword -->
<meta name="keywords" content="">
<!-- meta character set -->
<meta charset="UTF-8">
<!-- Site Title -->
<title>PeAR WPI</title>
<!-- Site Title -->
<!-- Site Title -->
<link href="https://fonts.googleapis.com/css?family=Poppins:100,200,400,300,500,600,700" rel="stylesheet">
<!--
CSS
============================================= -->
<link rel="stylesheet" href="css/linearicons.css">
<link rel="stylesheet" href="css/font-awesome.min.css">
<link rel="stylesheet" href="css/bootstrap.css">
<link rel="stylesheet" href="css/magnific-popup.css">
<link rel="stylesheet" href="css/nice-select.css">
<link rel="stylesheet" href="css/animate.min.css">
<link rel="stylesheet" href="css/owl.carousel.css">
<link rel="stylesheet" href="css/jquery-ui.css">
<link rel="stylesheet" href="css/main.css">
<link href="css/icofont/icofont.min.css" rel="stylesheet">
<link href="css/remixicon/remixicon.css" rel="stylesheet">
<link href="css/owl.carousel/assets/owl.carousel.min.css" rel="stylesheet">
<link href="css/boxicons/css/boxicons.min.css" rel="stylesheet">
<link rel="stylesheet" href="https://cdn.rawgit.com/jpswalsh/academicons/master/css/academicons.min.css">
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css">
<!-- Global site tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-171009851-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-171009851-1');
</script>
</head>
<body>
<!-- EDIT ME -->
<header id="header">
<div class="container main-menu">
<div class="row align-items-center justify-content-between d-flex">
<!-- style="margin-left: -36vh; margin-right: -36vh" -->
<div id="logo">
<a href="https://www.wpi.edu/" style="font-size: 24px; font-weight: 600; color: #ddd"><img src="img/logos/WPILogo2.png" width="48px" alt="" title=""> </a><a href="index.html" style="font-size: 24px; font-weight: 600; color: #ddd"><img src="img/logos/LogoWhiteRed.png" width="48px" alt="" title=""> Perception and Autonomous Robotics Group</a>
</div>
<nav id="nav-menu-container">
<ul class="nav-menu">
<li><a title="Home" href="index.html" style="position: relative; top: -4px"><i style="font-size: 28px" class="fa fa-home"></i></a></li>
<li class="menu-has-children"><a title="Research" href="research.html">Research</a>
<ul>
<li><a href="research.html">Research Areas</a></li>
<!-- <li><a href="softwares.html">Softwares/Datasets</a></li> -->
<li><a href="publications.html">Publications/Softwares/Datasets</a></li>
<li><a href="labs.html">Research Labs And Facilities</a></li>
</ul>
</li>
<li><a title="Teaching" href="teaching.html">Teaching</a></li>
<li><a title="Media" href="media.html">Media</a></li>
<li><a title="Openings" href="openings.html">Openings</a></li>
<li><a title="Events" href="events.html">Events</a></li>
</ul>
</nav><!-- #nav-menu-container -->
</div>
</div>
</header> </header> </header> <!-- EDIT ME -->
<!-- Start Sample Area -->
<section class="sample-text-area">
<div class="container">
<h3 class="text-heading">Quadrotor Plant Pollination</h3>
<p class="sample-text">
Bee populations have been steadily declining and we have lost about 40% of the bees in the last decade. To aid these conservation efforts, we are working on supplementing bees with artificial bees for pollination and to monitor crops.
</p>
</div>
</section>
<!-- End Sample Area -->
<!-- Start Align Area -->
<div class="whole-wrap">
<div class="container">
<div class="section-top-border" style="text-align: justify">
<h3 class="mb-30">Pollination Using Bee-Quadrotors</h3>
The human fascination to mimic ultra-efficient flying beings like birds and bees hasled to a rapid rise in aerial robots in the recent decade. These aerial robots now posses a market share of over 10 Billion US Dollars. The future for aerial robots or Unmanned Aerial Vehicles (UAVs) which are commonly called drones is very bright because of their utility in a myriad of applications. I envision drones delivering packages to our homes, finding survivors in collapsed buildings, pollinating flowers, inspecting bridges, performing surveillance of cities, in sports and even as pets. In particular, quadrotors have become the go to platform for aerial robotics due to simplicity in their mechanical design, their vertical takeoff and landing capabilities and agility characteristics. Our eternal pursuit to improve drone safety and improve power efficiency has givenrise to the research and development of smaller yet smarter drones. Furthermore, smaller drones are more agile and task-distributable as swarms. Embodied Artificial Intelligence (AI) has been a big fuel to push this area further. Classically, the approach to designing such nano-drones possesses a strict distinction between perception, planning and control and relies on a 3D map of the scene that are used to plan paths that are executed by a control algorithm. On the contrary, nature’s never-ending quest to improve the efficiency of flyingagents through genetic evolution led to birds developing amazing eyes and brains tailored for agile flight in complex environments as a software and hardware co-design solution. In contrast, smaller flying agents such as insects that are at the other end of the size and computation spectrum adapted an ingenious approach – to utilize movement to gather more information. Early pioneers of robotics remarked at this observation and coined the concept of “Active Perception” which proposed that one can move in an exploratory way to gather more information to compensate for lack of computation and sensing. Such a controlled movement imposes additional constraints on the data being perceived to make the perception problem simpler. Inspired by this concept, in this thesis, I present a novel approach for algorithmicdesign on nano aerial robots (flying robots the size of a hummingbird) based on active perception by tightly coupling and combining perception, planning and control into sensorimotor loops using only on-board sensing and computation. This is done by re-imagining each aerial robot as a series of hierarchical sensorimotor loops where the higher ones require the inner ones such that resources and computation can be efficiently re-used. Activeness is presented and utilized in four different forms to enable large-scale autonomy at tight Size, Weight, Area and Power (SWAP) constraints not heard of before. The four forms of activeness are: 1. By moving the agent itself, 2. By employing an active sensor, 3. By moving a part of the agent’s body, 4. By hallucinating active movements. Next, to make this work practically applicable I show how hardware and software co-design can be performed to optimize the form of active perception to be used. Finally, I present the world’s first prototype of a RoboBeeHive that shows how to integrate multiple competences centered around active vision in all it’s glory. <br><br>
Following is a list of contributions of this thesis:
<ul class="unordered-list">
<li> The world’s first functional prototype of a RoboBeeHive that can artificially pollinate flowers.</li>
<li> The first method that allows a quadrotor to fly through gaps of unknown shape,location and size using a single monocular camera with only on-board sensing and computation.</li>
<li> The first method to dodge dynamic obstacles of unknown shape, size and location on a quadrotor using a monocular event camera. Our series of shallow neural networks are trained in simulation and transfers to the real world without any finetuning or re-training.</li>
<li> The first method to detect unmarked drones by detecting propellers. Our neural network is trained in simulation and transfers to the real world without any finetuning or re-training.</li>
<li> A method to adaptively change the baseline of a stereo camera system for quadrotor navigation.</li>
<li> The first method to introduce the usage of saliency to select features in a directvisual odometry pipeline.</li>
<li> A comprehensive benchmark of software and hardware for embodied AI whichwould serve as a blueprint for researchers and practitioners alike.</li><br><br>
</ul>
<h3> References</h3><br>
<div class="rowunmod">
<div class="col-lg-6 col-md-6 mt-sm-20 left-align-p" style="padding-left:0; padding-right:0">
<h4><a href="https://drum.lib.umd.edu/handle/1903/27925">Active Vision Based Embodied-AI Design For Nano-UAV Autonomy</a></h4><br>
<div class="highlight-sec">
<h6>Doctoral dissertation</h6>
</div>
<p>
<b>Nitin J. Sanket</b>, <i>Doctoral dissertation</i>, 2021.<br><br>
<span style="font-weight: 600; color:#c30000"><i class="fa fa-trophy"></i>Awarded the Larry S. Davis Award for Best Computer Science PhD Thesis at University of Maryland, 2021.</span> <span style="font-weight: 600"><a href="https://www.cs.umd.edu/article/2021/10/two-former-graduate-students-receive-larry-s-davis-doctoral-dissertation-award"> <i class="fa fa-newspaper-o"></i> News Article</a> </span><br><br>
<span style="font-weight: 600; color:#c30000"><i class="fa fa-trophy"></i>Awarded the MDPI Drones 2021 PhD Thesis Award for a highly anticipated academic thesis that shows great potential, 2021.</span> <span style="font-weight: 600"><a href="https://www.mdpi.com/journal/drones/awards"> <i class="fa fa-newspaper-o"></i> News Article</a> </span>
</p>
<h6>
<a href="https://drum.lib.umd.edu/handle/1903/27925"><i class="fa fa-file-text-o"></i> Paper </a> <a href="http://umd.edu"><i class="fa fa-map-marker"></i> UMD </a> <br><br>
<!-- <a href="research/thesis.html"><i class="fa fa-quote-right"></i> Cite </a> -->
<h4>Featured in</h4> <br>
<a href="https://www.youtube.com/watch?v=ed3jg-xQfPw"><img src="img/logos/BBC_Earth_Lab.png" width="64px" alt="" class="img-fluid"></a><a href="https://www.voanews.com/a/episode_worlds-smallest-drones-could-revolutionize-agriculture-search-and-rescue-efforts-4765706/6117930.html"><img src="img/logos/VOA.png" width="100px" alt="" class="img-fluid"></a><a href="https://www.youtube.com/watch?v=haZG_Xs5LOM&feature=youtu.be"><img src="img/logos/EnterpriseUMD.png" width="100px" alt="" class="img-fluid"></a> <a href="https://today.umd.edu/computer-scientist-creates-hive-ideas-drones-83562028-be87-45c7-84ed-1f508ee00f20"><img src="img/logos/MarylandToday.png" width="200px" alt="" class="img-fluid"></a><a href="https://dronedj.com/2021/08/04/drones-pollination-bees/"><img src="img/logos/DroneDJ.png" width="140px" alt="" class="img-fluid"></a>
</h6>
</div>
<div class="col-lg-6 col-md-6 mt-sm-20 right-align-p">
<img src="img/research/thesis.png" alt="" class="img-fluid" style="border-radius: 16px;">
</div>
</div>
<hr>
</div>
</div>
</div>
<!-- EDIT FOOT -->
<!-- start footer Area -->
<section class="facts-area section-gap" id="facts-area" style="background-color: rgba(255, 255, 255, 1.0); padding: 40px">
<div class="container">
<div class="title text-center">
<p> <a href="index.html"><img src="img/logos/LogoBlackRed.png" width="128px" alt="" title=""></a><br><br>
Perception and Autonomous Robotics Group <br>
Worcester Polytechnic Institute <br>
Copyright © 2023<br>
<span style="font-size: 10px">Website based on <a href="https://colorlib.com" target="_blank">Colorlib</a></span>
</p>
</div>
</div>
</section>
<!-- End footer Area --> <!-- End footer Area --> <!-- EDIT FOOT -->
<script src="js/vendor/jquery-2.2.4.min.js"></script>
<script src="js/popper.min.js"></script>
<script src="js/vendor/bootstrap.min.js"></script>
<script src="https://maps.googleapis.com/maps/api/js?key=AIzaSyBhOdIF3Y9382fqJYt5I_sswSrEw5eihAA"></script>
<script src="js/easing.min.js"></script>
<script src="js/hoverIntent.js"></script>
<script src="js/superfish.min.js"></script>
<script src="js/jquery.ajaxchimp.min.js"></script>
<script src="js/jquery.magnific-popup.min.js"></script>
<script src="js/jquery.tabs.min.js"></script>
<script src="js/jquery.nice-select.min.js"></script>
<script src="js/isotope.pkgd.min.js"></script>
<script src="js/waypoints.min.js"></script>
<script src="js/jquery.counterup.min.js"></script>
<script src="js/simple-skillbar.js"></script>
<script src="js/owl.carousel.min.js"></script>
<script src="js/mail-script.js"></script>
<script src="js/main.js"></script>
</body>
</html>