Author name cluster

David J. Cappelleri

Possible papers associated with this exact author name in Arrow. This page groups case-insensitive exact name matches and is not a full identity disambiguation profile.

19 papers

1 author row

ICRA Conference 2024 Conference Paper

Magnetic Mobile Micro-Gripping MicroRobots (MMµGRs) with Two Independent Magnetic Actuation Modes

Aaron C. Davis
Emmett Z. Freeman
David J. Cappelleri

In this paper, we introduce magnetic mobile micro-gripping microrobots with two independent actuation modes. By aligning two magnets with slight variations in magnetic moment orientations, we create a net magnetic moment for precise position and orientation control through external fields, while harnessing opposing torques on the magnets to induce internal stresses needed for gripping. Our microrobot design features a compliant spring-like structure for significant deflection, enabling a gripping motion under specific magnetic field conditions. Magnet rotation allows precise control over gripper actions, returning to a default state (normally open or closed) when the magnetic field diminishes. This work advances magnetic field-controlled microrobotics, bridging the millimeter-to-micrometer gap. It holds promise for applications in microsurgery, micro-assembly, and microscale exploration.

IROS Conference 2023 Conference Paper

Deep Learning-Based Leaf Detection for Robotic Physical Sampling with P-AgBot

Aarya Deb
Kitae Kim 0002
David J. Cappelleri

Automating leaf detection and physical leaf sample collection using Internet of Things (IoT) technologies is a crucial task in precision agriculture. In this paper, we present a deep learning-based approach for detecting and segmenting crop leaves for robotic physical sampling. We discuss a method for generating a physical dataset of agricultural crops. Our proposed pipeline incorporates using an RGB-D camera for dataset collection, fusing the depth frame along with RGB images to train Mask R-CNN and YOLOv5 models. We also propose our novel leaf pose estimating algorithm for physical sampling and maximizing leaf sample area while using a robotic arm integrated to the P-AgBot platform. The proposed approach has been experimentally validated on corn and sorghum, in both indoor and outdoor environments. Our method has achieved a best-case detection rate of 90. 6%, a 9% smaller error compared to our previous method, and approximately 80% smaller error compared to other state-of-the-art methods in estimating the leaf position.

IROS Conference 2023 Conference Paper

Design and Control of Microscale Dual Locomotion Mode Multi-Functional Robots (μDMMFs)

Aaron C. Davis
David J. Cappelleri

This paper presents the design and control of a novel microrobot that utilizes two distinct magnetic locomotion methods, a combination of rotating and gradient field control, for precise micro-object manipulation using multiple end-effectors. Rotating magnetic fields induce a tumbling locomotion mode to increase the movement speed and decrease issues associated with stiction and locomotion over rough surfaces. The gradient field control allows for precise manipulation using the end-effectors, which include a pointed tip for splitting groups of objects and a blunt end for pushing or capturing objects. The microrobot is fabricated using a two-photon polymerization 3D printer, allowing for the precise reproduction of complex geometries and designs. The potential applications of this technology in the medical field are discussed, highlighting the potential for in vitro cellular manipulation.

ICRA Conference 2022 Conference Paper

Modular End-Effector System for Autonomous Robotic Maintenance & Repair

Juncheng Li 0010
Clark B. Teeple
Robert J. Wood
David J. Cappelleri

This paper describes the development of a modular end-effector system (MEES) for autonomous robotic maintenance and repair tasks. The design consists of the following major components: Robot Side Mating Socket Module (RSMS), End-Effector Side Mating Socket Module (EEMS), the Modular Camera System (MCS), and Tool Holder/Changer unit. Multiple prototypes for each component have been manufactured, tested, and evaluated resulting in the final concept. Existing robotic tool-changer systems on the market were evaluated and features were built into the Modular End-Effector System to overcome the current limitations of those systems. A notable advantage to the MEES is that it is a robot agnostic system and simply uses an ISO standard bolt mounting pattern to physically attached to the robot of choice along with an ethernet connection. No external cables are required that could restrain the workspace of the robot manipulator. Additionally, it is compatible with customized wrist-mounted sensors and end-effectors without any modification of the actual robot circuitry. The MEES is demonstrated working with three different end-effectors and two different robots.

IROS Conference 2021 Conference Paper

Modeling of Bilayer Hydrogel Springs for Microrobots with Adaptive Locomotion

Liyuan Tan
David J. Cappelleri

Adaptive locomotion of microrobots can be achieved by using a smart polymer such as a hydrogel. For hydrogel-based bilayer helical microrobots, the change of environment such as temperature and pH can result in shape deformation into helical shapes differing from their initial state and hence swimming performance. In this work, we proposed a model for studying the parameters that affect the shape deformation of a hydrogel-based bilayer helical microrobot. Moreover, the dynamics of some examples of responsive helical swimming are compared before and after stimulation.

ICRA Conference 2020 Conference Paper

Pose-Estimate-Based Target Tracking for Human-Guided Remote Sensor Mounting with a UAV

Daniel R. McArthur
Ze An
David J. Cappelleri

In this paper, we present a method for pose-estimate-based target tracking (PBTT) that enables the performance of autonomous aerial manipulation operations in unstructured environments using fully on-board computation for both UAV localization and target tracking. The PBTT method does not depend on extracting traditional visual features (e. g. using SIFT, SURF, ORB, etc.) on or near the target. Instead, the algorithm combines input from an RGB-D camera and the UAV's position estimator (which utilizes a downward-facing optical flow camera for horizontal localization) to track a target point selected by a human operator. The effectiveness of the PBTT method is evaluated through several autonomous flight tests performed with the Interacting-Boomcopter (I-BC) UAV platform in unstructured environments and in the presence of light wind disturbances.

ICRA Conference 2018 Conference Paper

Autonomous Control of the Interacting-BoomCopter UAV for Remote Sensor Mounting

Daniel R. McArthur
Arindam B. Chowdhury
David J. Cappelleri

This paper presents a novel approach for autonomously mounting a sensor package on a vertical surface with an unmanned aerial vehicle (UAV). The Interacting-BoomCopter (I-BC) UAV uses an on-board webcam and computer along with a horizontally-mounted reversible propeller on its front boom to autonomously perform the aerial manipulation task. An overview of the vehicle design is presented along with the image processing algorithms used for target tracking, and the implementation of an extended finite state machine (EFSM) for carrying out the high-level autonomous control. The effectiveness of the autonomous control strategy and I-BC platform are examined through the performance of several autonomous sensor mounting flight tests.

ICRA Conference 2017 Conference Paper

Design of the I-BoomCopter UAV for environmental interaction

Daniel R. McArthur
Arindam B. Chowdhury
David J. Cappelleri

This paper presents the design of the Interacting-BoomCopter (I-BoomCopter) unmanned aerial vehicle (UAV), designed specifically for environmental interactions. The novel design consists of a horizontally mounted four-blade reversible propeller on a front boom that is attached to a standard tri-rotor UAV configuration. A custom end-effector and force sensor is placed at the end of the front boom for autonomous pushing and pulling interaction tasks. The modeling of the new platform is presented and two prototype versions built, flight tested, and characterized. Finally, the efficacy of the new platform for environmental interactions is evaluated with an autonomous door opening task and a teleoperated door opening and door closing task.

IROS Conference 2014 Conference Paper

Incorporating in-situ force sensing capabilities in a magnetic microrobot

Wuming Jing
David J. Cappelleri

This paper presents the preliminary design of a micro force sensing mobile microrobot. The design consists of a planar, vision-based micro force sensor end-effector, while the microrobot body is made from a nickel magnetic layer driven by an exterior magnetic field. With a known stiffness, the manipulation forces can be determined from observing the deformation of the end-effector through a CCD camera attached to an optical microscope. After analyzing and calibrating the stiffness of a micromachined prototype, manipulation tests are conducted to verify this microrobot prototype is indeed capable of in situ force sensing while performing a manipulation task. This concept can be scaled down further for next generation designs targeting real biomedical applications on microscale.

ICRA Conference 2013 Conference Paper

A tumbling magnetic microrobot with flexible operating modes

Wuming Jing
Nicholas Pagano
David J. Cappelleri

This paper presents a magnetic tumbling microrobot design at the micro-scale with flexible operating modes. The microrobot has a dumb-bell shape whose largest dimension is 400 µm. When subjected to an exterior predefined magnetic field, the magnetic microagent performs a tumbling motion driven by the interacting magnetic forces and momentums. By switching the magnetic field during the motion cycle the agent is also able to perform a sliding locomotion that is useful for micromanipulation. The magnetic field providing the drive force is generated by a portable coil system consisting of five electromagnetic coils. Under the available driven field, the prototype has shown adaptable mobility through tumbling mechanism on various types of surface in both dry and fluid environments, and also shown pushing manipulation in viscous fluid. This manipulation force has been experimentally evaluated through testing with AFM tip and a micro force sensor and shown to be on the order of several µNs.

IROS Conference 2013 Conference Paper

Complete dynamic modeling, control and optimization for an over-actuated MAV

Yangbo Long
David J. Cappelleri

This paper presents an original configuration of a micro aerial vehicle (MAV), the Omnicopter. Two central counter-rotating coaxial propellers provide a major part of lift force, and three perimeter-mounted tiltable ducted fans are used to supplement the lift force, provide lateral forces and adjust its attitude. Different from traditional underactuated MAVs, the presence of the tilt-rotor mechanism, composed of three ducted fans and three servo motors, on the Omnicopter makes it over-actuated. The characteristic of over-actuation enables the Omnicopter's position dynamics to be decoupled from its attitude dynamics. Based on a complete description of its dynamic model derived using the Newton-Euler motion equations, we propose attitude and position controllers and control allocation for the Omnicopter MAV. Simulation and experimental results are shown to demonstrate its performance.

ICRA Conference 2013 Conference Paper

Linear control design, allocation, and implementation for the Omnicopter MAV

Yangbo Long
David J. Cappelleri

Traditional vertical take-off and landing micro aerial vehicles (VTOL MAVs) are generally underactuated, i. e. , equipped with fewer actuators than degrees-of-freedom (DOF). As a consequence, they possess a limited mobility because of the inherent underactuation (e. g. , they can neither translate laterally with a zero attitude nor hover at a spot with a nonzero attitude). In this paper, we present the design of a novel MAV, the Omnicopter, with two central counter-rotating coaxial propellers for thrust and yaw control and three perimeter-mounted variable angle ducted fans to control roll and pitch and provide lateral forces. It can work under two configurations, a fixed 90° ducted fan angle configuration and a variable angle ducted fan configuration. The variable angle configuration provides full actuation to the Omnicopter position/attitude. After a brief introduction of the Omnicopter platform, we discuss the control design, allocation and implementation for the two configurations separately. Simulations and experimental results verify the performance of the Omnicopter.

ICRA Conference 2013 Conference Paper

Towards flexible, automated microassembly with caging micromanipulation

David J. Cappelleri
Zhenbo Fu

In this paper, we present a novel approach to micromanipulation and assembly tasks using caging micro-manipulation motion primitives for 2D and 3D autonomous micromanipulation and assembly tasks. A flexible, multi-scale test-bed, developed for use in conjunction with these primitives, is described first. The approach and motion primitives are then discussed. An autonomous micromanipulation and assembly task is described and manipulation plans using the methodology are generated and experimentally executed. The autonomous task shows promising results with a success rate of 93% for 27 individual micro-assembly experiments.

ICRA Conference 2011 Conference Paper

A magnetic thin film microrobot with two operating modes

Wuming Jing
Xi Chen
Sean Lyttle
Zhenbo Fu
Yong Shi
David J. Cappelleri

Magnetic principles have proved successful for untethered submillimeter microrobotics, although challenges still exist in areas of propulsion and control. This paper presents the design, analysis, and performance results for a bimorph thin film magnetic microrobot utilizing the magnetostrictive principle as a secondary oscillating operation mode. The microrobot is no larger than 580 μm in its planar dimension and its total thickness is less than 5 μm. As a robot with magnetic material, it can be operated in a pushing/pulling mode in orthogonal directions for movement in a plane, while it's powered with an external magnetic field as low as 1 mT. For the secondary oscillating operation mode utilizing the magnetostrictive principle, in-plane strain is induced, resulting in bending and blocking forces on the robot. These forces are theoretically calculated to prove enough drive force can be generated in this mode. The design is further abstracted and translated into a piezoelectric cantilever FEM model to confirm the theorectical results. Microrobot fabrication and test-bed development based on this analysis is shown, which enabled us to participate in the final competition in the 2010 NIST Mobile Microrobot Challenge, with good performance in the dash and freestyle events. Finally, we discuss the testing results in various dry and fluid environments along with recommendations for future investigation and improvements. Keywords: microrobot, magnetostrictive, bimorph.

IROS Conference 2011 Conference Paper

Caging grasps for micromanipulation & microassembly

David J. Cappelleri
Michael Fatovic
Zhenbo Fu

In this paper, we demonstrate a systematic way to determine configurations for up to four coordinated micromanipulators to form caging grasps for transporting micro-scale planar, polygonal parts. We exploit the geometry of the part, noting the presence and location of convex corners and non-convex corners, and form opposing force equivalents with the micromanipulator probe tips around the micro-scale parts that define a caging polygon. We perform an error bound analysis for caging grasps derived in this manner and provide theoretical values of this bound for four micro-parts of interest. We demonstrate experimental results of the caging micromanipulation transport primitive using these feature-defined grasps and compare them with the expected error bounds. Finally, we combine this caging transport primitive along with rotational and one-sided-pushing motion primitives, to carry out a representative microassembly task.

ICRA Conference 2011 Conference Paper

Caging micromanipulation for automated microassembly

David J. Cappelleri
Michael Fatovic
Utsav Shah

This paper introduces the concept of caging micromanipulation for use in automated open loop microassembly tasks. Utilizing a caging transport motion primitive along with rotational and translation primitives, we demonstrate full control of the state of the part. Additionally, a framework for planar microassembly task planning is provided based on the A* algorithm. It is used to determine the optimal assembly sequences and part starting locations in the workspace. We also describe a test-bed suitable for planar micro, meso-scale, and nano-scale manipulation and assembly tasks and present simulation and experimental results of this work.

ICRA Conference 2009 Conference Paper

Two-dimensional, vision-based muN force sensor for microrobotics

David J. Cappelleri
Gianluca Piazza
Vijay Kumar 0001

We present a two-dimensional, vision-based force sensor, capable of sensing muN level forces. There are currently no reliable, off-the-shelf, commercially-available force sensors to measure forces at this scale, that can be easily integrated into standard microrobotic test-beds. Our design consists of a planar, elastic mechanism with known force-deflection characteristics. A CCD camera is used to track the deformation of the mechanism as it is used to manipulate objects in a micro/meso-scale robotic manipulation test-bed. By observing the displacements of select points in the mechanism, the manipulation forces can be estimated. The modeling, design, microfabrication, calibration and experimental validation of the force sensor are presented with a brief discussion of an application to a robotic manipulation tasks such as microassembly.

ICRA Conference 2008 Conference Paper

Meso-scale manipulation: System, modeling, planning and control

David J. Cappelleri
Peng Cheng 0009
Jonathan Fink
Bogdan Gavrea
Vijay Kumar 0001

Manipulation and assembly tasks are typically characterized by many nominally rigid bodies coming into frictional contacts, possibly involving impacts. Manipulation tasks are difficult to model because uncertainties associated with friction and assembly tasks are particularly hard to analyze because of the interplay between process tolerance and geometric uncertainties due to manufacturing errors. Manipulation at the meso (hundred microns to millimeters) and micro (several microns to tens of microns) scale is even harder for several reasons. It is difficult to measure forces at the micro-netwon level reliably using off-the-shelf force sensors and good force-feedback control schemes have not proved successful. It is hard to manufacture general-purpose end effectors at this scale and it is even more difficult to grasp and manipulate parts at the micro and meso level than it is at the macro level. Finally, the lack of good models of the mechanics of contact interactions at this scale means that model-based approaches to planning and control are difficult.

ICRA Conference 2006 Conference Paper

Designing Open-loop Plans for Planar Micro-manipulation

David J. Cappelleri
Jonathan Fink
Barry Munkundakrisnam
Vijay Kumar 0001
Jeffrey C. Trinkle

This paper describes a test-bed for planar micro manipulation tasks and a framework for planning based on quasi-static models of mechanical systems with frictional contacts. We show how planar peg-in-the-hole assembly tasks can be designed using randomized motion planning techniques with Mason's models for quasi-static manipulation. Finally, we present simulation and experimental results in support of our methodology