
Robotics Researcher
Robotics & Autonomous Systems,
Royal Military Academy
Address
Avenue De La Renaissance 30, 1000 Brussels, Belgium
Contact Information
Call: –
Publications
2025
- V. N. Fernandez-Ayala, J. Silva, M. Guo, and D. V. Dimarogonas, “Robust visual servoing under human supervision for assembly tasks," European Journal of Control, p. 101312, 2025.
[BibTeX] [Abstract] [Download PDF] [DOI]
We propose a framework enabling mobile manipulators to reliably complete pick-and-place tasks for assembling structures from construction blocks. The picking uses an eye-in-hand visual servoing controller for object tracking with Control Barrier Functions (CBFs) to ensure fiducial markers in the blocks remain visible. An additional robot with an eye-to-hand setup ensures precise placement, critical for structural stability. We integrate human-in-the-loop capabilities for flexibility and fault correction and analyze robustness to camera pose errors, proposing adapted barrier functions to handle them. Lastly, experiments validate the framework on 6-DoF mobile arms.
@article{FERNANDEZAYALA2025101312, title = {Robust visual servoing under human supervision for assembly tasks}, journal = {European Journal of Control}, pages = {101312}, year = {2025}, issn = {0947-3580}, doi = {https://doi.org/10.1016/j.ejcon.2025.101312}, url = {https://www.sciencedirect.com/science/article/pii/S0947358025001414}, author = {Victor Nan Fernandez-Ayala and Jorge Silva and Meng Guo and Dimos V. Dimarogonas}, keywords = {Visual servoing, Control Barrier Functions, Human-in-the-loop, Construction assembly, Object tracking}, abstract = {We propose a framework enabling mobile manipulators to reliably complete pick-and-place tasks for assembling structures from construction blocks. The picking uses an eye-in-hand visual servoing controller for object tracking with Control Barrier Functions (CBFs) to ensure fiducial markers in the blocks remain visible. An additional robot with an eye-to-hand setup ensures precise placement, critical for structural stability. We integrate human-in-the-loop capabilities for flexibility and fault correction and analyze robustness to camera pose errors, proposing adapted barrier functions to handle them. Lastly, experiments validate the framework on 6-DoF mobile arms.} }