Remote control of PC and Smartphones with DIY HID devices (incl. Rubber Ducky / Bad USB)

Подписаться 474 тыс.

Просмотров 32 тыс.

50% 1

This is a replay of video 343 (during my summer break)
Human interfaces to computers are essential. This video will focus on our hands inputting data. And a Microcontroller replacing hands for automatic data logging. I will show you five very different projects, and maybe you find a project idea for this summer.
My second channel: / hb9blawireless
Links:
Jog Wheel: s.click.aliexpress.com/e/_d7RLvJE or amzn.to/2VJmJEo
Arduino Pro Micro: s.click.aliexpress.com/e/_dXD6aI8 or bit.ly/2ZzEvel or amzn.to/4cDe23h
Similar camera (not tested): s.click.aliexpress.com/e/_Ddp...
"Rubber Ducky": s.click.aliexpress.com/e/_DF8... or amzn.to/3RMDb3H
Code snippets: github.com/SensorsIot/HID-exa...
ESP32 BLE Keyboard Library: github.com/T-vK/ESP32-BLE-Key...
Overthruster: github.com/RedLectroid/OverTh...
"Inspiration" video: • Automating Mouse and K...
Patreon supporter companies:
www.welectron.com/
The links above are usually affiliate links that support the channel (at no additional cost to you).
Supporting Material and Blog Page: www.sensorsiot.org
GitHub: www.github.com/sensorsiot
My Patreon Page: / andreasspiess
Discord: / discord
If you want to support the channel, please use the links below to start your shopping. No additional charges for you, but I get a commission on your purchases to buy new stuff for the channel
My Amazon.com shop: www.amazon.com/shop/andreassp...
For Banggood bit.ly/2jAQEf4
For AliExpress: For AliExpress: bit.ly/3MtXUY8 (just go on from here to your product)
For Amazon US: www.amazon.com/shop/andreassp...
For Amazon.de: amzn.to/2r0ZCYI
For Amazon UK: amzn.to/2mxBaJf
For ebay.com: ebay.to/2DuYXBp
/ spiessa
Please do not try to email me. This communication channel is reserved for my primary job
As an Amazon Associate, I earn from qualifying purchases
Corporate Rise-and-Hit_05.wav by s-cheremisinov -- freesound.org/s/401121/ -- License: Creative Commons 0
#no#midroll#ads

Наука

Опубликовано:

29 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 144

@siberx4 3 дня назад

One thing not mentioned here (and it's a little-known but potentially very useful feature) is that in addition to the standard HID descriptors and profiles for things like keyboards/mice/joysticks, it's also possible to set up a "custom" vendor-specific HID descriptor that doesn't map to one of the usual classes. The device will be detected by your PC automatically and be accessible to applications, but the operating system won't do anything with it by default. This allows you to make "driverless" custom USB peripherals with their own data-exchange requirements. You basically set up the HID descriptor to contain generic read/write data blocks that match your use-case, and you can then interact with these blocks of data from the connected host. You need to write the program on the host side to interact with it (so it's more work than piggybacking on a standard class), but it's orders of magnitude simpler than writing a custom driver from scratch and sidesteps all the painful signing requirements that normally entails. Controlling custom RGB/LED layouts or LCDs, custom sensor inputs (force, temperature, accelerometers, etc) and more are all possible using this approach, and you don't have to worry about other applications interfering with your peripheral or ensuring you're not going to affect other programs because of some fake keyboard inputs you're sending. I believe it's even possible to interact with such custom HID peripherals directly from the Chrome web browser (because it has some APIs for interacting with USB/HID, although other browsers don't support this) although I haven't played around with this myself.

@AndreasSpiess 2 дня назад

Very interesting information. Thank you!

@theagileaardvark 3 дня назад

The jog wheel should have some kind of indexing mechanism in it that snaps into grooves on a wheel or something similar. Open the thing, remove (or break) this, add a good amount of non-conductive grease (for dampening) and you should be done. Thanks for this informative video :)

@AndreasSpiess 2 дня назад

Thank you for the tip!

@leroymay8156 3 дня назад

With this Method i've bult a foot pedal used as PTT e.g. for discord. TIPP: Use funktionkeys F13 to F24, since they typically are not used by any standard input scheme, because this keys don't exist on a standard keyboard. But emulated with an arduino they work like a charm.. Great for Programs running in the background.

@AndreasSpiess 2 дня назад

Good idea! Thanks.

@grigorigahan 3 дня назад

ah its a replay. Still I got one of these videos for once within a year of it being produced. Keep it up - you have no idea just how much all these videos are helping I just deployed my first solar-powered esp32 project using a tp5000 and a lifepo4 battery and your vids were like 95% of what I needed from the hardware side.

@AndreasSpiess 2 дня назад

Yes, it is a replay. And I am surprised how well it performs. It seems to be an "evergreen" topic ;-)

@DT-dc4br 3 дня назад

Also of help might be "Autohotkey" which can act as a layer above the HID and is able to run entire Macros. This can also detect & change which window is in focus, so can be made robust to input interruption. This is a lot easier to write & debug. Plus the microcontroller is simpler as it only has to send one keystroke combination (which can be entirely novel control+alt+whatever you like) for each action and AHK handles the rest.

@AndreasSpiess 2 дня назад

Thank you for the info!

@Electronieks 2 дня назад

I was thinking the same thing Ahk is very powerfull

@michaegi4717 3 дня назад

I had some hoby projects in the past year, that ended up beeing HID devices. Maybe some inspiration for others: 1. some inputs for flight simulation at my PC. Here I used a Teensy. First I only added some Buttons and switches and a rotary encoder (to set the radio in the plane). When my rudder paddle device broke I did build an own that is also run by the very same Teensy-module. 2. A friend needed to combine two HIDs to act as one (with some tricks to avoid interference of both). I chosed a maybe overcomplicated solution with a Rasperry Pi where I plugged in both HID-devices. A Python script was able so separate inputs from both HIDs and ensured proper order... this was send via serial port to an arduino, which worked as a HID for a PC. 3. control RU-vid player on Smartphone or iPad. A musician want to play along YT-Videos... a ESP32 emolates a mouse/keboard HID and enable to chose a specific video with a rotary encoder. This video is then started in YT-app. An extra button trigger to jump at a specific time in the video. Raspberry pi Pico can also be used as USB hid. If you build a Bluetooth HID, don't forget to add a battery information (read voltage with analog pin). Battery status can be send via bluetooth, this is part of HID-protocol.

@AndreasSpiess 2 дня назад

Cool ideas! Thank you.

@curtstacy779 3 дня назад

Andreas, for the encoder I just use a standard encoder like we use in industrial applications you can get them cheap. then I buy a solid aluminum knob usually a large diameter with a 6mm hole for the encoder. I also use these on my radio builds for frequency tuning. it works great and the weight of the large aluminum knob works very smoothly.

@AndreasSpiess 2 дня назад

What would be the keywords to find it on AliExpress? (Links are not alowed on youTube)

@curtstacy779 День назад

@@AndreasSpiess 600P version of either is more than enough count per rev. you could probably go lower but you can fix it in code. The first encoders I used are this one $9.36 US: 100/200/360/400/500/600P/R Photoelectric Incremental Rotary Encoder 5V-24V I found a cheaper one but didn't try yet $6.26 US New incremental photoelectric rotary encoder 400P/R 600P/R 360P/R pulse / line AB two-phase 5-24V NPN PNP output 2m cable The knob I prefer the larger one here $12.50 US: 1pcs high quality aluminum knob solid potentiometer knob 44*22*6m But smaller knobs work also 2pcs for $2.53 US: 2PCS Aluminum Solid-core Knob Cap Size 32*13mm 13X32MM The Inn Have fun with this, it makes your project seem much more impressive with the feel you get. it's like using a store-bought radio. and thanks for all the videos.

@curtstacy779 День назад

@@AndreasSpiess By the way, let me know if you need more info maybe I can send the links a different way. the schematic was a standard easy-to-find version. it will bring your input to 0VDC and there is a better schematic that has just a little filtering in it I haven't tried to use that one yet but it could be even smoother.

@jameswest848 3 дня назад

I find the ducky device often called a digispark. I made some devices to tap the ctrl key every 5 minutes for some friends to use on their work devices and keep them awake.

@thetinkerist 3 дня назад

lol and thereby bypassing the security policy the company has set for these work computers.

@ulwur 3 дня назад

I made a similar one that toggled caps lock on and off randomly

@ulwur 3 дня назад

Drove co workers crazy when they typed reports and such

@joeofloath 3 дня назад

I built some digispark duckies, if you want to keep a computer awake you just need to draw a one pixel square with the mouse every few minutes, unless you're doing graphics or something you'll never even notice.

@AttilaAsztalos 3 дня назад

The "Digisparks" are not 32U4-based though, and they don't actually have USB either - they barely limp by as a low-speed USB1.1 device, bitbang-emulating one with a rather shoddy timing.

@joeofloath 3 дня назад

A standard through hole or panel mount rotary encoder with a big heavy knob attached should run pretty free. I put one on a panel for some equipment at work, it has a little finger detent and you can give it a quick spin to make big changes or dial it in exactly, it's so much better than buttons.

@altamiradorable 3 дня назад

use a stepper motor....cheaper!

@joeofloath 3 дня назад

@@altamiradorable how do you use a stepper motor as an encoder? Is it really cheaper than a £1 PCB mount encoder?

@Pici3k 2 дня назад

Cool video! I wanted to make a macro keyboard for myself, maybe that's a sign to finally do that. PS: For a smartphone photobooth - it works with headphones' buttons (wired or wireless) as their buttons also take a picture. I used to have a lot of old broken earphones with working buttons, before moving.

@emilalmberg1096 3 дня назад

Interesting, this solution might help me build physical knobs for my Analog Discovery 2, a software oscilloscope. Hope your summer will also be nice, greetings from Sweden.

@AndreasSpiess 2 дня назад

I hope so too! Just returned from "around your corner" (Norway) ;-)

@Rob_65 2 дня назад

AH, this is a cool video. Why did I not notice this before? I have been playing with USB keyboard interfaces a lot and I also have been working on a similar jog wheel for Davinci Resolve. I used an AS5600 magnetic angle sensor, a large bearing and some 3D printing to create my own jog wheel. That works great, the only problem I had was most microcontrollers only implemented a slow speed USB which uses a 8 ms polling rate, resulting in max. 62 keys/s. I used a Teensy 4 to get full speed USB with a 1 ms polling rate, theoretically getting up to 500 keys/s. This completely removed any key lagging in my case. I cound the AS5600 a great solution for this since this now allows me to adjust the number of steps (keys) per rotation, resulting in a perfect 1, 2 or 5 second (25, 50, 250 or 30, 60, 300 pulses) step per rotation. I not have to check if the ESP32 is up to a similar task so I can replace the umbilical (USB) with a battery to get more freedom on my desk😀

@AndreasSpiess 2 дня назад

Thanks for sharing your project! I hope you will be successful with the ESP32. It is a bit cheaper than the Teensy...

День назад

I have used an Arduino Micro as a game controller in order to use a sled as a car driving device (I also made a video showing that). The possibilities with this device are so huge!

@DaveHojo 2 дня назад

I saw a build where they used a VCR motor as a jog wheel!

@steven51612 15 часов назад

7:09 Evan Kale 😢 I miss this guy. He got me into tinkering with electronics. Wish he’s all good

@MichaelWoodrum 15 часов назад

You could use a hard drive, a spinner, to create a freely moving rotary encoder.

@JanJeronimus 3 дня назад

As always an interesting video with usefull information. I think another option could be using a Streamdeck.

@AndreasSpiess 2 дня назад

I agree (and own one now). But it has no jogwheel

@thetinkerist 3 дня назад

Still a good video, thanks!

@AndreasSpiess 2 дня назад

My pleasure!

@jfseaman1 3 дня назад

Home run. Your "accent" is and always has been part of you. That is a good thing.

@AndreasSpiess 2 дня назад

Thank you!

@largerification 2 дня назад

May Dishka rest in piece in cat heaven!

@ronm6585 3 дня назад

Thank you.

@AndreasSpiess 2 дня назад

You are welcome!

@Tutorius 3 дня назад

I use my ESP32 as a keyboard for my Kodi-Mediaplayer... Works very well, with Bluetooth.

@AndreasSpiess 2 дня назад

Cool. Thanks for sharing your experience!

@mfx1 3 дня назад

There are Chinese encoders available with very smooth movement and a standard 6mm shaft, just add a machined knob that has some decent mass to give some inertia.

@AndreasSpiess 2 дня назад

Thank you for the additional info!

@goodcitizen4587 3 дня назад

Cool! I wish someone would just make these devices.

@AndreasSpiess 2 дня назад

Maybe you find one on one of these project pages?

@goodcitizen4587 2 дня назад

@@AndreasSpiess Good point. Still, it will be nice when they are more mainstream. Thanks for the vids!

@jimlynch9390 3 дня назад

Thank you

@AndreasSpiess 2 дня назад

You are welcome!

@daveh7914 3 дня назад

It should be possible to modify the CNC rotary encoder you show. I have done it with one (for tuning an SDR). I had to remove the 'handle', carefully remove the centre disc (it's stuck on with double-sided tape), remove the knob then remove the spring-loaded ball-bearing which creates the 'steps'. I got this information from another YT channel - can't emember which unfortunately.

@AndreasSpiess 2 дня назад

Thank you for the info!

@alvxi9969 3 дня назад

Hey Andreas! Great video, as always. I've been looking for something like this for some time, but for controlling my music production/live mixing, and usually those programs use the MIDI protocol - maybe it is worth a try on exploring it? Many musicians use very expensive controllers that could be done for basic functions with little less than some buttons and a controller board. Another thing I've been trying to explore, but with no success, is doing a DIY button matrix, where each button could be illuminated with a defined colour (e.g. to dynamically allocate functions to them and know what they do in each program by their colour), it seems that it is a bit difficult to build RGB buttons, maybe you have any tips on that?

@AndreasSpiess 2 дня назад

You should find projects for small keyboards with different additional functions. An may use ready-made "Stream Decks". So far I had no use for midi (other than for a video on my second channel).

@tetraquark2402 3 дня назад

I would of thought the software would have shortcut keys

@kwazar6725 3 дня назад

Super sonntig mit Andreas films

@AndreasSpiess 2 дня назад

Danke!

@ulwur 3 дня назад

I used an attiny85 on a board that fit in the usb port. The program pressed caps-lock at random times. Drove my co workes crazy when they couldnt figure out the problems with their keyboards 😂

@AndreasSpiess 2 дня назад

I assume you won the "best co-worker" award after that prank ;-)

@jmaguilarr 3 дня назад

hi Andreas , nice video, how aobut some proyect of old HF transmitters and recivers for amateur radio aficionados?

@AndreasSpiess 2 дня назад

At the Swiss Radio Amateur Society (USKA), I am responsible for "new technologies". You you should not expect too much content about old radios ;-)

@jmaguilarr 2 дня назад

@@AndreasSpiess i así because you know a lot

@jmaguilarr 2 дня назад

Ask

@alpha_pixel_ 3 дня назад

Use optical encoder for smoothness

@AndreasSpiess 2 дня назад

Good idea!

@carneeki 3 дня назад

I didn't know I wanted this before but now is like a rotary encoder on my phone and computer for moving thru yt videos. I wonder if the same left/right key strokes will work on Android yt as in my desktop browser.

@AndreasSpiess 2 дня назад

Maybe google knows the anwer to your question (I am an IOS user)

@kamilosxd678 3 дня назад

Can you link that scope-camera? It looks awesome

@AndreasSpiess 2 дня назад

Since this is a replay, the camera I used is no more available. It uses a SONY IMX290 autofocus sensor. I now posted a link to a camera with a newer sensor.

@kamilosxd678 2 дня назад

@@AndreasSpiess Thank you!

@galileo_rs 3 дня назад

Would love to see the review of that microscope.

@AndreasSpiess 2 дня назад

I once made a video about microscopes. But mainly optical binoculars. If you watch it, you will see why...

@galileo_rs 2 дня назад

@@AndreasSpiess That was 7 years ago, this looks like it's new and you are using a stand-alone lens. The reason why I ask is that you get pretty good image quality, the one I got from AliExpress is lousy so I'm looking for one that is decent and affordable. The alternative is to convert a DSLR into a microscope.

@leozendo3500 3 дня назад

Also, i want a esp32s3 rubber ducky

@chioz 19 часов назад

interesting 👍

@leozendo3500 3 дня назад

Maybe a projet that manages password with face or fingerprint for easy input on challenngingn apps?

@mathieucaron4957 3 дня назад

That's a big risk if you lose the device 😕

@johanholmberg1561 3 дня назад

How about a AS5600 with some 3d printing instead of a rotary encoder?

@AndreasSpiess 2 дня назад

I never looked into it :-(

@deslomeslager 2 дня назад

As a rotary replacement, what about a stepper motor (from a printer or something else)? But I do not know how to detect the direction for that 😞 PS; for a project I would like to do, do you know if there is an ESP library to connect to an external HID over bluetooth? I have a scanner which can behave like a keyboard either over USB or BT. Of course I also have other solutions which already support usb IN, and I wil use that alternatively. But if there is an ESP library for this, that would be great! Second question: I would like to remote control lights and such. But all the radio or LED controlled devices use 5 mA at standby. This is way too much. I know BT used really so little, I would like to enable lights over BT with a simple BT switch (those ones they sell for taking pictures with your Android). I am asking too much. But I hope I may inspire you to use either one for a project (if you know there is a working solution). PS: yes, I have seen most of your remote devices in many of your previous videos! Do know I watched them all. I was just thinking of switching a new way. Or: do you think a BT receiver would use a lot of power as well? I do know the sender uses almost nothing! I have temperature meters running all day on a cr2032 battery for over a year. BT must be the way to go I think.

@patrickmagon3735 3 дня назад

As5600 magnetic encoder are great... But it's just a chip.. you need to build an enclosure...

@AndreasSpiess 2 дня назад

I agree.

@bluegizmo1983 3 дня назад

What microscope camera setup are you using there? Ive been looking to get one like that, but there are so many different models that look the same but with vastly different specs...

@AndreasSpiess 2 дня назад

Since this is a replay video, my setup is no more available. But I posted a link to a camera that should contain a successor chip.

@arbitrary_username 3 дня назад

I always wanted to use HID for pausing/playing RU-vid on my IPad via home assistant when the door rings or I leave the room.

@AndreasSpiess 2 дня назад

Sounds like a good plan!

@mrigankamaji8405 3 дня назад

please make a video on sct013 100A/50ma and ads1115 for calculate ac current

@AndreasSpiess 2 дня назад

I made some videos about such topics.

@ReneKnuvers74rk 3 дня назад

7:50 you should talk to Tinkering with Atkalar. He services switches and may be able to help you removing the brake function. He is from Wien in Österreich.

@AndreasSpiess 2 дня назад

Thank you for the tip! I just found his channel!

@klintkrossa6885 2 дня назад

How about using vband with a key?

@MoritzvonSchweinitz 3 дня назад

A friend of mine had a horrible accident and was paralyzed from the neck down. I used an ESP32 to built him some buttons and levers he could actuate by moving his head. One function was launching the Google assistant reliably instead of "ok Google", which get frustrating quite quickly.

@AndreasSpiess 2 дня назад

Very useful application. And you are a good friend!

@AjinkyaMahajan 3 дня назад

Dishka cat gets a Esp controlled Selfie Booth 😸😸

@AndreasSpiess 2 дня назад

:-))

@nalinux 2 дня назад

I made a small joystick to use with Candle and my small CNC 3018. Keyboard control is a pain on Candle.

@AndreasSpiess 2 дня назад

Cool!

@accdiabolus 3 дня назад

Hallo Andreas, es gibt auch noch eine Möglichkeit ein Pi Zero (vermutlich auch 2) in ein HID zu verwandeln.

@AndreasSpiess 2 дня назад

Gut zu wissen. Danke!

@grzecho119 3 дня назад

challenge - is it possible to connect a USB keyboard and mouse to Arduino at the same time? Esp32-s3 with USB-OTG currently supports only one connected device at the same time.. Any suggestions?

@AndreasSpiess 2 дня назад

I do not know :-(

@SarahKchannel 3 дня назад

Well, left some comment about my 3D printed job version / project.... Any mention to external links get zapped.... Too bad.

@SarahKchannel 3 дня назад

It kind of sucks that we cant share info on such a topic, makes the whole comment section sort of useless.

@luisfelipesaldivar5100 3 дня назад

What are you talking about?

@AndreasSpiess 2 дня назад

Indeed, RU-vid deletes most comments with links.

@SarahKchannel 2 дня назад

@@AndreasSpiess I sent you some pictures of the 3D printed encoder on X.

@AndreasSpiess 2 дня назад

@@SarahKchannel Thanks. I will check later.

@bluegizmo1983 3 дня назад

Everyone thinks HID stands for Human Input Device, but it actually stands for Hacker Input Device 😂

@AndreasSpiess 2 дня назад

Aha. This is new to me, too ;-)

@ergindemir7366 3 дня назад

What is the model of your microscope? Where did you buy it?

@AndreasSpiess 2 дня назад

I did not find a link, but added one of its successor.

@ergindemir7366 2 дня назад

@@AndreasSpiess Thanks, do you know the sensor of your microscope?

@AndreasSpiess 2 дня назад

@@ergindemir7366 SONY IMX290

@evlo8059 3 дня назад

So did anyone since found outwhat BLE input device commands android stuff understand for next, prev, pause, etc.? (it is asked in the video) - but it reminded me that i never found out how to do it years ago, and the real actually fully working solution to the problem i wanted to solved years ago, still does not exist. (aftermarket car head unit :D )

@AndreasSpiess 2 дня назад

I do not have the answer :-(

@Misophist 3 дня назад

High quality jog wheel: maybe slaughter a disused Logitech mouse for one?

@AndreasSpiess 2 дня назад

Maybe. I never tried...

@Electronieks 2 дня назад

Yes and mod it in a nice box

@nabeel_malik 3 дня назад

Esp32 ble keyboard have lags issue.

@AndreasSpiess 2 дня назад

Thank you for the info. I was not aware.

@pete3897 3 дня назад

A pain in the dah-dah-dah to program? That's a pain in the O. Surely you meant it's a pain in the dit-dah-dit (dit dit dit) - that's a pain in the Rs ;-)

@AndreasSpiess 2 дня назад

:-))

@xDR1TeK 3 дня назад

Esp, a confused chip.

@AndreasSpiess 2 дня назад

Why do you think?

@xDR1TeK 2 дня назад

@@AndreasSpiess oh for many reasons. But it seems everyone disagrees with me. For one, is it an RF transceiver or a microcontroller? Another point, they seem to take so much feedback from the hobbiest community as from the Arduino but when they give you the option to use their ide with the idf they end up with half functional code that doesn't run the same firmware between updates. Dear Andreas, you're a model engineer, what do you think? Please share.

@AndreasSpiess 2 дня назад

@@xDR1TeK I like the possibilities of the ESP32 and did many projects with it. Its price performance is excellent, and its community support, too.

@mcconkeyb 3 дня назад

:-)

@Dalmen 3 дня назад

I wait when the first USB-C rubber ducky with video capture support comes out. A nightmare for security. With a OCR or a nano AI model he can control the whole computer.