Samo Penic
2022-03-26 c1488c2eb92b70999b8b93b641aaf8db9287201a
Documenting firmware
5 files deleted
2 files renamed
6 files added
267 ■■■■■ changed files
documentation/depth_camera/.project_progress.tex.swp patch | view | raw | blame | history
documentation/depth_camera/Whitepaper_Multiple_Camera_Configuration_v1.2.pdf patch | view | raw | blame | history
documentation/depth_camera/project_progress.aux 10 ●●●●● patch | view | raw | blame | history
documentation/depth_camera/project_progress.log 141 ●●●●● patch | view | raw | blame | history
documentation/depth_camera/project_progress.pdf patch | view | raw | blame | history
documentation/depth_camera/project_progress.tex 33 ●●●●● patch | view | raw | blame | history
documentation/esp32/esp32_datasheet_en.pdf patch | view | raw | blame | history
documentation/figures/REARmechanical.png patch | view | raw | blame | history
documentation/figures/case_drawing.png patch | view | raw | blame | history
documentation/figures/connector.png patch | view | raw | blame | history
documentation/figures/esppinout.png patch | view | raw | blame | history
documentation/figures/pinout.png patch | view | raw | blame | history
documentation/project_progress.tex 83 ●●●●● patch | view | raw | blame | history
documentation/depth_camera/.project_progress.tex.swp
Binary files differ
documentation/depth_camera/Whitepaper_Multiple_Camera_Configuration_v1.2.pdf
Binary files differ
documentation/depth_camera/project_progress.aux
File was deleted
documentation/depth_camera/project_progress.log
File was deleted
documentation/depth_camera/project_progress.pdf
Binary files differ
documentation/depth_camera/project_progress.tex
File was deleted
documentation/esp32/esp32_datasheet_en.pdf
Binary files differ
documentation/figures/REARmechanical.png

documentation/figures/case_drawing.png

documentation/figures/connector.png
documentation/figures/esppinout.png
documentation/figures/pinout.png
documentation/project_progress.tex
New file
@@ -0,0 +1,83 @@
\documentclass[12pt]{article}
\usepackage{graphicx}
\begin{document}
\section{Camera}
\subsection{Model and make}
Intel Realsense D455
\subsection{Mechanical specifications}
At the rear of the camera there are two M4 holes for mounting additional modules to the camera. The mechanical drawing is not that clear about the hole size, since there is also a mention of M3 at the same drawing. The part of the mechanical drawing regarding the back of the camera is presented in figure \ref{fig:rearmechanical}.
\begin{figure}[bth]
    \begin{center}
\includegraphics[angle=-90, origin=c, width=0.6\linewidth]{figures/REARmechanical.png}
    \end{center}
    \caption{Rear of the Intel RealSense Depth Camera D455. All units in millimeters. Taken from \cite{productFamilyDatasheet}.}\label{fig:rearmechanical}
\end{figure}
The case was drawn with open source 3d cad software FreeCAD version 0.19. The size of the case is approx 2 mm larger as camera back side in both dimensions and is 12 mm thick, allowing enough space for mounting the ESP32 board and nRF24l01 module. The holes for synchronization cables from camera and output sinchronization are of diameter 3 mm. They are positioned in such a way, that they do not pose any mechanical problems for assembly. Improvement would be to put connectors to the case. Which ones?
\begin{figure}
    \begin{center}
        \includegraphics[width=0.6\linewidth]{figures/case_drawing.png}
    \end{center}
    \caption{Drawing of the case done in FreeCAD 0.19.}
\end{figure}
\subsection{Extension connector pinout}
For multicamera synchronization, the external senzor connector is placed at the top side wall of the camera. The 9 pin JST connector with manufacturer part number SM09B-SRSS TB(LF)(SN) with 1 mm pitch is used and is show in figure \ref{fig:connector}.
\begin{figure}[htb]
    \begin{center}
        \includegraphics[width=0.4\linewidth]{figures/connector.png}
    \end{center}
    \caption{Connector for sync signal. Taken from \cite{productFamilyDatasheet}. }\label{fig:connector}
\end{figure}
The connector has pinout shown in the data table. According to the \cite{productFamilyDatasheet}, pins 5 and 9 shoud be used for synchronization. From the pinout, pin number 8 could be used to power up electronics. However, no data about electrical characteristics of power supply is given (max current?).
\begin{figure}[htb]
    \begin{center}
        \includegraphics[width=0.7\linewidth]{figures/pinout.png}
    \end{center}
    \caption{Connector pinout. Taken from \cite{productFamilyDatasheet}.}\label{fig:pinout}
\end{figure}
For multi-camera case, one camera could be initialized as master and the rest configured as slave. Alternatively an external signal generator can also be used as the master trigger with all cameras set to slave mode. When applying an external sync pulse, the HW SYNC input requires a 100 microsecond positive pulse at the nominal camera frame rate, 33.33 ms for a 30Hz frame rate for example. Inputs are high impedance, 1.8V CMOS voltage levels.
However, it is important to make sure to use a high resolution signal generator. The frequency of the signal generator needs to exactly match the sensor frame rate. For example, if the sensor is set up as 30 fps, the real frame rate may be 30.015 fps. You may need to use an oscilloscope to measure the real frame and configure the signal generator to the same frequency.
For this reason, it may be better to just use one additional camera as master sync signal generator. \cite{whitesheet}
\section{ESP32 controller}
\begin{figure}[htb]
    \begin{center}
        \includegraphics[width=\linewidth]{figures/esppinout.png}
    \end{center}
    \caption{ESP32 pinout.}\label{fig:esppinout}
\end{figure}
\section{Firmware}
\subsection{Energy conservation}
WiFi.mode(WIFI\_OFF);
btStop();
\subsection{Input trigger and interrupt}
https://lastminuteengineers.com/handling-esp32-gpio-interrupts-tutorial/
\end{document}