Microcontroller Tips

Microcontroller engineering resources, new microcontroller products and electronics engineering news

John Koon

Who is driving the growth of Virtual Reality?

By Leave a Comment

Caltech

Many leading research groups like the NASA Jet Propulsion Lab at the California Institute of Technology (Caltech), which helped send the Curiosity rover to Mars, and other leading academia are supporting VR development. Many heavyweight tech companies such as Microsoft, NVIDIA, Qualcomm, and IBM are investing in VR.

Caltech is using VR to improve the science of the future. “We are thinking about what doing science will look like 10 to 15 years from now,” said Santiago Lombeyda, a computational scientist at the Center for Data-Driven Discovery (CD3), the group behind the virtual reality research, as well as other data science projects. CD3 is a joint partnership between Caltech and JPL, which is managed by Caltech for NASA. “In the future, a scientist might be working on their desktop, and then they could just grab a pair of virtual reality glasses, or they may even be already wearing regular glasses that enable VR, and then start manipulating their data in the same shared visual context of their actual work area.”

Microsoft

In VR, Microsoft is known for its HoloLens 2. Based on the Qualcomm Snapdragon 850 and a custom-built holographic processing unit, the HoloLens 2 headset checks eye movements with two IR cameras and head movement with four light cameras. For developers, the Windows 10 OS includes a holographic shell, holographic APIs, perception APIs, middleware, and Xbox Live services. This enables a familiar experience across apps and content and ease of development. Besides being used for gaming, the HoloLens 2 helps solve business problems in education, training (Figure 1), remote field support, healthcare, and manufacturing. This trend will continue.

According to a Microsoft spokesperson, “Front-line workers comprise 80 percent of the global workforce. They form the backbone of many of the world’s largest industries, but they’ve been largely underserved by technology. Without them, the ambitions of many organizations could not be brought to life. Mixed reality is poised to help them work together, problem solve and communicate in more immersive ways.  They will also be able to access the information they need when they need it in a spatially relevant, heads-up, and hands-free way. For Information Workers, mixed reality will enable them to collaborate and work remotely both synchronously and asynchronously. This will allow them to change the content, the people, or even the location of a meeting, in a matter of seconds.”

Figure 1: VR has the potential of overlaying video and images on top of the real environment giving specific instructions to workers in a training scenario. (Source: Microsoft).

NVIDIA

NVIDIA, a leader in graphics processing unit (GPU) development, has changed the VR and artificial intelligence (AI)  landscape with its superfast GPU technology. They offer chipsets and modules to accelerate the development of VR.

“The demands of using high-fidelity engineering models and creating photorealistic, beautiful environments are extraordinarily compute-intensive and where NVIDIA Quadro GPUs shine,” said Greg Jones, senior manager for XR and product manager of CloudXR at NVIDIA. “As these collaborative design environments continue to develop, AI will play a larger role in features from speech translation and understanding to generative design, further increasing the compute workload and delivering astounding efficiencies in the design and manufacturing pipelines.”

What does the future hold?

VR has increased the efficiency of knowledge transfer in many different areas. On-site training can be replaced by off-site training with VR, saving travel costs and time. Additionally, VR simulation can provide remarkable savings. What used to cost thousands of dollars, such as immersive simulation rooms, can now be replaced with VR HMDs.

There are other benefits to fueling the growth of VR.

“When looking at the workplace, VR has the potential to change product development significantly. Low network latency and advanced hardware will allow anyone to work closely as a team regardless of location and time zone. VR will allow everyone to see, hold, and explore a product without requiring expensive physical prototyping. Haptic controller input and voice commands will enable changing color and shape as team members push and pull the object to iterate to the best solution rapidly. Ultimately, faster time to market with more compelling designs will be the hallmark of the new design method,” added Peter Hartwell, CTO at InvenSense, a TDK group company.

“In the future, VR will continue to provide benefits for training and simulation. Walmart has tens of thousands of workers training in VR because of its cost-effectiveness. Sales, retail, and marketing is another popular application. Car dealerships can use VR to help customers experience virtual test drives and product customization,” commented Eric Abbruzzese, AR/VR Research Director at Global Tech Market Advisory, ABI Research.

New applications for VR will continue to increase, and it will evolve into AR, MR, and, ultimately XR.

 

How are we tapping into the potential of VR?

By Leave a Comment

Virtual Reality (VR) technology was primarily used by video gamers to play 3-D games. Not anymore. The technology has changed so much over the years that now medical, sports, training, industrial, and many more applications use it. And it has significant business potential.

So what is VR?

Manufacturer STMicroelectronics has spent a great deal of time in researching the subject, defines VR as follows:

  • Virtual Reality (VR) – An immersive experience with a fully occluded view with content that is rendered (i.e., CGI) or captured video and/or images or combinations thereof.
  • Augmented Reality (AR) – A fully transparent headset or glasses through which the viewer will see the real world with superimposed information in the user’s field-of-view. The content is typically overlaid text, images, or graphics.
  • Mixed or Merged Reality (MR) – Here, there are some differences in definition. Still, a commonly accepted one is a device that combines a camera with a VR headset to deliver live video/image feed to the display. The “mixing” or “merging” is the integration of the real-world images from the camera with the rendered or captured video/images.
  • eXtended Reality (XR) – A fully transparent device/headset that delivers realistic, 3D, holographic-like content in the user’s visual field-of-view. Here virtual and physical objects are indistinguishable.

 

Figure 1: The VR hardware platform includes a high-performance MCU processor, memory, audio, and optic electronics integrated into a single chip or chipset. (Source: STMicroelectronics)

A VR hardware platform is a head-mounted display (HMD) or goggles with embedded electronics and VR software that interfaces with video, audio, and sensors to create an environment that a human being can interact with.

As shown in Figure 1, the VR hardware platform includes a high-performance MCU processor, memory, audio, and optic electronics integrated into a single chip or chipset. Because it is battery-powered, the designers must create it to be energy efficient yet high performance. In real-life applications, latency has to be kept to less than four milliseconds. Otherwise, the user will experience motion sickness because the video observed cannot catch up with the real environment as the user’s head turns.

What is the VR market potential?

According to ABI Research, a technology research and advisory firm, 35 million VR head-mounted displays (HMD) will be shipped in 2024, with market revenues reaching $25 billion. The revenue will come mostly from the consumer segment (media/entertainment), with notable enterprise revenues in education. Revenues from other segments are expected to grow in the future.

The SyncThink technology: Using VR for insight into the brain

Figure 2: The EYE-SYNC platform includes a wireless, Bluetooth-enabled, custom-designed VR goggles, a smartphone, and a tablet. (Source: SyncThink)

In the early 2000s, neurosurgeon Jamshid Ghajar MD, Ph.D., had an idea. He wanted to come up with a way to measure people’s attention span through eye movement objectively. Early in his studies, he found eye movement abnormalities to be very common in patients with concussion. A few years later, he presented these findings to the US Department of Defense, was awarded several grants to study the military population, and began developing EYE-SYNC technology (Figure 2).

In 2014, after years of studying military personnel returning from the Middle East with deficits after traumatic brain injury (TBI), Ghajar arrived at Stanford to study student-athletes. There, he met Scott Anderson, at that time the head of the Stanford Sports Medicine program, which oversees the medical care provided to student-athletes. In 2015, Anderson began using a prototype device based on EYE-SYNC technology in clinical trials. The trials examined how eye movements, brain trauma, and cognitive functions relate to one another (Figure 3). Soon after, Anderson integrated the technology into the clinical care of more than 900 athletes across 36 athletic programs. In 2016, EYE-SYNC technology was awarded its first FDA clearance as a Class II medical device.

Figure 3: The EYE-SYNC technology has given us a window to the brain. (Source: SyncThink)

Ghajar later founded SyncThink and commercialized the EYE-SYNC technology as a product in 2017 following 15 years of clinical research. The EYE-SYNC product has evolved into an award-winning digital brain health platform. The platform includes a wireless, Bluetooth-enabled, custom-designed VR goggles, a smartphone, and a tablet. Figure 3. Top academic, research, clinical, and sports organizations across North America use EYE-SYNC.

Our human brain interacts with its environment by predicting incoming visual information to determine how to react. Using the eyes to receive information, the brain tends to synchronize a person’s behavior with the information received constantly. If this synchronization is off by 0.25 seconds, a healthy brain will react a certain way. If the brain has a problem, it will respond differently. The difference between and the normal and abnormal reaction is called “variance” or “errors”. EYE-SYNC measures the variance. Over the years, SyncThink has developed a very comprehensive data set of eye signatures for clinicians to use in diagnosing brain functions.

“EYE-SYNC has given us a window to the brain. When a clinician gives the patient a set of instructions to follow, the patient will move his eyes accordingly. Using multiple built-in cameras, EYE-SYNC can detect the movement of the patient’s eyes. The captured data will then be compared to a set of well-defined eye signatures. With this new ability to compare findings, clinicians now have information that was once unavailable,” commented Anderson, Chief Clinical Officer of SyncThink, “It is indeed remarkable!”

Who is winning the LPWAN race? Part 2

By Leave a Comment

Continues from Part 1 FAQ on Low-Power Wide Area Network (LPWAN) technology & implementation

6.     What are some of the LPWAN design considerations?

There are many criteria a business can consider when trying to decide on the best LPWAN solution.

For example, how quickly do you need the IoT device to transfer the data, how much data do you need to transfer, how large must the data packet be, and how far do you need to transmit the data?  In addition, how energy-efficient must the device be, how much mobility do you require, and how long should the battery last? Lastly, how do you want to provide network security for your data – on your own or through carriers?

In designing a new LPWAN network, security requirement is very important. Security experts have always warned that cyberattacks are on the rise and will only get worse. However, security is fluid. Even though LPWAN has provided detailed security design specifications, achieving security is an ongoing challenge and requires regular fine-tuning.

“I was once told by a cybersecurity expert ‘Security is something you get, not something you buy.’  No matter which network one chooses, i.e. one buys, security will require ongoing attention if it is to be sustained.” Scott Nelson, CEO/CTO, Reuleaux Technology.

In short, LPWAN design considerations can be summarized in the following checklist:

  • Speed requirement
  • Power consumption
  • Application type
  • Availability of hardware and software solutions
  • RF band consideration
  • Security requirement
  • Product life and design support
  • Cost

7.     How to implement an LPWAN network?

We can convolve the above-mentioned criteria down to some binary choices, such as start with a module or chip, customizing hardware or buying off-the-shelf, private cloud or public cell-based cloud.  Both the LoRa Alliance and LTE-M/NB-IoT carriers offer their own certification. The LoRa Alliance has a streamlined, in-house process to certify products for LoRaWAN devices. The LoRa Alliance certification guarantees interoperability among the certified devices.

LTE-M/NB-IoT carriers, on the other hand, guarantee interoperability between LTE-M/NB-IoT devices and the specific carrier. AT&T, Verizon, and T-Mobile, for example, offer their own unique certification programs. Many of the LPWAN modules have already obtained their corresponding certification from either LoRa Alliance or the LTE carriers. In designing a new network, if device performance reliability is important to you, choosing certified devices will give you assurance.

Buying off-the-shelf modules saves time but limits design flexibility.  On the other hand, starting with chips and customizing hardware is more time- and labor-intensive, but offers better alignment between hardware and software for a given application.

The purpose of carrier certification is to ensure interoperability and prevent damage done to the network by the LTE device. Depending on the readiness of the device, the certification process can take as long as one year. However, using one of the 200 AT&T pre-certified LTE modules, the network device can be certified quickly. (See link below). “We have a simple process for certification of IoT devices that ensures they are ready for operation on our networks with maximum efficiency. Certification can be achieved within a day for most devices using a module that is already approved by AT&T. We aim to support our customers in building the best products while protecting our network at the same time,“ according to Cameron Coursey, vice president, Advanced Technical Solutions, AT&T.

8.     What are the budget considerations?

A business needs to consider if it wants to spend money on the a licensed spectrum.  There are service fees for LTE-M/NB-IoT but the spectrum cost is free for LoRaWAN, which uses ISM bands. ISM bands stand for the Industrial, Scientific, and Medical frequency band (2.4GHz) reserved for the equipment use.

There are advantages to both that should be considered in the context of your business model and products. Overall, the budget can be broken down into the following categories:

  • the process of product development (R&D)
  • LPWAN certification cost
  • bills of material (BOM) costs including the LPWAN module or chip
  • Carrier service charge if LTE-M or NB-IoT is deployed

The R&D costs vary greatly depending on the structure of the organizations and the process involved. (See link below). The certification process can be very labor-intensive. If a pre-certified module is used, it will save our great deal of time and the cost of an application can be quite reasonable. But if a company starts from scratch and go through the whole certification process, it may take up to a year with multiple trials before passing. In this case, the total cost of certification including R&D and overhead can potentially exceed 1,000,000 dollars according to the experience of a module manufacturer.

For the BOM consideration, the costs will range from $200 to $1000 for a development kit, $5 to $60 for a module depending on what features are included, and less than five dollars for silicon depends on the purchase volume. The annual carrier service charge for LTE-M or NB-IoT is $12 to $30.

 

Who is winning the LPWAN race? Part 1

By Leave a Comment

A two-part tutorial series on Low-Power Wide Area Network (LPWAN) technology & implementation.

Low-power wide-area networks have continued gaining momentum over the last few years, propelled by IoT growth and sensor ubiquity. In this article, we will answer the basic, frequently asked questions, and offer insights on the implementation strategy.

There are different abbreviations for the technology. The most commonly used are LPWAN or LPWA. Once in a while, you will see LPN used. But they all refer to the same technology. We will use LPWAN throughout the article.

The world map showing LTE-M/NB-IoT deployment. The coverage has been increasing gradually over the past few years. (Image: GSMA)

1.     What is an LPWAN?

An LPWAN is a wireless telecommunication network enabling the long-range transfer of data at very low power. The data rate supported ranges from 0.3 kbits/s to 1 Mbits/s per single channel. It is also relatively low cost.  LPWAN use prevails among the large number of battery-operated IoT sensors installed in remote locations for various types of applications.

2.     How many types of LPWAN are available today?

Many types of LPWAN are available today.  The most prevalent LPWANs include long range wide-area network (LoRaWAN), Long Term Evolution for Machines (LTE-M), and Narrowband-IoT (NB-IoT).  The LTE-based solutions (LTE-M/NB-IoT) are supported by all the major carriers, including AT&T, Verizon, and T-Mobile. Additionally, according to AT&T, the future development of LTE-M and NB-IoT will be included in 5G globally. Other LPWANs, such as Weightless, SigFox, Wi-SUN, and Ingenu tend to focus on different niches.

LoRaWAN uses an unlicensed spectrum and uses do not need to pay a license fee. It is primarily used in a smaller geographic region. Both LTE-M (also known as LTE Cat M1) and NB-IoT (also known as LTE Cat M2) are cellular-based much like our mobile phones, and users pay the carrier for the services.

Comparison of the three common types of LPWAN.  (Image: Tech idea Research)

Note 1: The LTE-M/NB-IoT speed shown here is available today from LTE carrier(s). The theoretical speed of LTE-M is 1 Mbps.

3. What is the difference between LTE-M and NB-IoT?

While both LTE-M and NB-IoT are cellular-based, LTE-M supports a higher data rate (1 Mbps) and has voice support capability, VoLTE. In applications such as asset tracking crossing multiple states which require greater bandwidth and/or voice over LTE, LTE-M will be more applicable.

On the other hand, NB-IoT, using a single narrow band, has a higher density of energy for transmission. Therefore it has better building penetration and reach than LTE-M. It is more suitable for smart meter and sensor deployments where small packets of data are sent infrequently, commonly referred to as machine-to-machine (M2M) applications.

4.     What are some of the applications of LPWAN?

LPWAN are used in many different areas for tracking and monitoring, including the following:

  • agriculture
  • asset tracking
  • energy management
  • healthcare
  • industrial IoT
  • industrial automation
  • livestock farming
  • power grid
  • smart building
  • smart cities
  • smart lighting
  • smart manufacturing
  • smart metering and parking

5.     Who are the market leaders today?

LoRaWAN and LTE-based LTE-M/NB-IoT remain the market leaders for low-power deployed sensors.

The LoRa Alliance, (the alliance organization behind the LoRaWAN technology) has a vast reach in its 400+ members, including IBM, Microchip, Cisco, Semtech, Bouygues Telecom, Singtel, KPN, Swisscom, Fastnet, and Belgacom.  Its ability to operate on multiple region-specific frequencies extends LoRaWAN’s reach.

On the other hand, LTE-M/NB-IoT’s commercial reach comes from leveraging the existing LTE infrastructure, which is supported by LTE’s high data rate applications, i.e., cell phones, thereby enabling low upfront deployment costs.

According to 360 Research Reports, a technology market research firm, the worldwide LPWAN market is expected to grow from less than $1 billion in 2019 to more than $14 billion by 2026 with a compound annual growth rate (CAGR) of 46.5%.  See link below. (Compare with other projections, 360 Research Reports’ forecast seems to be the most reasonable). Additionally, the estimate of the market split is 54% LTE, 36% LoRaWAN, and 10% for the others according to Tech Idea Research.

In the race between LoRaWAN and LTE-M/NB-IoT for market share, the LoRa Alliance aims to foster an ecosystem with increased collaboration that can operate as private or public networks. At the same time, LTE-M/NB-IoT seeks to gain an advantage by riding on the shoulders of LTE.

LPWANs such as Weightless, Sigfox, Wi-SUN, and Ingenu are niche players.  For example, Weightless focus on smart meters. Sigfox is fairly established in Europe but much less so in other regions.  Ingenu is focused on sectors such as utilities and oil and gas exploration, while Wi-SUN is specifically for power grid applications.

Part 2 continues here.

What is the LoRaWAN certification process?

By Leave a Comment

The Internet of Things (IoT) is on the upward trajectory and seeing applications in an increasing number of sectors or industries. In these IoT applications, the IoT devices will be installed in remote or hard-to-reach locations and expected to operate for a long time without repair. Because the IoT devices collect and integrate many different data sets for analytics, interoperability is also crucial. Therefore, there is a significant demand for the energy efficiency, long-range connectivity, and interoperability of the IoT devices.

Similar to the LTE (long-term evolution) technology, LoRaWAN aims to support IoT through low-power devices with extensive connectivity. LoRaWAN (long-range) is a low-power, radio frequency technology for a wireless local-area network (LAN) in the category of low-power wide-area (LPWA) network technology. In addition, LoRaWAN is a network protocol using LoRaWAN.

Because LoRaWAN technology offers high power efficiency and long-range data transmission, it is an effective technology for the Internet of Things (IoT) devices. Also, ensuring that the LoRaWAN devices are interoperable with other components of IoT will be necessary.

Figure 1: LoRaWAN end-device certification process (Image: LoRa Alliance)

 

Why do devices need to be LoRaWAN certified?

The interoperability of all LoRaWAN products and technologies are usually certified by the LoRa Alliance, which is an open, non-profit association that aims to support the adoption of secure, carrier-grade IoT LPWAN connectivity. LoRaWAN is being used by major mobile networks globally and likely to continue to expand.

Supporting and promoting the global adoption of the LoRaWAN standard by ensuring interoperability of all LoRaWAN products and technologies will help enable the IoT to deliver a sustainable future.

How are LoRaWAN devices certified

The certification process of LoRaWAN devices involves multiple steps. First, the company that has developed the LoRaWAN device needs to register, sign a Non-Disclosing Agreement (NDA) and a Certificate Agreement (CA), and provide Certificate of Insurance (COI). Then, the company needs to submit documentation on the device, including its FCC grant, GCF grant, user guide, references, and troubleshooting guides. Also, the company needs to select a certification lab and turn in related documents.  In addition, the company needs to submit paperwork to a mobile carrier.

After sending the LoRaWAN sample device to a test house (or lab) in the U.S., Western Europe, or Asia that has been authorized by the LoRa Alliance, it will take about a week for the company to get the test results. The certification test will cover conformance, interoperability, and RF testing of a product.

Passing results will get the company an Open Development Certification letter to run its device on the network carrier. Then, the company can activate the device and upload the unique device identifiers to the carrier’s database to finalize the certification.

Even when the LoRaWAN product passes in the first try, the company has to handle much paperwork and coordinates with several internal and external organizations, not to mention paying for the test. However, the real pain starts when the LoRaWAN product fails in the test house. The company needs to consult with LoRa Alliance to reach a resolution, not knowing how long the mediation may take.

To avoid the hassle, a company can purchase pre-certified LoRaWAN modules.  This way, the company can skip the paperwork or any additional problem with failing the test, while knowing that the device it purchases is good to go.

How the IIoT makes factories smart

By Leave a Comment

Factories have always set their sights on increased productivity and cost reduction and the Industrial Internet-of-Things (IIoT) has impacted modern factories in a big way. To achieve those goals, modern factories have made automation and preventive maintenance using robotics, artificial intelligence (AI),  and edge computing top priorities. In the next 10 years, factories with IIoT know-how will excel, while any sticking with older methods are likely to be left behind. This article explores the role of sensors in modern factories and surveys IIoT trends affecting sensors.

At this year’s Sensors Expo, TE demonstrated how preventive maintenance was implemented and retrofitted in an HVAC system that formed part of a smart factory system. In the system, liquid flow and leakage are monitored 24/7 automatically and remotely.

smart factories
Figure 1: Using IIoT with flow meters and leak detectors, liquid flow and leakage can be monitored 24/7 automatically and remotely. Source: Tech Idea Research and TE Connectivity 

Figure 2 outlines how sensors that are part of the IIoT help create a smart factory. While traditional factories have used automatic equipment for a long time, smart factories go further, integrating more robotics and AI. For example, smart factories can implement 24/7 remote monitoring of automation equipment (item 1) using smart sensors (item 2). The data collected is transmitted wirelessly via LoRaWAN, Bluetooth, cell signals, or Wi-Fi (item 3) to a remote control center (item 4). Note that the control center can be a handheld device with an app. To maximize production,  factories may run three eight-hour shifts a day except during scheduled maintenance.

Figure 2: Block diagram shows how smart sensors are used to monitor and measure factory automation equipment. Data is sent to the control center wirelessly. (Source: Tech Idea Research)

In a scenario where automation equipment, robotics, and many machine tools are on such a schedule, early warnings to prevent equipment breakdown when equipment exhibits abnormal behavior are crucial. Some of the common parameters to be monitored include:

  • Temperature
  • Vibration and shock
  • Electrical current
  • Motion
  • Position/ proximity
  • Pressure
  • Fluid/flow
  • Force
  • Vision
  • Gases 

What’s next for IIoT sensors?

Future smart factory sensors will have higher precision, integrate multiple sensors in a smaller device, and combine sensing and wireless communication technology. Sensor packaging will be more compact, while the sensors themselves consume less power and lower overall costs. Here are a few examples of what to expect.

Integrating sensor and wireless communication in one package

TE’s wireless vibration transmission sensor, now in development, integrates in a single package a battery-operated LoRaWAN radio and a sensor which measures vibration in machines or automation equipment containing motors or pumps.  There is no need to wire the sensors to a controller. In addition, the low-power, 868/915 MHz, LoRaWAN wireless technology provides an operating life of five years, important for lowering labor and maintenance costs. A trendsetter, indeed.

Figure 3: TE’s wireless vibration transmission sensor, now in development, integrates in a single package a battery-operated LoRaWAN radio and a sensor to measure vibration. (Source TE Connectivity)

Compact data analysis system

The OleaWave intelligent vibration sensor platform from Olea Sensors Network is a system in a box. Weighing one ounce and measuring 84mm x 35mm x 8.7mm (WxHxD), it includes a 24GHz radar sensor,  nine axis motion sensors, and a 32-bit Arm Cortex-based 16-bit data acquisition. Able to measure temperature and vibration, the unit is also to the machine requiring analysis. Data can be extracted via USB 3.0, Bluetooth, or Wi-Fi. A Li-Ion battery allows 40 hours of use per recharge. Supported software includes Windows 10, Linux, Android, and iOS.

Figure 4: The system-in-a-box OleaWave packs a 24 GHz radar sensor,  nine-axis motion sensors, and a 32-bit Arm Cortex-based 16-bit data acquisition in one small unit. (Source: Olea Sensors Networks)

How are sensors advancing medical development?

By Leave a Comment

Recent developments in the field of sensors have helped advance medical technology. Wearables have become smaller and provide more vital sign monitoring functions with higher accuracy. The wearable sports watch is gradually transforming the healthcare industry. Not only does it help people stay healthy by potentially causing them to exercise more, but the technology is also approaching that required for clinical-grade devices, so that wearable ECG machines, for example, are on the horizon. Recently,  Apple, Eli Lilly, and Evidation Health joined forces to develop a consumer-grade device like the iPhone which could be equipped with sensors to collect vital signs. Such a device might be able to predict conditions such as  Alzheimer’s someday. Besides looking forward to the benefits that clinical-grade sensors will deliver, we can also anticipate sensors that will take less power, be smaller, and that will integrate more functions. Here is a glimpse of what’s coming.

Sport watch provides vital sign monitoring

At the recent Sensors Expo 2019, Maxim demonstrated its wearable health sensor platform (HSP) 2.0 as well as new silicon with improved power consumption. The all-in-one, wrist-worn format reference design can measure photoplethysmography (PPG), SpO2, and skin temperature with an embedded heart-rate algorithm, motion, and rotation capability.

This platform not only integrates clinical-grade ECG, heart-rate and body-temperature measurements, but it also meets the clinical-grade requirement of accuracy to within  ±0.1°C. This is similar to the oximeter sensors used during a doctor’s appointment to measure the SpO2  (for blood-oxygen saturation) and PPG (for pulse and blood flow).

medical sensors
Figure 1: Maxim’s wearable reference health sensor platform (HSP) 2.0 enables developers to provide products to measure photoplethysmography (PPG), SpO2, and skin temperature with an embedded heart-rate algorithm, motion, and rotation capability. (Source: Maxim Integrated Products, Inc.)

 

Additionally, Maxim also offers a new temperature sensor IC. Packaged in 2mm x 2mm x 0.75mm, the 10-pin thin LGA, MAX30208, can measure to within ±0.1 °C accuracy from +30 °C to +50 °C and draws 67μA operational compared with135μA from products on the market today.

In-ear devices such as hearing aids can integrate the heart-rate monitor and pulse oximeter functions with the MAXM86161. Compared with solutions on the market today, this new IC is 40% smaller (2.9mm x 4.3mm x 1.4 mm) and draws 10μA operating power (typical at 25sps) and 1.6μA in shutdown mode, about 35% less than current products on the market. This is important because the lower the power, the longer the battery life.

Flexible design

Many of the medical devices worn by patients to measure various types of vital signs need to be flexible. (Figure 2). To provide flexibility, Molex offers a combination of flexible circuitry to integrate various types of sensors and wireless communication capability on the same design. This approach meets both space and functional requirements. For example, as shown in Figure 3, a possible temperature tag can be integrated with near-field communications (NFC) capability. Such integration can make it possible to measure the temperature of, say, a sleeping hospital patient, without waking the person. The nurse only needs to stand close to the tag in order to take the reading wirelessly. The tag can be in the form of a “Band-aid” taped to the forehead. Additionally, the design can be customized to include other types of sensors for different applications.

Figure 2: An illustration showing medical wearable electronics needs to be flexible, lightweight and functional. (Source: Molex and Tech Idea)
Figure 3: Flexible circuits can potentially integrate temperature tag and near-field communications (NFC) capability to allow temperature measurement with wireless readers. (Source: Molex)

Deployment platform

If you are designing remote health monitoring systems using sensors, the OS-3010 Intelligent Multi-Sensor Development Platform from Olea may save you time. It combines multi-sensor input and artificial intelligence for data collection, analysis, and display in a graphical format. The sensors include the Olea HeartSensor™ 24GHz Micro-Doppler Radar Sensor (OS-3010) and Motion Sensors (Tri-Axis Magnetometer [compass], Tri-Axis Accelerometer and Tri-Axis Gyroscope). This is a non-invasive sensor design based on the Cortex-M4 32-bit Arm processor for loading embedded firmware, algorithms and signal processing. Finally, the platform bundles micro-USB and Bluetooth Low-Energy (BLE) 4.2 for communication purposes.

Figure 4: The OS-3010 Intelligent Multi-Sensor Development Platform from Olea Sensor Networks includes a display showing the measurement results from various sensors for R&D purpose. (Source: Olea Sensor Networks)

 

Sensors are used in wearable sports watches, remote healthcare, clinics, and hospitals for vital sign data collection and analysis. Future medical products with sensors will be smarter by using AI. Look for them to also shrink, extend battery life, and be more accurate. As accuracy approaches clinical-grade, devices such as sports watches will be more useful and functional. In this article, we have examined wearable design platforms, flexible circuitries with custom sensor integration, and a multi-sensor input development tool. Expect the evolution of medical sensors to continue and for their new capabilities to make possible a host of new applications.

Autonomous vehicle sees with LiDAR eyes

By Leave a Comment

Automakers are struggling to deliver the first commercially available fully autonomous car (SAE Level 5). There are a lot of vision technologies and sensors available, but fine-tuning them has proved to be challenging. Cars need to “see” objects, moving or stationary, from far away enough to react and make driving decisions. One of the most popular sensors uses Light Detection And Ranging technology, known by the acronyms LiDAR, LIDAR, LiDAR or LADAR.

How does LiDAR work?

LiDAR sends out laser pulses — up to 160,000 per second. It can detect an object within a 1000- to 4000-foot range. LiDAR system accuracy varies, depending on if it is stationary or in a moving car. The frequency of the scanner also affects accuracy. It is not unusual to achieve accuracy to within about 0.6 inch. LiDAR paints the picture of what it “sees” by firing laser pulses and measuring the bounced back signals. By calculating the time delay, the distance of the object is detected. By doing this very fast, the processor can recreate its surroundings and paint a 3D picture.

Designing with an integrated solution

LiDAR
Figure 1: A high-resolution image of the surroundings is generated by the Cheetah, a complete LiDAR system. (Source: Innovusion Inc.)

It’s easiest to integrate a field-tested, off-the-shelf, all-in-one solution. At the recent Sensors Expo, California-based, Innovusion Inc. introduced the first dual rotating polygon optical architecture LiDAR system, “Cheetah” (Figure 1). It can detect objects at 200 meters with 10% reflectivity (Lambertian) with a maximum detection range of 280 meters. The system delivers a screen resolution of 300 vertical pixels at a frame rate of 10Hz, resulting in high-resolution images. This is done using 0.13-degree resolution over its 40-degree vertical field of view (FOV), and 0.14-degree resolution over its 100-degree horizontal FOV. Its best-in-the-industry performance opens the possibility of using the Cheetah system to replace multiple LiDAR units for SAE Level 3 driving. The laser pulse wavelength is 1550nm combined with a large aperture polygon. The sensor head dimension measures 112 x 145 x 105 mm (HxWxD) with the control box at 103 x 242 x 152 mm (HxWxD). The data transmission rate is at 1Gbps Ethernet, and the whole unit draws less than 40W.

Designing your own LiDAR

If you are a LiDAR maker or an OEM preferring to design your own LiDAR, you will need to select individual components for the job. What are the components of a LiDAR system? A basic LiDAR system consists of the semiconductor laser generator and a photodiode sensor to receive the bounced signals (Figure 2). Inside the system is a microcontroller or computer with digital processing capability. Additionally, not shown in the block diagram is the GPS unit to monitor the LiDAR system’s position. With many bounced signals, a 3D picture/image will be constructed to simulate the environment.

Figure 2: The LiDAR block diagram showing the unit with a laser transmitter and a photodiode receiver. (Source: Laser Components)

An example of a laser pulse diode transmitter is shown in Figure 3. Offered by Laser Components, the QuickSwitch Pulsed Laser Diode (PLD) was given the “Best of Sensors”  award at the Sensors Expo & Conference 2019 and an AVT ACE award from Autonomous Vehicle Technology for its design. The unit comes in 850nm, 905nm and 1550nm laser wavelengths for different applications. 1550nm provides the best accuracy. It is capable of firing 200,000 laser pulses a second. Another consideration is the power output. Depending on the frequency, the QuickSwitch can deliver 100W. In general, a higher power diode can do a better job. Modules with built-in laser diodes are also available.

Figure 3: A hybrid pulsed laser diode (PLD), capable of firing 200,000 laser pulses a second, enabling faster and more precise 3D LiDAR scanning. (Source: Laser Components)

To include the signal processing and microcontroller capability, you can look into a silicon chipset (Figure 4). The color blocks represent chips available from Analog Devices. The GPS is the other commonly available component you will need.

Figure 4: Block diagram showing various chips used in designing LiDAR. (Source: Analog Devices, Inc.)

In short, there are various design approaches a designer can take, including using an integrated system or discrete components. The former provides shorter-time to-market while the latter more flexibility. The LiDAR innovation for automotive is progressing quickly. It is expected to have better LiDAR products coming to the market in the next few years and, hopefully, this will make fully autonomous driving a reality sooner.

The role of sensors in IoT networks, Part 2: Smart sensors and how to choose

By Leave a Comment

Part 2 of this series continues with answering common questions about how sensors work in IoT system development.

What are smart sensors?

Basic sensors can detect changes in their environments and convert measured data into a digital format for the external microcontroller to process. The “smart” is in the microcontroller. Combining the microcontrollers in a single package makes it possible for the sensors to become “smart.” Modern technology enables this combination to be accomplished within small packaging.

For example, Bosch Sensortec’s BHA250 can integrate a 32-bit microcontroller with a 14-bit acceleration sensor in a 2.2 x 2.2 x 0.95 mm3 package. Another sensor manufacturer, TE, for instance, has integrated sensors with connectors to pack functionality into a small space.

FIgure 1. Bosch Sensortec’s BHA250 can integrate a 32-bit microcontroller with a 14-bit acceleration sensor in a small 2.2 x 2.2 x 0.95 mm3 package. (Image: Bosch Sensortec)

 

Smart sensors
Figure 2: MEMS sensors can be used in IoT applications for parking space detection, asset tracking, step counting, and sleep monitoring. (Image: Bosch)

Q. How difficult is it to do system design with sensors?

A. Sensors and silicon manufacturers assist developers with ready-to-go developer’s kits to make design work easier. Developers can use the kits to do proof of concept before doing the final design. Here is an example.

STMicroelectronics recently introduced a flexible unit called the SensorTile.box.  A functions board, including a low-power Arm Cortex-M4 microcontroller with DSP and floating‐point unit (FPU) and multiple sensors, is packed in a small box (57 x 38 x 20 mm3 ) (Figures 3 and 4). Bluetooth functions are built-in. For developers desiring quick results, the kit does not require programming. But it also has an Expert Mode for developers to do custom programming. Furthermore, the STMicro STM32 Open Development Environment (STM32 ODE) supports more complex programming with AI and neural network libraries. More and more smart and integrated solutions are becoming available from various vendors. It pays to explore.

  • Digital temperature sensor
  • 6-axis inertial measurement unit
  • 3-axis accelerometers
  • 3-axis magnetometer
  • Altimeter/pressure sensor
  • Microphone/audio sensor
  • Humidity sensor
Figure 3: A functions board, including a low-power Arm Cortex-M4 microcontroller with DSP and floating‐point unit (FPU) and multiple sensors, is packed in a small box (57 x 38 x 20 mm3 ). (Image: STMicroelectronics)

 

Figure 4:  The SensorTile.box  block diagram shows the various functions that can be measured. (Image: STMicroelectronics)

Q. What are the considerations in choosing a sensor solution?

A. A few criteria should be considered when selecting a sensor solution:

  • Accuracy in terms of precision and resolution. Determine in advance what resolution you need. In the case of temperature, will accuracy within 1 degree be accurate enough? For distance, you may need accuracy as low as units of 0.01 inch. The higher the resolution, the higher the cost.
  • Measurement range. What is the upper and lower limit you need? If you don’t need a wide range, it will reduce your design cost.
  • Environmental conditions. Does it have to perform in high temperature/humidity conditions or be waterproof?
  • Reliability considerations. There are two aspects. One is how long the sensors will function without breaking down. The mean-time-between-failure (MTBF) specification refers to the length of time that sensors can function without experiencing failure or breakdown. This will be important for sensors operating in remote and rugged areas. The other aspect is whether the sensor’s performance is accurate without calibration. It is possible to have sensors that have not broken down but require calibration to perform accurately.
  • Rugged environment. Some sensors must withstand extreme heat, cold, shock, and vibration. Make sure the sensor you select will meet the requirements.
  • Size and weight requirements. Depending on the applications, some sensors must fit in very small spaces, or many sensors need to be installed for one application.
  • Tradeoffs—highly integrated solution vs. using individual components. An integrated solution may cost a bit more, but can ave design and installation time. For example, a vibration sensor with a built-in LoRaWAN or RF communication function will take up less space and installation time.
  • If the applications are critical and require redundancy, consider sensors with a dual-package.
  • Overall system cost. Finally, take a look at the overall design, install, and support costs and not only the sensor’s individual unit cost.

What are the roles of sensors in an IoT network? Part 1

By Leave a Comment

The Internet of Things (IoT) and edge computing have created many smart industries such as smart city, smart factories, smart agriculture, smart medicine, and more. How do they become smart? The key lies in real-time data capture and analytics, using various types of sensors.

TechJury, a software firm that reviews forecasts from various companies, predicts that IoT connections will reach 64 billion by 2025, while Grand View Research, a marketing firm, projects the IoT market will reach $949.42 billion the same year. The accelerating growth of the sensor industry is expected to mirror that of the IoT. Sensors are innovating very fast. It is expected that in the next 25 years, they will be smaller, smarter, cheaper, and ubiquitous.

How do sensors work, and what is involved in IoT system development using sensors? This series will begin answering some common questions raised by many.

Q. How do sensors work? 

A. IoT cloud servers and edge (gateway) devices depend on sensors to collect real-time data. Since the world we live in deals with analog signals such as temperature in Fahrenheit, distance in feet, speed in miles per hour, pressure in pounds per square inch, etc., sensors have to detect changes in their environments and then convert the physical parameters’ signals to digital data.

Figure 1 illustrates the configuration of an IoT network with sensors. Sensors are usually referred to as the endpoint in the IoT network because they are at the outermost edge from the cloud servers’ perspective.  Note the cloud servers on the right side of Figure 1. Even though these sensors are small and do not seem as important as the cloud servers, they can play a critical role in system design. A recent notable example comes from the Boeing  737 Max plane crashes. Among other factors, sensor failure played a part in the two tragedies.

Sensors need to connect and communicate with the gateways and cloud servers to operate in the IoT network. Nowadays, wireless technologies such as Bluetooth, NFC, RF, Wi-Fi,  LoRaWAN, NB-IoT (cell) are commonly used. Depending on how the network is set up, more and more gateway products are used to perform edge computing (data analytics) before sending data to the cloud servers.

sensors in an IoT network
Figure 1: The sensor network block diagram shows the relationship between the sensor device and the IoT network.

Q. How many different types of sensors are available today?

A. There are hundreds of different types of sensors available today to measure almost anything, and they come in various forms and shapes. Some are a single component such as a light-sensing diode; others can be a module with built-in microcontrollers.

These sensors are available to measure light, sound, temperature, pressure, position, change of altitude and distance, types of gases, movement, liquid and on and on. There are also many types of technologies used for detection including radar, LiDAR, light detection, magnet detection, infrared (IR), using inductive technology, image sensing, ultrasonic, sonar, photon emission, touch sensing, encoder and many more. Here is a sample list of the types of sensors available.

  1. Atmospheric pressure sensor
  2. Distance/ Proximity sensor
  3. Humidity sensor
  4. IR sensor
  5. Level sensor
  6. Light sensor
  7. Motion detection sensor
  8. Pressure sensor
  9. Smoke and gas sensor
  10. Temperature and thermocouple sensor
  11. Touch sensor
  12. Ultrasonic sensor
Figure 2: Hundred different types of sensors are available in various forms ranging from single components to smart modules. (Source: https://www.electricaltechnology.org/)

Additionally, sensors can also be classified into active vs. passive and analog vs. digital.

Active sensors typically require external stimulation to work. It can be an external power source or induced energy. For example,  a linear variable differential transformer (LVDT) can be used to convert linear motion to equivalent electrical signals. In this case, the energy source comes from the linear movement through induction, even without an external power source. Passive sensors do not need external stimulation to work. For example, a thermocouple will be able to convert heat directly to electrical signals.

Both analog and digital sensors are used. Analog sensors measure analog signals such as temperature and pressure. These output signals need to be digitized before communication with microcontrollers can take place. Digital sensors, on the other hand, can measure input signals such as light and use an internal rotating disc, for example, to output in digital formats.

Q. What is MEMS?

A. MEMS stands for microelectromechanical systems. Integrated circuit (IC) technology has miniaturized electrical circuitries. Multiple functions can now be packed in a smaller space than that required with the use of discrete components. For example, a MEMS miniature device using IC technology could add a third axis, in addition to the x and y axes, to measure movements. When a MEMS sensor is moved, it creates a difference in electrical potential internally, measured as a capacitance change.

Figure 3: MEMS sensors are used to simulate human functions by detecting changes in the environment. (Source: Yole Development)

MEMS combines both the electrical and mechanical functions in one package. The electrical elements perform data processing, and the mechanical elements respond and carry out the functions. It is like a miniature machine inside the IC packaging with dimensions varying from 1-100μ, approximately the thickness of a human hair. MEMS sensors have broad applications. For example, airbag MEMS sensors inside a vehicle will be able to sense the impact from a crash and trigger the deployment of the airbag(s). A 120-member, international consortium, SEMI-MEMS & Sensors Industry Group (MSIG), has dedicated themselves to promote the development of MEMS technology. It is expected that MEMS technology will continue to play an essential role in the world of sensors.

Part 2 will elaborate upon smart sensors, and key considerations when choosing sensors for your design.