ComputingNotes

Key Concepts and Terminology in Reinforcement Learning

by ComputingNotes
The Agent-Environment Interaction In Reinforcement Learning, the two core components are the Agent and the Environment. The environment serves as the simulated or physical world where the agent operates. 🤖 Agent Action (a_t) Observation & Reward 🌍 Environment In a continuous loop, the agent receives an observation detailing the current condition of this world. Based ... Read More

Deep Reinforcement Learning

by ComputingNotes
What is Deep Reinforcement Learning? Demystifying Deep Reinforcement Learning How AI learns to make decisions through trial and error. Let’s break down deep reinforcement learning (DRL). It is a type of artificial intelligence where a computer program learns to make a sequence of decisions through trial and error, guided by a system of rewards. The ... Read More

Reinforcement Learning – Gymnasium

by ComputingNotes
If you want to teach an Artificial Intelligence to play a video game, control a robot, or optimize a trading strategy, you need an environment for it to practice in. Enter Gymnasium (formerly OpenAI Gym), the standard API for single-agent Reinforcement Learning (RL). 1. The Agent-Environment Loop Reinforcement learning is fundamentally about trial and error. We don’t ... Read More

CDMA – Code Division Multiple Access

by ComputingNotes
Multiple Access is done using TDMA, FDMA and CDMA. CDMA is also multiple access technology. Example below show two users User 0 and User 1. a0 and a1 are data to be sent to users 0 and 1 respectively. Codes C0 is for User 0 data and C1 is for User 1 data. The key ... Read More

CDMA, FDMA, TDMA

by ComputingNotes
What is Multiple Access? Managing the digital traffic of our wireless world. Think of Multiple Access as the traffic controller for radio waves. It is the protocol that prevents millions of signals from crashing into each other on a shared communication channel. By organizing data from multiple transmitters into one structured data link, it prevents ... Read More

Deep Learning for Wireless Communications

by ComputingNotes
The 4-step AI workflow designed to solve complex parameter challenges in modern networks like 5G and Wi-Fi, bypassing the need for manual algorithms. 1 2 3 4 Data Preparation & Synthesis AI models require massive amounts of data. To overcome real-world data shortages, engineers synthesize millions of compliant waveforms using MATLAB apps, or capture live ... Read More

Data Packet

by ComputingNotes
What is a Data Packet? In wireless communications, large files (like an image or a video stream) are never sent as one continuous block. Instead, they are chopped up into thousands of tiny, manageable chunks called Data Packets. Think of a packet as a digital envelope moving through the postal system. Anatomy of a Packet ... Read More

Different types of modulation

by ComputingNotes
In wireless communication, modulation is the process of encoding information into a carrier wave by varying one or more of its properties. The various types of modulation can be categorized into analog, digital, and spread spectrum modulation. Analog Digital Spread Spectrum Types of Modulations 1. Analog Modulation While mostly replaced by digital systems in modern ... Read More

What are electromagnetic waves?

by ComputingNotes
Further, electromagnetic waves are different from mechanical wave which need medium to travel. What is an Electromagnetic Wave? Most waves we encounter like sound or water ripples are mechanical. They need matter (a “medium”) to travel, bumping molecules together like falling dominoes. But Electromagnetic (EM) waves are different. They don’t need a medium at all, ... Read More

How Data or Information travel wirelessly?

by ComputingNotes
Wireless communication relies on invisible electromagnetic waves that carry information through the air by altering their size or speed. By precisely manipulating these wave properties, using techniques like Amplitude Modulation (AM), Frequency Modulation (FM), and digital Frequency Shift Keying (FSK), devices can seamlessly transmit everything from analog radio broadcasts to high-speed Wi-Fi data. How Wireless ... Read More
error: